-- Logs begin at Wed 2022-08-24 13:40:47 UTC, end at Wed 2022-08-24 15:07:46 UTC. -- Aug 24 14:18:09.027186 dv-cinder-756710-6-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 14:18:09.036095 dv-cinder-756710-6-iscsi devstack@keystone.service[81730]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 14:18:09.038728 dv-cinder-756710-6-iscsi devstack@keystone.service[81730]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 14:18:09 2022] *** Aug 24 14:18:09.038857 dv-cinder-756710-6-iscsi devstack@keystone.service[81730]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 14:18:09.038969 dv-cinder-756710-6-iscsi devstack@keystone.service[81730]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 14:18:09.039069 dv-cinder-756710-6-iscsi devstack@keystone.service[81730]: nodename: dv-cinder-756710-6-iscsi Aug 24 14:18:09.039173 dv-cinder-756710-6-iscsi devstack@keystone.service[81730]: machine: x86_64 Aug 24 14:18:09.039280 dv-cinder-756710-6-iscsi devstack@keystone.service[81730]: clock source: unix Aug 24 14:18:09.039382 dv-cinder-756710-6-iscsi devstack@keystone.service[81730]: pcre jit disabled Aug 24 14:18:09.039486 dv-cinder-756710-6-iscsi devstack@keystone.service[81730]: detected number of CPU cores: 4 Aug 24 14:18:09.039595 dv-cinder-756710-6-iscsi devstack@keystone.service[81730]: current working directory: / Aug 24 14:18:09.039689 dv-cinder-756710-6-iscsi devstack@keystone.service[81730]: detected binary path: /usr/bin/uwsgi-core Aug 24 14:18:09.039822 dv-cinder-756710-6-iscsi devstack@keystone.service[81730]: your processes number limit is 47680 Aug 24 14:18:09.039822 dv-cinder-756710-6-iscsi devstack@keystone.service[81730]: your memory page size is 4096 bytes Aug 24 14:18:09.039822 dv-cinder-756710-6-iscsi devstack@keystone.service[81730]: detected max file descriptor number: 2048 Aug 24 14:18:09.039822 dv-cinder-756710-6-iscsi devstack@keystone.service[81730]: lock engine: pthread robust mutexes Aug 24 14:18:09.040088 dv-cinder-756710-6-iscsi devstack@keystone.service[81730]: thunder lock: enabled Aug 24 14:18:09.040153 dv-cinder-756710-6-iscsi devstack@keystone.service[81730]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 14:18:09.040209 dv-cinder-756710-6-iscsi devstack@keystone.service[81730]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 14:18:09.080312 dv-cinder-756710-6-iscsi devstack@keystone.service[81730]: Python main interpreter initialized at 0x55d4ddb609c0 Aug 24 14:18:09.080312 dv-cinder-756710-6-iscsi devstack@keystone.service[81730]: python threads support enabled Aug 24 14:18:09.080312 dv-cinder-756710-6-iscsi devstack@keystone.service[81730]: your server socket listen backlog is limited to 100 connections Aug 24 14:18:09.080312 dv-cinder-756710-6-iscsi devstack@keystone.service[81730]: your mercy for graceful operations on workers is 90 seconds Aug 24 14:18:09.080675 dv-cinder-756710-6-iscsi devstack@keystone.service[81730]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 14:18:09.080760 dv-cinder-756710-6-iscsi devstack@keystone.service[81730]: *** Operational MODE: preforking *** Aug 24 14:18:09.081014 dv-cinder-756710-6-iscsi devstack@keystone.service[81730]: *** uWSGI is running in multiple interpreter mode *** Aug 24 14:18:09.081014 dv-cinder-756710-6-iscsi devstack@keystone.service[81730]: spawned uWSGI master process (pid: 81730) Aug 24 14:18:09.081215 dv-cinder-756710-6-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 24 14:18:09.082525 dv-cinder-756710-6-iscsi devstack@keystone.service[81730]: spawned uWSGI worker 1 (pid: 81741, cores: 1) Aug 24 14:18:09.082525 dv-cinder-756710-6-iscsi devstack@keystone.service[81730]: spawned uWSGI worker 2 (pid: 81742, cores: 1) Aug 24 14:18:09.082525 dv-cinder-756710-6-iscsi devstack@keystone.service[81730]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 14:18:13.443297 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:18:13.443297 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: from cryptography.utils import int_from_bytes Aug 24 14:18:13.444090 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:18:13.444090 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: from cryptography.utils import int_from_bytes Aug 24 14:18:13.444524 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:18:13.444524 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: from cryptography.utils import int_from_bytes Aug 24 14:18:13.444632 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:18:13.444632 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: from cryptography.utils import int_from_bytes Aug 24 14:18:13.494569 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 14:18:13.494765 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 14:18:13.494765 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 14:18:13.494939 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 14:18:13.495024 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] command line args: [] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 14:18:13.495104 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] command line args: [] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 14:18:13.495184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 14:18:13.495263 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 14:18:13.495336 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ================================================================================ {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 14:18:13.495413 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ================================================================================ {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 14:18:13.495590 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] admin_token = **** {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.495672 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] admin_token = **** {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.495832 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] config_dir = [] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.495922 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] config_dir = [] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.496001 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.496078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.496187 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] config_source = [] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.496285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] config_source = [] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.496374 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] debug = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.496453 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] debug = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.496552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.496817 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.496915 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.496987 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.497137 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.497222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.497326 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.497399 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.497567 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.497658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.497824 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] list_limit = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.497916 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] list_limit = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.497986 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] log_config_append = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.498048 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] log_config_append = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.498168 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.498254 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.498321 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] log_dir = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.498385 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] log_dir = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.498482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] log_file = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.498551 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] log_file = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.498721 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.498843 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.499036 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.499123 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.499189 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.499357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.499471 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.499588 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.499677 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.499752 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.499878 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.500004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.500093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.500168 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.500306 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.500426 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.500510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.500640 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.500718 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.500849 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.500933 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.501012 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.501137 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.501222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.501312 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.501990 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.502136 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.503536 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.503620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.503747 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.503878 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.503878 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] publish_errors = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.504061 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.504149 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.504229 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] publish_errors = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.504308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.504385 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.504505 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.504580 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.504580 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.504762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.504860 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.504942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.505016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.505092 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] standard_threads = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.505166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] standard_threads = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.505243 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.505316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.505395 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.505395 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.505525 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.505602 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] use_journal = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.505676 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.505774 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] use_json = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.505866 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] use_journal = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.505941 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] use_stderr = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.506012 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] use_json = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.506089 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] use_syslog = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.506162 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] use_stderr = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.506251 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.506335 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] use_syslog = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.506335 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:18:13.506479 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.506479 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.506608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.506755 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.506830 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.506915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.506993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.507387 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.507476 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.507643 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.507729 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.507890 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.507976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.508144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.508230 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.508386 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.508467 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.508630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.508709 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.508877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.508957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.509108 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.509195 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.509350 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.509452 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.509582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.509675 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.509928 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.510037 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.510125 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.510197 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.510361 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.510439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.510611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.510691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.510860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.510950 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.511103 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.511190 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.511338 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.511419 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.511583 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.511668 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.511839 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.511917 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.512089 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.512170 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.512335 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.512416 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.512566 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.512652 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.512803 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.512879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.513009 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.513096 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.513242 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.513328 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.513480 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.513560 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.513723 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.513850 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.513972 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.514065 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.514200 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.514280 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.514436 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.514515 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.514678 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.514773 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.514916 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.515048 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.515160 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.515240 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.515389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.515478 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.515624 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.515704 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.515857 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.515976 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.516114 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.516230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.516336 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.516435 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.516549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.516649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.516778 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.516917 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.517006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.517799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.517879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.517941 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.518045 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.518159 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.518301 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.518381 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.518544 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.518625 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.518778 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.518865 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.519013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.519140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.519252 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.519333 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.519477 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.519556 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.519715 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.519806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.519950 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.520033 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.520184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.520270 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.520417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.520498 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.520650 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.520779 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.520879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.520959 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.521111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.521194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.521346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.521467 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.521582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.521662 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.521831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.521933 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.522139 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.522245 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.522336 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.522398 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.522558 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.522650 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.522793 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.522882 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.523026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.523106 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.523283 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.523371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.523518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.523604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.523763 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.523901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.524003 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.524164 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.524247 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.524415 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.524495 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.524660 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.524743 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.524893 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.524969 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.525130 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.525210 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.525360 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.525448 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.525600 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.525688 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.525858 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.525952 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.526100 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.526198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.526335 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.526429 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.526567 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.526648 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.526799 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.526880 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.527055 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.527142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.527291 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.527372 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.527530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.527614 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.527767 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.527869 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.528007 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.528088 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.528243 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.528323 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.528477 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.528566 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.528711 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.528791 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.528938 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.529018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.529166 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.529255 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.529394 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.529474 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.529627 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.529707 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.529878 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.529972 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.530115 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.530196 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.530348 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.530431 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.530592 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.530683 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.530826 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.530914 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.531076 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.531155 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.531320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.531409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.531556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.531643 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.531785 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] auth.external = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.531874 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.532014 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.532103 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.532283 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] auth.external = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.532362 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.532517 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.532641 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.532788 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] auth.password = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.532906 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.533145 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] auth.token = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.533239 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.533370 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.533457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] auth.password = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.533546 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.533622 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] auth.token = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.533787 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.533875 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.534007 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.534110 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.534254 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.534363 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.534501 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.534585 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.534731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.534839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.534966 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] credential.caching = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.535092 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.535212 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.535327 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.535458 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.535568 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] credential.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.535705 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.535819 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.535947 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.536074 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.536189 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.536323 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.536425 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.536566 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.536661 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.536813 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.536896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.537052 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.537133 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.537308 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.537438 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.537565 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.537646 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.537838 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.537924 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.538099 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.538194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.538367 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.538447 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.538625 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.538704 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.538922 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] federation.caching = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.539083 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.539162 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.539236 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.539391 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.539473 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.539635 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.539726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] federation.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.539864 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.539946 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.540108 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.540198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.540342 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.540432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.540580 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.540660 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.540816 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.540896 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.541069 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.541161 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.541305 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.541387 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.541550 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.541631 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.541808 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] identity.caching = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.547715 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.547833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.547916 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.547978 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.548051 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.548123 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.548210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.548274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.548334 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.548392 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.548450 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.548515 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.548576 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.548634 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.548691 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.548749 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.548806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.548875 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.548938 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.548996 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.549054 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.549111 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.549168 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.549233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.549307 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.549380 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.549452 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.549524 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.549597 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.549677 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.549741 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.549873 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.549963 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.550055 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.550130 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.550212 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.550288 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.550379 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.550442 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.550514 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.550576 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.550644 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.550718 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.550791 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.550864 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.550936 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.551009 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.551089 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.551165 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.551237 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.551237 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.551368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.551441 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.551521 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.551596 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.551675 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.551675 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.551807 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.551888 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.551970 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.552047 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.552120 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.552120 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.552251 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.552323 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.552403 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.552479 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.552551 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.552623 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.552696 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.552768 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.552848 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.552927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.552927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.553048 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.553048 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.553177 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.553258 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.553334 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.553407 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.553480 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.553553 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.553625 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.553705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.553800 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.553876 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.553948 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.554021 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.554093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.554181 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.554257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.554342 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.554443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.554520 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.554593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.554676 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.554751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.554824 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.554906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.554979 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.555060 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.555143 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.555208 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.555279 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.555352 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.555426 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.555505 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.555587 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.555663 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.555736 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.555809 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.555882 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.555962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.556038 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.556111 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.556202 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.556277 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.556350 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.556431 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.556513 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.556587 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.556660 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.556733 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.556811 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.556893 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.556968 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.557042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.557115 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.557188 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.557254 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.557333 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.557408 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.557481 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.557641 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.557725 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.557919 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.558013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.558163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.558245 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.558399 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.558482 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.558635 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.558728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.558869 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.558952 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.559104 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.559184 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.559346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.559438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.559585 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.559665 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.559820 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.559900 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.560057 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.560144 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.560289 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.560369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.560531 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.560612 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.560764 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.560854 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.560998 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.561079 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.561234 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.561315 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.561473 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.561701 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.561797 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.561861 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.562052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.562151 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.562226 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.562323 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.562443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] resource.caching = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.562527 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.562690 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.562779 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.562936 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.563027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.563171 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.563250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.563412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.563493 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.563657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] resource.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.563746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.564439 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.564551 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.564681 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.564880 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.564961 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.565129 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.565212 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.565388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.565470 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] role.caching = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.565645 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.565727 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] role.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.565913 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.565998 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.566168 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.566249 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.566411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.566492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.566654 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.566736 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.566893 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] role.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.566973 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.567135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.567216 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] role.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.567370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.567451 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.567611 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.567691 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.567857 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.567941 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.568089 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.568171 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.568332 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.568414 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.568576 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.568666 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.568820 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.568955 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.569063 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.569146 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.569341 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.569454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.569578 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.569690 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.569853 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.570039 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.570133 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.576366 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.576544 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.576630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.576705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.576779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.576779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.576913 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.576991 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.577065 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.577138 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.577211 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.577284 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.577367 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.577442 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.577515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.577588 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.577660 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.577733 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.577916 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.577994 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.578068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.578141 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.578213 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.578286 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.578367 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.578442 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.578516 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.578588 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.578661 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.578798 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.578903 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.578985 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] token.caching = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.579060 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.579122 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.579181 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.579248 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.579323 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.579412 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.579579 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.580161 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.580260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.580392 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.580519 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.580654 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.580789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] token.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.580927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.581060 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.581164 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.581242 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.581315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.581388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.581461 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.581461 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.581595 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.581671 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.581786 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.581869 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.581943 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.582021 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.582109 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.582186 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.582259 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.582333 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.582406 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.582479 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.582559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.582635 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] database.connection = **** {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.582717 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.582717 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.582860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.582934 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.583007 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.583007 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.583163 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.583231 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.583305 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.583378 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.583439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.583510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.583591 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.583591 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] database.connection = **** {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.583732 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.583816 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.583897 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.583973 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.584047 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.584127 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.584203 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.584275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.584348 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.584420 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.584492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.584638 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.584716 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.584790 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.584863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.584936 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.585009 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.585091 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.585166 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.585239 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.585311 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.585311 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.585442 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.585523 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 14:18:13.585599 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.585599 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.585599 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.585599 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.585599 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.585599 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.585599 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:18:13.585599 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 14:18:13.612554 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.612773 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.612994 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.613213 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.613449 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.613681 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.621472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.622231 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.652493 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.652719 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.653393 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.653630 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.714176 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.714616 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.763927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.764086 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.764607 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.764847 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.942154 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.942386 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.942480 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.942612 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.942700 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.942833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.942921 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.943051 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.943136 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.943269 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.943352 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.943492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.995451 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.995707 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.995812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.995896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.995997 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.996134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.996225 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.996329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.996398 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.996529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.996614 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.996738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.996821 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:13.997022 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:14.013559 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:14.014143 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:14.026508 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:14.026745 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:14.026871 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:14.026960 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:14.027102 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:14.027188 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:14.027324 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:14.027425 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:14.027551 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:14.027651 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:14.027767 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:14.027854 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:14.027985 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:14.028193 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:18:14.051957 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.052089 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.052177 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 14:18:14.052258 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 14:18:14.052491 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.052589 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.052687 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 14:18:14.052768 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 14:18:14.052952 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.053047 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.053212 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.053316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.053719 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.053846 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.054004 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.054097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.063265 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.063436 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.063544 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.063712 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.063804 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.064709 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.064817 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.065086 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.071781 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.072107 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.074790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.075075 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.075177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.075358 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.075443 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.075640 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.075725 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.075957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.076048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.076215 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.076302 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.076477 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.076569 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.076744 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.076826 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.077012 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.077129 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.077391 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.077483 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.077663 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.077743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.077951 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.100368 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.101327 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.101915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.102201 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.102817 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.103101 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.106907 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.107190 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.107471 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.107720 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.108002 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.108284 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.114503 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.114787 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.115488 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.115773 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.118828 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.119116 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.119398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.119679 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.119826 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.119955 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.120116 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.120229 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.120400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.120483 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.120684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.120766 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.120960 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.121234 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.121502 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.121788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.138660 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.138940 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.139902 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.140179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.142900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.144432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.150546 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.150546 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.150797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.150797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.150938 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.152073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.153698 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.155188 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.156945 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.157244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.157532 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.158010 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.158434 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.158727 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.158811 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.159077 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.159364 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.159650 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.159938 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.160230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.175085 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.175372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.175635 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.175906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.177037 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.177325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.177592 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.177882 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.182740 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.184250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.184530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.184791 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.186343 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.186616 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.187226 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.187510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.187810 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.188102 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.188382 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.190164 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.190456 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.190750 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.191041 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.191317 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.200331 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.200609 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.213653 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.213653 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.213653 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.213653 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.213653 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.214062 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.214062 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.214062 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.214062 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.214062 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.214062 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.214451 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.217489 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.219862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.221049 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.223725 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.223928 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.225355 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.226607 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.226823 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.227104 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.227399 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.228026 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.229466 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.229764 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.230058 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.233896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.235338 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.237534 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.239027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.239119 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.239316 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.260264 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.260264 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.260900 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.260900 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.260900 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.260900 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.261185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.261185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.261185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.261354 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.261354 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.261354 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.261509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.261509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.261509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.261509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.261509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.261509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.261509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.261934 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.261934 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.261934 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.261934 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.261934 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.261934 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.262263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.262325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:18:14.262325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.262325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.262325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.262325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.262325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.262325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.262702 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.262702 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.262702 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.262702 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.262702 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.262702 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.263002 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:18:14.293406 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d4ddb609c0 pid: 81742 (default app) Aug 24 14:18:14.296869 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb3c0f-0b02-48df-a1b8-28ce011702df None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:14.297154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb3c0f-0b02-48df-a1b8-28ce011702df None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:14.297292 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d4ddb609c0 pid: 81741 (default app) Aug 24 14:18:14.297425 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb3c0f-0b02-48df-a1b8-28ce011702df None None] PATH_INFO: `/v3` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:14.302352 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 791 bytes} [Wed Aug 24 14:18:14 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:21.842763 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c6c89-7b2e-423c-ac76-e2bbbad43f82 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:21.843281 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c6c89-7b2e-423c-ac76-e2bbbad43f82 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:21.843281 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c6c89-7b2e-423c-ac76-e2bbbad43f82 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:21.848412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1/2] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:18:21.854854 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fca0c9-cd20-493b-9e08-ce05e5ada3f9 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:21.855286 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fca0c9-cd20-493b-9e08-ce05e5ada3f9 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:21.855405 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fca0c9-cd20-493b-9e08-ce05e5ada3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:21.927668 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: INFO dbcounter [None req-e3fca0c9-cd20-493b-9e08-ce05e5ada3f9 None None] Registered counter for database keystone Aug 24 14:18:21.946796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG oslo_db.sqlalchemy.engines [None req-e3fca0c9-cd20-493b-9e08-ce05e5ada3f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81742) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:18:21.952950 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writer thread running {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:18:22.136615 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG passlib.handlers.bcrypt [None req-e3fca0c9-cd20-493b-9e08-ce05e5ada3f9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81742) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 14:18:22.136970 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG passlib.handlers.bcrypt [None req-e3fca0c9-cd20-493b-9e08-ce05e5ada3f9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81742) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 14:18:22.191588 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-e3fca0c9-cd20-493b-9e08-ce05e5ada3f9 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:22.193188 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e3fca0c9-cd20-493b-9e08-ce05e5ada3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:22.321262 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 2/3] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 14:18:22.807577 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c6c89-7b2e-423c-ac76-e2bbbad43f82 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:22.876264 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: INFO dbcounter [None req-ee2c6c89-7b2e-423c-ac76-e2bbbad43f82 None None] Registered counter for database keystone Aug 24 14:18:22.898316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG oslo_db.sqlalchemy.engines [None req-ee2c6c89-7b2e-423c-ac76-e2bbbad43f82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81741) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:18:22.904444 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writer thread running {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:18:23.026154 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c6c89-7b2e-423c-ac76-e2bbbad43f82 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:23.030451 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38863e91-23a9-47d0-b561-2f765205b482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:23.031068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38863e91-23a9-47d0-b561-2f765205b482 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:23.031345 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38863e91-23a9-47d0-b561-2f765205b482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:23.031617 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38863e91-23a9-47d0-b561-2f765205b482 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:23.039648 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38863e91-23a9-47d0-b561-2f765205b482 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:23.094375 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: WARNING keystone.common.rbac_enforcer.enforcer [None req-38863e91-23a9-47d0-b561-2f765205b482 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 14:18:23.094660 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38863e91-23a9-47d0-b561-2f765205b482 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:23.104427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 2/4] 10.222.0.65 () {58 vars in 1324 bytes} [Wed Aug 24 14:18:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 14:18:23.110497 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fca0c9-cd20-493b-9e08-ce05e5ada3f9 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:23.125416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fca0c9-cd20-493b-9e08-ce05e5ada3f9 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:23.130558 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5233c4-f9db-4013-b055-ce2443b7c85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:23.131664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5233c4-f9db-4013-b055-ce2443b7c85a admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:23.132215 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5233c4-f9db-4013-b055-ce2443b7c85a admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:23.132491 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5233c4-f9db-4013-b055-ce2443b7c85a admin admin] PATH_INFO: `/v3/projects/4f4410563d8b45fea6a29fd68277b77c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:23.134086 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5233c4-f9db-4013-b055-ce2443b7c85a admin admin] RBAC: Authorizing `identity:get_project(project_id=4f4410563d8b45fea6a29fd68277b77c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:23.186135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7d5233c4-f9db-4013-b055-ce2443b7c85a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 14:18:23.186477 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5233c4-f9db-4013-b055-ce2443b7c85a admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:23.191955 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 3/5] 10.222.0.65 () {56 vars in 1207 bytes} [Wed Aug 24 14:18:23 2022] GET /identity/v3/projects/4f4410563d8b45fea6a29fd68277b77c => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:25.073902 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48c04b-9875-4ed3-a39f-e011fdee66d4 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:25.074449 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48c04b-9875-4ed3-a39f-e011fdee66d4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:25.074449 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48c04b-9875-4ed3-a39f-e011fdee66d4 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:25.078545 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 3/6] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:18:25.083959 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729e887-e348-41c2-ab05-a3b7eef120d5 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:25.084330 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729e887-e348-41c2-ab05-a3b7eef120d5 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:25.084515 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729e887-e348-41c2-ab05-a3b7eef120d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:25.104482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a729e887-e348-41c2-ab05-a3b7eef120d5 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:25.106030 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a729e887-e348-41c2-ab05-a3b7eef120d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:25.114507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 4/7] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 14:18:25.387497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48c04b-9875-4ed3-a39f-e011fdee66d4 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:25.400025 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48c04b-9875-4ed3-a39f-e011fdee66d4 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:25.404169 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a042bcd-672e-446b-aebd-245abf93628d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:25.404923 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a042bcd-672e-446b-aebd-245abf93628d admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:25.405202 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a042bcd-672e-446b-aebd-245abf93628d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:25.405472 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a042bcd-672e-446b-aebd-245abf93628d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:25.414273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a042bcd-672e-446b-aebd-245abf93628d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:25.415054 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a042bcd-672e-446b-aebd-245abf93628d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:25.424472 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 4/8] 10.222.0.65 () {58 vars in 1324 bytes} [Wed Aug 24 14:18:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 14:18:25.429938 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729e887-e348-41c2-ab05-a3b7eef120d5 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:25.439760 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729e887-e348-41c2-ab05-a3b7eef120d5 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:25.444342 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd2719-ee1a-439e-9228-99c759ca3633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:25.444967 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd2719-ee1a-439e-9228-99c759ca3633 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:25.445247 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd2719-ee1a-439e-9228-99c759ca3633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:25.445521 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd2719-ee1a-439e-9228-99c759ca3633 admin admin] PATH_INFO: `/v3/users/438e8adacb8940c696f3738e6ff13c30` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:25.446886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd2719-ee1a-439e-9228-99c759ca3633 admin admin] RBAC: Authorizing `identity:get_user(user_id=438e8adacb8940c696f3738e6ff13c30)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:25.448754 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd2719-ee1a-439e-9228-99c759ca3633 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:25.450315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 5/9] 10.222.0.65 () {56 vars in 1198 bytes} [Wed Aug 24 14:18:25 2022] GET /identity/v3/users/438e8adacb8940c696f3738e6ff13c30 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:27.424718 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e49683-1d93-429c-8e15-ed0877eb9592 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:27.425295 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e49683-1d93-429c-8e15-ed0877eb9592 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:27.425295 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e49683-1d93-429c-8e15-ed0877eb9592 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:27.426631 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 5/10] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:18:27.432128 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc44bd5-5266-491d-af4b-b5a84ed8bb03 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:27.432524 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc44bd5-5266-491d-af4b-b5a84ed8bb03 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:27.432809 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc44bd5-5266-491d-af4b-b5a84ed8bb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:27.448601 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b938c7-df53-44ab-839b-22939b80575b None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:27.448885 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b938c7-df53-44ab-839b-22939b80575b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:27.449160 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b938c7-df53-44ab-839b-22939b80575b None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:27.450492 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 6/11] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:18:27.451298 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-3cc44bd5-5266-491d-af4b-b5a84ed8bb03 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:27.452523 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3cc44bd5-5266-491d-af4b-b5a84ed8bb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:27.455570 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d88c2-ef63-4ed2-9302-74131e042da8 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:27.455852 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d88c2-ef63-4ed2-9302-74131e042da8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:27.456202 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d88c2-ef63-4ed2-9302-74131e042da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:27.498006 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG passlib.handlers.bcrypt [None req-4f5d88c2-ef63-4ed2-9302-74131e042da8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81741) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 14:18:27.498423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG passlib.handlers.bcrypt [None req-4f5d88c2-ef63-4ed2-9302-74131e042da8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81741) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 14:18:27.533922 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 6/12] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:18:27.544365 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4f5d88c2-ef63-4ed2-9302-74131e042da8 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:27.546009 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4f5d88c2-ef63-4ed2-9302-74131e042da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:27.645545 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 7/13] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:18:27.803210 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc44bd5-5266-491d-af4b-b5a84ed8bb03 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:27.826548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:27.906628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc44bd5-5266-491d-af4b-b5a84ed8bb03 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:27.910149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d88c2-ef63-4ed2-9302-74131e042da8 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:27.942181 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fabc354-86ab-4444-909e-283203e1bf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:27.942822 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabc354-86ab-4444-909e-283203e1bf3d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:27.943111 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabc354-86ab-4444-909e-283203e1bf3d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:27.943389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabc354-86ab-4444-909e-283203e1bf3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:27.956129 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fabc354-86ab-4444-909e-283203e1bf3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:18:27.964583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-6fabc354-86ab-4444-909e-283203e1bf3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:18:27.964583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:18:27.964583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:18:27.964583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:18:27.964583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:18:27.964583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:18:27.964583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:18:27.964583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:18:27.964583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:18:27.964583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:18:27.964583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:18:27.964583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:18:27.964583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:18:27.964583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:18:27.964583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:18:27.964583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:18:27.965556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:18:27.965556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:18:27.965556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:18:27.965556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:18:27.965556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:18:27.965556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:18:27.965556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:18:27.965556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:18:27.965556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:18:27.965556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:18:27.965556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:18:27.965556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:18:27.965556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:18:27.965556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:18:27.965556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:18:27.965556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:18:27.966426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:18:27.966426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:18:27.966426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:18:27.966426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:18:27.966426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:18:27.966426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:18:27.966426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:18:27.966426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:18:27.966426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:18:27.966426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:18:27.966426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:18:27.966426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:18:27.966426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 7/14] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:18:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:18:27.971819 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fabc354-86ab-4444-909e-283203e1bf3d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:28.013274 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d88c2-ef63-4ed2-9302-74131e042da8 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:28.015611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:28.052112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c6758-5e47-4587-9e4c-9ffc0a0754eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:28.052982 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c6758-5e47-4587-9e4c-9ffc0a0754eb None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:28.053315 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c6758-5e47-4587-9e4c-9ffc0a0754eb None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:28.053541 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c6758-5e47-4587-9e4c-9ffc0a0754eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:28.056236 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:28.074530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fabc354-86ab-4444-909e-283203e1bf3d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:28.107584 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f279bb8-7c72-4fe6-aed1-3175d0585c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:28.108177 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f279bb8-7c72-4fe6-aed1-3175d0585c00 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:28.108456 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f279bb8-7c72-4fe6-aed1-3175d0585c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:28.108724 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f279bb8-7c72-4fe6-aed1-3175d0585c00 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:28.109385 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f279bb8-7c72-4fe6-aed1-3175d0585c00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:28.109682 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f279bb8-7c72-4fe6-aed1-3175d0585c00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:28.111671 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f279bb8-7c72-4fe6-aed1-3175d0585c00 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:28.121610 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c6758-5e47-4587-9e4c-9ffc0a0754eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:28.123295 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 8/15] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:18:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:18:28.123423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c6758-5e47-4587-9e4c-9ffc0a0754eb None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:28.129346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f279bb8-7c72-4fe6-aed1-3175d0585c00 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:28.224267 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 8/16] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:18:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 14:18:28.228266 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f279bb8-7c72-4fe6-aed1-3175d0585c00 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:28.229919 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c6758-5e47-4587-9e4c-9ffc0a0754eb None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:28.232573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:28.262997 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60954c2-b552-43ec-8965-082346765d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:28.263631 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60954c2-b552-43ec-8965-082346765d5b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:28.263920 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60954c2-b552-43ec-8965-082346765d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:28.264197 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60954c2-b552-43ec-8965-082346765d5b None admin] PATH_INFO: `/v3/users/438e8adacb8940c696f3738e6ff13c30` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:28.265356 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60954c2-b552-43ec-8965-082346765d5b None admin] RBAC: Authorizing `identity:get_user(user_id=438e8adacb8940c696f3738e6ff13c30)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:28.266839 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60954c2-b552-43ec-8965-082346765d5b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:28.268951 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 9/17] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:18:28 2022] GET /identity/v3/users/438e8adacb8940c696f3738e6ff13c30 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:18:28.274461 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60954c2-b552-43ec-8965-082346765d5b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:28.289282 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:28.331189 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c6758-5e47-4587-9e4c-9ffc0a0754eb None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:28.364899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c68b9-38b9-49d6-ab99-c0a354e2b145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:28.366046 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c68b9-38b9-49d6-ab99-c0a354e2b145 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:28.366336 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c68b9-38b9-49d6-ab99-c0a354e2b145 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:28.366610 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c68b9-38b9-49d6-ab99-c0a354e2b145 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:28.374055 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60954c2-b552-43ec-8965-082346765d5b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:28.384870 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c68b9-38b9-49d6-ab99-c0a354e2b145 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:28.386366 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c68b9-38b9-49d6-ab99-c0a354e2b145 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:28.404959 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-012c68b9-38b9-49d6-ab99-c0a354e2b145 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:18:28.404959 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:18:28.404959 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:18:28.404959 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:18:28.404959 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:18:28.404959 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:18:28.404959 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:18:28.404959 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:18:28.404959 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:18:28.404959 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:18:28.404959 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:18:28.404959 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:18:28.404959 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:18:28.404959 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:18:28.404959 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:18:28.404959 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:18:28.405966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:18:28.405966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:18:28.405966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:18:28.405966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:18:28.405966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:18:28.405966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:18:28.405966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:18:28.405966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:18:28.405966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:18:28.405966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:18:28.405966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:18:28.405966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:18:28.405966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:18:28.405966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:18:28.405966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:18:28.405966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:18:28.405966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:18:28.407408 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:18:28.407408 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:18:28.407408 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:18:28.407408 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 9/18] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:18:28.408455 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af95768-c2ab-4121-9496-a555d681b5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:28.409111 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af95768-c2ab-4121-9496-a555d681b5fe None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:28.409393 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af95768-c2ab-4121-9496-a555d681b5fe None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:28.409671 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af95768-c2ab-4121-9496-a555d681b5fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:28.410840 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af95768-c2ab-4121-9496-a555d681b5fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:28.412277 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c68b9-38b9-49d6-ab99-c0a354e2b145 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:28.412388 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af95768-c2ab-4121-9496-a555d681b5fe None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:28.418575 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 10/19] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:18:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:18:28.419504 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af95768-c2ab-4121-9496-a555d681b5fe None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:28.468744 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:28.500598 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:28.511513 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c68b9-38b9-49d6-ab99-c0a354e2b145 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:28.520342 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af95768-c2ab-4121-9496-a555d681b5fe None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:28.545974 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebc785-dc7d-4586-b86d-ea52d0b756fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:28.546585 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebc785-dc7d-4586-b86d-ea52d0b756fe None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:28.546865 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebc785-dc7d-4586-b86d-ea52d0b756fe None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:28.547149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebc785-dc7d-4586-b86d-ea52d0b756fe None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:28.547793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbebc785-dc7d-4586-b86d-ea52d0b756fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:28.548094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbebc785-dc7d-4586-b86d-ea52d0b756fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:28.549539 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbebc785-dc7d-4586-b86d-ea52d0b756fe None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:28.554687 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e29ab2-ab84-44e4-a0d8-d697b9a25726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:28.555281 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e29ab2-ab84-44e4-a0d8-d697b9a25726 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:28.555561 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e29ab2-ab84-44e4-a0d8-d697b9a25726 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:28.555834 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e29ab2-ab84-44e4-a0d8-d697b9a25726 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:28.556562 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e29ab2-ab84-44e4-a0d8-d697b9a25726 None admin] RBAC: Adding query filter params (role.id=b779073cee3c470ca4ad7a7b27d72c5e, scope.domain.id=default, user.id=438e8adacb8940c696f3738e6ff13c30) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:28.556896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e29ab2-ab84-44e4-a0d8-d697b9a25726 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:28.558357 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e29ab2-ab84-44e4-a0d8-d697b9a25726 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:28.565538 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 11/20] 10.222.0.65 () {56 vars in 1322 bytes} [Wed Aug 24 14:18:28 2022] GET /identity/v3/role_assignments?user.id=438e8adacb8940c696f3738e6ff13c30&scope.domain.id=default&role.id=b779073cee3c470ca4ad7a7b27d72c5e => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:28.569303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 10/21] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:18:30.547791 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95b806-7dc8-49ea-bf39-2c99138b3cd3 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:30.548875 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95b806-7dc8-49ea-bf39-2c99138b3cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:30.549232 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95b806-7dc8-49ea-bf39-2c99138b3cd3 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:30.550658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 12/22] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:18:30.555934 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cf996-4a50-4217-9d14-0920b917dbed None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:30.556779 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cf996-4a50-4217-9d14-0920b917dbed None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:30.557253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cf996-4a50-4217-9d14-0920b917dbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:30.586882 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c67cf996-4a50-4217-9d14-0920b917dbed None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:30.588463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c67cf996-4a50-4217-9d14-0920b917dbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:30.674556 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 11/23] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:18:30.735352 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f6d36-3681-4479-8dfd-3fd3508d5537 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:30.736731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f6d36-3681-4479-8dfd-3fd3508d5537 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:30.737394 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f6d36-3681-4479-8dfd-3fd3508d5537 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:30.739192 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 13/24] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:18:30.744883 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f2e6a-3ccb-4af8-8705-f211869a0f0a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:30.745418 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f2e6a-3ccb-4af8-8705-f211869a0f0a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:30.745910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f2e6a-3ccb-4af8-8705-f211869a0f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:30.774838 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-8c7f2e6a-3ccb-4af8-8705-f211869a0f0a None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:30.776384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8c7f2e6a-3ccb-4af8-8705-f211869a0f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:30.829537 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:30.861129 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 12/25] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:18:31.053887 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f6d36-3681-4479-8dfd-3fd3508d5537 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:31.068248 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9db4c1-8ef4-451e-b392-1a4203233366 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:31.068529 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9db4c1-8ef4-451e-b392-1a4203233366 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:31.068796 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9db4c1-8ef4-451e-b392-1a4203233366 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:31.070287 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 13/26] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:18:31.077809 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21faa48-41e2-493f-ba77-a5c56be96d27 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:31.078098 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21faa48-41e2-493f-ba77-a5c56be96d27 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:31.078375 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21faa48-41e2-493f-ba77-a5c56be96d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:31.118884 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f21faa48-41e2-493f-ba77-a5c56be96d27 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:31.119999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f21faa48-41e2-493f-ba77-a5c56be96d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:31.196526 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f6d36-3681-4479-8dfd-3fd3508d5537 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:31.211242 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 14/27] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:18:31.241229 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abeb19c-91b6-4985-8ccd-a527c5fac6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:31.242187 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abeb19c-91b6-4985-8ccd-a527c5fac6ae None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:31.242660 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abeb19c-91b6-4985-8ccd-a527c5fac6ae None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:31.243152 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abeb19c-91b6-4985-8ccd-a527c5fac6ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:31.254007 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abeb19c-91b6-4985-8ccd-a527c5fac6ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:18:31.260204 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-2abeb19c-91b6-4985-8ccd-a527c5fac6ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:18:31.260204 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:18:31.260204 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:18:31.260204 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:18:31.260204 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:18:31.260204 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:18:31.260204 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:18:31.260204 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:18:31.260204 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:18:31.260204 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:18:31.260204 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:18:31.260204 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:18:31.260204 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:18:31.260204 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:18:31.260204 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:18:31.260204 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:18:31.261025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:18:31.261025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:18:31.261025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:18:31.261025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:18:31.261025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:18:31.261025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:18:31.261025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:18:31.261025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:18:31.261025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:18:31.261025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:18:31.261025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:18:31.261025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:18:31.261025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:18:31.261025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:18:31.261025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:18:31.261025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:18:31.261821 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:18:31.261821 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:18:31.261821 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:18:31.261821 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:18:31.261821 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:18:31.261821 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:18:31.261821 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:18:31.261821 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:18:31.261821 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:18:31.261821 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:18:31.261821 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:18:31.261821 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:18:31.264233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 14/28] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:18:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:18:31.275862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21faa48-41e2-493f-ba77-a5c56be96d27 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:31.403500 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21faa48-41e2-493f-ba77-a5c56be96d27 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:31.416356 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:31.449193 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856f55b-f15b-491d-95c5-aceabf8f36b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:31.450392 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856f55b-f15b-491d-95c5-aceabf8f36b2 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:31.450883 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856f55b-f15b-491d-95c5-aceabf8f36b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:31.451357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856f55b-f15b-491d-95c5-aceabf8f36b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:31.452300 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856f55b-f15b-491d-95c5-aceabf8f36b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:31.452808 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856f55b-f15b-491d-95c5-aceabf8f36b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:31.454581 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856f55b-f15b-491d-95c5-aceabf8f36b2 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:31.473150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 15/29] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:18:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:31.475364 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abeb19c-91b6-4985-8ccd-a527c5fac6ae None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:31.479476 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:31.489335 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856f55b-f15b-491d-95c5-aceabf8f36b2 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:31.668850 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856f55b-f15b-491d-95c5-aceabf8f36b2 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:31.686169 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abeb19c-91b6-4985-8ccd-a527c5fac6ae None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:31.726711 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa684f4-7403-4248-8b03-01392c077b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:31.727816 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa684f4-7403-4248-8b03-01392c077b87 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:31.728101 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa684f4-7403-4248-8b03-01392c077b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:31.728377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa684f4-7403-4248-8b03-01392c077b87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:31.730464 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a07f2-8927-4965-b462-b1aaceca8722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:31.731186 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a07f2-8927-4965-b462-b1aaceca8722 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:31.735525 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a07f2-8927-4965-b462-b1aaceca8722 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:31.735525 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a07f2-8927-4965-b462-b1aaceca8722 None admin] PATH_INFO: `/v3/users/438e8adacb8940c696f3738e6ff13c30` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:31.735525 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a07f2-8927-4965-b462-b1aaceca8722 None admin] RBAC: Authorizing `identity:get_user(user_id=438e8adacb8940c696f3738e6ff13c30)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:31.735525 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a07f2-8927-4965-b462-b1aaceca8722 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:31.737475 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 16/30] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:18:31 2022] GET /identity/v3/users/438e8adacb8940c696f3738e6ff13c30 => generated 247 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:31.738778 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69418161-3e08-4c70-bf50-3bbc473d80a2 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:31.739065 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69418161-3e08-4c70-bf50-3bbc473d80a2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:31.739346 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69418161-3e08-4c70-bf50-3bbc473d80a2 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:31.747216 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 17/31] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:18:31.747216 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69418161-3e08-4c70-bf50-3bbc473d80a2 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:31.747448 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa684f4-7403-4248-8b03-01392c077b87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:31.750597 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa684f4-7403-4248-8b03-01392c077b87 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:31.768599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-3aa684f4-7403-4248-8b03-01392c077b87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:18:31.768599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:18:31.768599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:18:31.768599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:18:31.768599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:18:31.768599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:18:31.768599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:18:31.768599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:18:31.768599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:18:31.768599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:18:31.768599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:18:31.768599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:18:31.768599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:18:31.768599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:18:31.768599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:18:31.768599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:18:31.769707 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:18:31.769707 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:18:31.769707 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:18:31.769707 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:18:31.769707 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:18:31.769707 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:18:31.769707 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:18:31.769707 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:18:31.769707 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:18:31.769707 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:18:31.769707 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:18:31.769707 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:18:31.769707 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:18:31.769707 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:18:31.769707 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:18:31.769707 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:18:31.769707 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:18:31.770796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:18:31.770796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:18:31.770796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:18:31.772660 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 15/32] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:18:31.774119 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfe629-c306-4dd9-9c98-ab1d5d800952 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:31.774569 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfe629-c306-4dd9-9c98-ab1d5d800952 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:31.774985 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfe629-c306-4dd9-9c98-ab1d5d800952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:31.793327 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:31.795157 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-0abfe629-c306-4dd9-9c98-ab1d5d800952 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:31.798072 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0abfe629-c306-4dd9-9c98-ab1d5d800952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:31.854782 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:31.879286 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 16/33] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:18:31.879286 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfe629-c306-4dd9-9c98-ab1d5d800952 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:31.884394 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69418161-3e08-4c70-bf50-3bbc473d80a2 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:31.956308 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7178c33-40b3-40ac-a334-0be13869fdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:31.956836 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7178c33-40b3-40ac-a334-0be13869fdb3 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:31.957114 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7178c33-40b3-40ac-a334-0be13869fdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:31.957385 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7178c33-40b3-40ac-a334-0be13869fdb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:31.958085 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7178c33-40b3-40ac-a334-0be13869fdb3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:31.959459 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7178c33-40b3-40ac-a334-0be13869fdb3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:32.029804 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfe629-c306-4dd9-9c98-ab1d5d800952 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:32.066296 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273b3ee-6367-4914-a2da-20d61bd9af9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:32.066998 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273b3ee-6367-4914-a2da-20d61bd9af9d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:32.067278 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273b3ee-6367-4914-a2da-20d61bd9af9d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:32.067558 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273b3ee-6367-4914-a2da-20d61bd9af9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:32.068701 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273b3ee-6367-4914-a2da-20d61bd9af9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:32.074018 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273b3ee-6367-4914-a2da-20d61bd9af9d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:32.075712 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 17/34] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:18:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:32.076480 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273b3ee-6367-4914-a2da-20d61bd9af9d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:32.178979 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:32.205232 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 18/35] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Aug 24 14:18:31 2022] POST /identity/v3/roles => generated 219 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:18:32.206776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7178c33-40b3-40ac-a334-0be13869fdb3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:32.249998 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273b3ee-6367-4914-a2da-20d61bd9af9d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:32.331799 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17978b-2d1c-4ad4-bd9c-9b29ec99644a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:32.332452 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17978b-2d1c-4ad4-bd9c-9b29ec99644a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:32.332738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17978b-2d1c-4ad4-bd9c-9b29ec99644a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:32.333019 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17978b-2d1c-4ad4-bd9c-9b29ec99644a None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:32.333678 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17978b-2d1c-4ad4-bd9c-9b29ec99644a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:32.334005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17978b-2d1c-4ad4-bd9c-9b29ec99644a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:32.335429 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17978b-2d1c-4ad4-bd9c-9b29ec99644a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:32.381347 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 18/36] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:32.382440 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17978b-2d1c-4ad4-bd9c-9b29ec99644a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:32.404244 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:32.411399 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7178c33-40b3-40ac-a334-0be13869fdb3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:32.449166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318c4f9-5597-4226-9a4f-e02bd4b85587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:32.450395 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318c4f9-5597-4226-9a4f-e02bd4b85587 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:32.450879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318c4f9-5597-4226-9a4f-e02bd4b85587 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:32.451354 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318c4f9-5597-4226-9a4f-e02bd4b85587 None admin] PATH_INFO: `/v3/domains/default/users/438e8adacb8940c696f3738e6ff13c30/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:32.453810 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e318c4f9-5597-4226-9a4f-e02bd4b85587 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=438e8adacb8940c696f3738e6ff13c30, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:32.456538 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e318c4f9-5597-4226-9a4f-e02bd4b85587 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:32.503073 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17978b-2d1c-4ad4-bd9c-9b29ec99644a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:32.519241 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:32.541334 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af8d55-efc4-410e-885c-3a5de9260e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:32.541977 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af8d55-efc4-410e-885c-3a5de9260e59 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:32.542263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af8d55-efc4-410e-885c-3a5de9260e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:32.542539 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af8d55-efc4-410e-885c-3a5de9260e59 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:32.543243 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af8d55-efc4-410e-885c-3a5de9260e59 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:32.544746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af8d55-efc4-410e-885c-3a5de9260e59 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:32.551970 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 19/37] 10.222.0.65 () {58 vars in 1361 bytes} [Wed Aug 24 14:18:32 2022] PUT /identity/v3/domains/default/users/438e8adacb8940c696f3738e6ff13c30/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:18:32.552866 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318c4f9-5597-4226-9a4f-e02bd4b85587 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:32.678424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318c4f9-5597-4226-9a4f-e02bd4b85587 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:32.717077 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce867a2-53f2-4ec5-8e44-48e5133f0fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:32.717774 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce867a2-53f2-4ec5-8e44-48e5133f0fed None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:32.718066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce867a2-53f2-4ec5-8e44-48e5133f0fed None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:32.718344 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce867a2-53f2-4ec5-8e44-48e5133f0fed None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:32.719000 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce867a2-53f2-4ec5-8e44-48e5133f0fed None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:32.720546 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce867a2-53f2-4ec5-8e44-48e5133f0fed None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:32.755974 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 19/38] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Aug 24 14:18:32 2022] POST /identity/v3/roles => generated 225 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:18:32.758316 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25573e-c794-481e-b921-d00ec0abb4ec None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:32.758608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25573e-c794-481e-b921-d00ec0abb4ec None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:32.758886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25573e-c794-481e-b921-d00ec0abb4ec None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:32.760164 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 20/39] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:18:32.761210 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa8b5b-c223-4907-b058-b1000a38702d None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:32.761549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa8b5b-c223-4907-b058-b1000a38702d None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:32.761851 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa8b5b-c223-4907-b058-b1000a38702d None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:32.763166 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 21/40] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:18:32.769164 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610f5d8-e756-4063-8010-0a68e9970ef8 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:32.769461 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610f5d8-e756-4063-8010-0a68e9970ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:32.769740 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610f5d8-e756-4063-8010-0a68e9970ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:32.790512 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-2610f5d8-e756-4063-8010-0a68e9970ef8 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:32.792115 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2610f5d8-e756-4063-8010-0a68e9970ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:32.824615 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 20/41] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 14:18:32 2022] POST /identity/v3/projects => generated 301 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:18:32.826982 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc9509-df2b-4a41-8ec7-042e52855cc7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:32.827276 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc9509-df2b-4a41-8ec7-042e52855cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:32.827841 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc9509-df2b-4a41-8ec7-042e52855cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:32.872048 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-aebc9509-df2b-4a41-8ec7-042e52855cc7 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:32.873781 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-aebc9509-df2b-4a41-8ec7-042e52855cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:32.877249 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:32.923018 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 22/42] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:18:32.979398 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 21/43] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:18:33.234831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610f5d8-e756-4063-8010-0a68e9970ef8 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:33.252245 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc9509-df2b-4a41-8ec7-042e52855cc7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:33.342154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610f5d8-e756-4063-8010-0a68e9970ef8 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:33.344553 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:33.367001 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc9509-df2b-4a41-8ec7-042e52855cc7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:33.375918 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c602f-c850-4ad0-8ae8-8112eabca52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:33.376561 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c602f-c850-4ad0-8ae8-8112eabca52b None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:33.376841 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c602f-c850-4ad0-8ae8-8112eabca52b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:33.377118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c602f-c850-4ad0-8ae8-8112eabca52b None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:33.377835 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c602f-c850-4ad0-8ae8-8112eabca52b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:33.379331 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c602f-c850-4ad0-8ae8-8112eabca52b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:33.403590 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6f638-2238-42c6-9d75-34feda3a1bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:33.404223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6f638-2238-42c6-9d75-34feda3a1bde None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:33.404504 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6f638-2238-42c6-9d75-34feda3a1bde None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:33.404776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6f638-2238-42c6-9d75-34feda3a1bde None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:33.406017 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6f638-2238-42c6-9d75-34feda3a1bde None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:33.408044 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6f638-2238-42c6-9d75-34feda3a1bde None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:33.410007 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 22/44] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:18:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:18:33.415251 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6f638-2238-42c6-9d75-34feda3a1bde None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:33.423773 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:33.448604 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 23/45] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Aug 24 14:18:33 2022] POST /identity/v3/roles => generated 223 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:18:33.530343 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6f638-2238-42c6-9d75-34feda3a1bde None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:33.568109 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7206f30-0b75-411a-9638-356ea8f05eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:33.568733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7206f30-0b75-411a-9638-356ea8f05eed None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:33.569016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7206f30-0b75-411a-9638-356ea8f05eed None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:33.569351 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7206f30-0b75-411a-9638-356ea8f05eed None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:33.570061 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7206f30-0b75-411a-9638-356ea8f05eed None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:33.571564 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7206f30-0b75-411a-9638-356ea8f05eed None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:33.667113 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 23/46] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 14:18:33 2022] POST /identity/v3/projects => generated 312 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:18:34.545519 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afb380-d165-4bd7-93a2-fe2ccad3b1f0 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:34.546067 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afb380-d165-4bd7-93a2-fe2ccad3b1f0 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:34.546150 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afb380-d165-4bd7-93a2-fe2ccad3b1f0 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:34.547456 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 24/47] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:18:34.553521 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66134c63-7c47-4bd0-84f5-7c9ae771a8e4 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:34.553974 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66134c63-7c47-4bd0-84f5-7c9ae771a8e4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:34.554086 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66134c63-7c47-4bd0-84f5-7c9ae771a8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:34.571782 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-66134c63-7c47-4bd0-84f5-7c9ae771a8e4 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:34.572961 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-66134c63-7c47-4bd0-84f5-7c9ae771a8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:34.625105 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:34.638808 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 24/48] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:18:34.905801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afb380-d165-4bd7-93a2-fe2ccad3b1f0 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:35.118801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afb380-d165-4bd7-93a2-fe2ccad3b1f0 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:35.158106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680eb09-c5a7-473f-b9aa-70413a79058e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:35.158687 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680eb09-c5a7-473f-b9aa-70413a79058e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:35.158969 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680eb09-c5a7-473f-b9aa-70413a79058e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:35.159244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680eb09-c5a7-473f-b9aa-70413a79058e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:35.169376 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680eb09-c5a7-473f-b9aa-70413a79058e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:18:35.174268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-5680eb09-c5a7-473f-b9aa-70413a79058e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:18:35.174268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:18:35.174268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:18:35.174268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:18:35.174268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:18:35.174268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:18:35.174268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:18:35.174268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:18:35.174268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:18:35.174268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:18:35.174268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:18:35.174268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:18:35.174268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:18:35.174268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:18:35.174268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:18:35.174268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:18:35.175096 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:18:35.175096 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:18:35.175096 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:18:35.175096 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:18:35.175096 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:18:35.175096 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:18:35.175096 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:18:35.175096 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:18:35.175096 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:18:35.175096 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:18:35.175096 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:18:35.175096 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:18:35.175096 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:18:35.175096 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:18:35.175096 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:18:35.175096 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:18:35.175847 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:18:35.175847 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:18:35.175847 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:18:35.175847 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:18:35.175847 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:18:35.175847 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:18:35.175847 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:18:35.175847 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:18:35.175847 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:18:35.175847 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:18:35.175847 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:18:35.175847 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:18:35.175847 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 25/49] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:18:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:18:35.181117 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66134c63-7c47-4bd0-84f5-7c9ae771a8e4 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:35.282730 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66134c63-7c47-4bd0-84f5-7c9ae771a8e4 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:35.422225 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667a09a-162c-4e17-b194-4d717d048c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:35.422766 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667a09a-162c-4e17-b194-4d717d048c3a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:35.423089 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667a09a-162c-4e17-b194-4d717d048c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:35.423370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667a09a-162c-4e17-b194-4d717d048c3a None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:35.424075 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667a09a-162c-4e17-b194-4d717d048c3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:35.424420 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667a09a-162c-4e17-b194-4d717d048c3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:35.425826 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667a09a-162c-4e17-b194-4d717d048c3a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:35.434478 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 25/50] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:18:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:35.441189 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680eb09-c5a7-473f-b9aa-70413a79058e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:35.466553 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:35.543225 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680eb09-c5a7-473f-b9aa-70413a79058e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:35.574619 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f8469-703d-4cf1-836a-83b78a2cb062 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:35.575110 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f8469-703d-4cf1-836a-83b78a2cb062 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:35.575228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f8469-703d-4cf1-836a-83b78a2cb062 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:35.576508 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 26/51] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:18:35.579353 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b5f6d-5679-43d3-9514-80020968efff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:35.580037 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b5f6d-5679-43d3-9514-80020968efff None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:35.580324 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b5f6d-5679-43d3-9514-80020968efff None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:35.580600 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b5f6d-5679-43d3-9514-80020968efff None admin] PATH_INFO: `/v3/users/438e8adacb8940c696f3738e6ff13c30` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:35.581586 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82774219-39ce-4fb1-b1a9-68162af8d94c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:35.581758 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b5f6d-5679-43d3-9514-80020968efff None admin] RBAC: Authorizing `identity:get_user(user_id=438e8adacb8940c696f3738e6ff13c30)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:35.581916 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82774219-39ce-4fb1-b1a9-68162af8d94c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:35.582198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82774219-39ce-4fb1-b1a9-68162af8d94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:35.583222 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b5f6d-5679-43d3-9514-80020968efff None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:35.584909 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 26/52] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:18:35 2022] GET /identity/v3/users/438e8adacb8940c696f3738e6ff13c30 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:18:35.590118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b5f6d-5679-43d3-9514-80020968efff None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:35.600265 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-82774219-39ce-4fb1-b1a9-68162af8d94c None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:35.601566 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-82774219-39ce-4fb1-b1a9-68162af8d94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:35.647783 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:35.667606 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 27/53] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:18:35.681737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:35.690756 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b5f6d-5679-43d3-9514-80020968efff None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:35.723837 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bf546-b156-4fc1-a373-84fc6c57868d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:35.724462 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bf546-b156-4fc1-a373-84fc6c57868d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:35.724747 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bf546-b156-4fc1-a373-84fc6c57868d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:35.725025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bf546-b156-4fc1-a373-84fc6c57868d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:35.726173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824bf546-b156-4fc1-a373-84fc6c57868d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:35.727636 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824bf546-b156-4fc1-a373-84fc6c57868d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:35.729195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 27/54] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:18:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:18:35.735140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82774219-39ce-4fb1-b1a9-68162af8d94c None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:35.833999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82774219-39ce-4fb1-b1a9-68162af8d94c None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:35.866808 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cfef8-7d4a-411c-be87-251d44b27bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:35.867405 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cfef8-7d4a-411c-be87-251d44b27bea None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:35.867682 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cfef8-7d4a-411c-be87-251d44b27bea None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:35.867953 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cfef8-7d4a-411c-be87-251d44b27bea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:35.868676 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9cfef8-7d4a-411c-be87-251d44b27bea None admin] RBAC: Adding query filter params (role.id=b779073cee3c470ca4ad7a7b27d72c5e, scope.domain.id=default, user.id=438e8adacb8940c696f3738e6ff13c30) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:35.868983 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9cfef8-7d4a-411c-be87-251d44b27bea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:35.870445 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9cfef8-7d4a-411c-be87-251d44b27bea None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:35.879091 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 28/55] 10.222.0.65 () {56 vars in 1322 bytes} [Wed Aug 24 14:18:35 2022] GET /identity/v3/role_assignments?user.id=438e8adacb8940c696f3738e6ff13c30&scope.domain.id=default&role.id=b779073cee3c470ca4ad7a7b27d72c5e => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:35.937982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bf546-b156-4fc1-a373-84fc6c57868d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:36.044904 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bf546-b156-4fc1-a373-84fc6c57868d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:36.080997 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702dc4d-11f8-4110-86d4-bc9e93485818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:36.081630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702dc4d-11f8-4110-86d4-bc9e93485818 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:36.081941 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702dc4d-11f8-4110-86d4-bc9e93485818 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:36.082224 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702dc4d-11f8-4110-86d4-bc9e93485818 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:36.083341 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702dc4d-11f8-4110-86d4-bc9e93485818 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:36.084822 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702dc4d-11f8-4110-86d4-bc9e93485818 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:36.086431 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 28/56] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:18:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:36.092049 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cfef8-7d4a-411c-be87-251d44b27bea None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:36.138163 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:36.191210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cfef8-7d4a-411c-be87-251d44b27bea None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:36.223376 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e39f0-83ce-426b-9d00-ae9a4fbf8bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:36.223984 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e39f0-83ce-426b-9d00-ae9a4fbf8bed None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:36.224255 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e39f0-83ce-426b-9d00-ae9a4fbf8bed None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:36.224529 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e39f0-83ce-426b-9d00-ae9a4fbf8bed None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:36.225173 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e39f0-83ce-426b-9d00-ae9a4fbf8bed None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:36.226627 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e39f0-83ce-426b-9d00-ae9a4fbf8bed None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:36.301108 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 29/57] 10.222.0.65 () {60 vars in 1140 bytes} [Wed Aug 24 14:18:36 2022] POST /identity/v3/projects => generated 298 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:18:38.206688 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276351f-2518-4578-9a00-87c700397d2b None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:38.207211 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276351f-2518-4578-9a00-87c700397d2b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:38.207297 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276351f-2518-4578-9a00-87c700397d2b None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:38.208596 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 29/58] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:18:38.213905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a54b0-efca-4a4b-b479-7104f67f75b8 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:38.214327 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a54b0-efca-4a4b-b479-7104f67f75b8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:38.214459 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a54b0-efca-4a4b-b479-7104f67f75b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:38.232026 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-888a54b0-efca-4a4b-b479-7104f67f75b8 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:38.233206 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-888a54b0-efca-4a4b-b479-7104f67f75b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:38.299539 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 30/59] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:18:38.567977 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276351f-2518-4578-9a00-87c700397d2b None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:38.595976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:38.667906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276351f-2518-4578-9a00-87c700397d2b None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:38.701732 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302f2b3-a9f9-4aee-883c-21742a67dfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:38.702401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302f2b3-a9f9-4aee-883c-21742a67dfaa None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:38.702683 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302f2b3-a9f9-4aee-883c-21742a67dfaa None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:38.702959 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302f2b3-a9f9-4aee-883c-21742a67dfaa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:38.704088 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302f2b3-a9f9-4aee-883c-21742a67dfaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:38.705672 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302f2b3-a9f9-4aee-883c-21742a67dfaa None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:38.707250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 30/60] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:18:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:18:38.712717 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a54b0-efca-4a4b-b479-7104f67f75b8 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:38.738903 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:38.812475 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a54b0-efca-4a4b-b479-7104f67f75b8 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:38.844569 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a31bc-3468-4b3e-9c9c-cfd5c6fef471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:38.845253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a31bc-3468-4b3e-9c9c-cfd5c6fef471 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:38.845557 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a31bc-3468-4b3e-9c9c-cfd5c6fef471 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:38.845861 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a31bc-3468-4b3e-9c9c-cfd5c6fef471 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:38.846523 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a31bc-3468-4b3e-9c9c-cfd5c6fef471 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:38.847983 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a31bc-3468-4b3e-9c9c-cfd5c6fef471 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:38.937945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 31/61] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 14:18:38 2022] POST /identity/v3/users => generated 275 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:18:41.978382 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a28b21-8268-4fe2-902a-9c7c242c6631 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:41.979410 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a28b21-8268-4fe2-902a-9c7c242c6631 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:41.979901 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a28b21-8268-4fe2-902a-9c7c242c6631 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:41.981571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 31/62] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:18:41.987157 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d05b35-24cd-4811-b051-4d2d7d074d85 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:41.987994 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d05b35-24cd-4811-b051-4d2d7d074d85 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:41.988475 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d05b35-24cd-4811-b051-4d2d7d074d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:42.017899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-11d05b35-24cd-4811-b051-4d2d7d074d85 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:42.019478 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-11d05b35-24cd-4811-b051-4d2d7d074d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:42.024804 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6814b22-06c3-4772-8ce6-4c6f65ae6526 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:42.025394 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6814b22-06c3-4772-8ce6-4c6f65ae6526 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:42.025907 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6814b22-06c3-4772-8ce6-4c6f65ae6526 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:42.027461 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 32/63] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:18:42.043290 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee4cc9-e354-48da-b7c2-09eb9b5b94f5 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:42.043908 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee4cc9-e354-48da-b7c2-09eb9b5b94f5 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:42.044388 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee4cc9-e354-48da-b7c2-09eb9b5b94f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:42.083954 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-2cee4cc9-e354-48da-b7c2-09eb9b5b94f5 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:42.085187 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2cee4cc9-e354-48da-b7c2-09eb9b5b94f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:42.123089 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 32/64] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:18:42.204908 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 33/65] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 24 14:18:42.361407 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02599e81-324c-4798-8eac-717f28c679b3 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:42.362064 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02599e81-324c-4798-8eac-717f28c679b3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:42.362537 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02599e81-324c-4798-8eac-717f28c679b3 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:42.364184 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 33/66] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:18:42.369687 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a5e7a-deda-4b82-a4e1-cf80da5a9804 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:42.370241 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a5e7a-deda-4b82-a4e1-cf80da5a9804 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:42.370712 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a5e7a-deda-4b82-a4e1-cf80da5a9804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:42.395313 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-7d5a5e7a-deda-4b82-a4e1-cf80da5a9804 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:42.396882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-7d5a5e7a-deda-4b82-a4e1-cf80da5a9804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:42.421020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:42.424373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed6f3d-a4f1-4e8a-b933-b4fd28255eb7 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:42.424979 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed6f3d-a4f1-4e8a-b933-b4fd28255eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:42.425482 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed6f3d-a4f1-4e8a-b933-b4fd28255eb7 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:42.427168 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 34/67] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:18:42.428822 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed6f3d-a4f1-4e8a-b933-b4fd28255eb7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:42.445509 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:42.488369 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 34/68] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:18:42.490635 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db637742-4106-4a29-aab5-dd7771aa9820 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:42.491138 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db637742-4106-4a29-aab5-dd7771aa9820 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:42.491900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db637742-4106-4a29-aab5-dd7771aa9820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:42.518573 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-db637742-4106-4a29-aab5-dd7771aa9820 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:42.518845 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-db637742-4106-4a29-aab5-dd7771aa9820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:42.541275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed6f3d-a4f1-4e8a-b933-b4fd28255eb7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:42.581283 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6fa9e-de5e-467c-885d-2286f5cf1924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:42.582273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6fa9e-de5e-467c-885d-2286f5cf1924 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:42.582749 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6fa9e-de5e-467c-885d-2286f5cf1924 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:42.583206 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6fa9e-de5e-467c-885d-2286f5cf1924 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:42.595044 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6fa9e-de5e-467c-885d-2286f5cf1924 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:18:42.601575 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-98b6fa9e-de5e-467c-885d-2286f5cf1924 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:18:42.601575 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:18:42.601575 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:18:42.601575 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:18:42.601575 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:18:42.601575 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:18:42.601575 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:18:42.601575 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:18:42.601575 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:18:42.601575 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:18:42.601575 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:18:42.601575 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:18:42.601575 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:18:42.601575 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:18:42.601575 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:18:42.601575 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:18:42.602457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:18:42.602457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:18:42.602457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:18:42.602457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:18:42.602457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:18:42.602457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:18:42.602457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:18:42.602457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:18:42.602457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:18:42.602457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:18:42.602457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:18:42.602457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:18:42.602457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:18:42.602457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:18:42.602457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:18:42.602457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:18:42.603207 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:18:42.603207 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:18:42.603207 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:18:42.603207 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:18:42.603207 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:18:42.603207 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:18:42.603207 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:18:42.603207 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:18:42.603207 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:18:42.603207 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:18:42.603207 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:18:42.603207 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:18:42.605520 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 35/69] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:18:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:18:42.606503 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6fa9e-de5e-467c-885d-2286f5cf1924 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:42.621684 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 35/70] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:18:42.627520 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db637742-4106-4a29-aab5-dd7771aa9820 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:42.723078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:42.732017 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:42.740788 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db637742-4106-4a29-aab5-dd7771aa9820 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:42.762009 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6fa9e-de5e-467c-885d-2286f5cf1924 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:42.776279 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78176cd7-8650-4ba5-b96d-609c5fb5b3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:42.777234 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78176cd7-8650-4ba5-b96d-609c5fb5b3c8 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:42.777668 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78176cd7-8650-4ba5-b96d-609c5fb5b3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:42.778115 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78176cd7-8650-4ba5-b96d-609c5fb5b3c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:42.779314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78176cd7-8650-4ba5-b96d-609c5fb5b3c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:42.779765 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78176cd7-8650-4ba5-b96d-609c5fb5b3c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:42.781311 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78176cd7-8650-4ba5-b96d-609c5fb5b3c8 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:42.790917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 36/71] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:18:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:42.792467 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858478ba-2392-41ce-baef-fa2ed9a3489e None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:42.792991 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858478ba-2392-41ce-baef-fa2ed9a3489e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:42.793417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858478ba-2392-41ce-baef-fa2ed9a3489e None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:42.795047 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 37/72] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:18:42.795892 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858478ba-2392-41ce-baef-fa2ed9a3489e None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:42.800642 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3bf30-551c-43b0-b8fb-949693268949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:42.801431 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3bf30-551c-43b0-b8fb-949693268949 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:42.801720 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3bf30-551c-43b0-b8fb-949693268949 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:42.802032 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3bf30-551c-43b0-b8fb-949693268949 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:42.814271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3bf30-551c-43b0-b8fb-949693268949 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:18:42.819696 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-98e3bf30-551c-43b0-b8fb-949693268949 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:18:42.819696 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:18:42.819696 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:18:42.819696 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:18:42.819696 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:18:42.819696 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:18:42.819696 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:18:42.819696 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:18:42.819696 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:18:42.819696 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:18:42.819696 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:18:42.819696 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:18:42.819696 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:18:42.819696 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:18:42.819696 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:18:42.819696 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:18:42.820515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:18:42.820515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:18:42.820515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:18:42.820515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:18:42.820515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:18:42.820515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:18:42.820515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:18:42.820515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:18:42.820515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:18:42.820515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:18:42.820515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:18:42.820515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:18:42.820515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:18:42.820515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:18:42.820515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:18:42.820515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:18:42.826717 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:18:42.826717 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:18:42.826717 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:18:42.826717 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:18:42.826717 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:18:42.826717 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:18:42.826717 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:18:42.826717 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:18:42.826717 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:18:42.826717 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:18:42.826717 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:18:42.826717 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:18:42.826717 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 36/73] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:18:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:18:42.826717 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3bf30-551c-43b0-b8fb-949693268949 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:42.915133 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858478ba-2392-41ce-baef-fa2ed9a3489e None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:42.929024 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3bf30-551c-43b0-b8fb-949693268949 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:42.950875 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ef8a9-1924-4ab0-9a1c-1a6995b35b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:42.951502 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ef8a9-1924-4ab0-9a1c-1a6995b35b21 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:42.951808 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ef8a9-1924-4ab0-9a1c-1a6995b35b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:42.952086 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ef8a9-1924-4ab0-9a1c-1a6995b35b21 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:42.957226 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:42.962109 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0967b-25b2-4ddb-bccf-819b8564b511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:42.962658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ef8a9-1924-4ab0-9a1c-1a6995b35b21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:18:42.962751 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0967b-25b2-4ddb-bccf-819b8564b511 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:42.962999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0967b-25b2-4ddb-bccf-819b8564b511 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:42.963274 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0967b-25b2-4ddb-bccf-819b8564b511 None admin] PATH_INFO: `/v3/users/438e8adacb8940c696f3738e6ff13c30` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:42.965476 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0967b-25b2-4ddb-bccf-819b8564b511 None admin] RBAC: Authorizing `identity:get_user(user_id=438e8adacb8940c696f3738e6ff13c30)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:42.966019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0967b-25b2-4ddb-bccf-819b8564b511 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:42.967492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-aa6ef8a9-1924-4ab0-9a1c-1a6995b35b21 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:18:42.967492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:18:42.967492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:18:42.967492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:18:42.967492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:18:42.967492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:18:42.967492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:18:42.967492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:18:42.967492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:18:42.967492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:18:42.967492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:18:42.967492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:18:42.967492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:18:42.967492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:18:42.967492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:18:42.967492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:18:42.968320 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:18:42.968320 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:18:42.968320 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:18:42.968320 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:18:42.968320 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:18:42.968320 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:18:42.968320 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:18:42.968320 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:18:42.968320 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:18:42.968320 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:18:42.968320 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:18:42.968320 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:18:42.968320 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:18:42.968320 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:18:42.968320 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:18:42.968320 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:18:42.969065 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:18:42.969065 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:18:42.969065 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:18:42.969065 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:18:42.969065 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:18:42.969065 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:18:42.969065 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:18:42.969065 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:18:42.969065 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:18:42.969065 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:18:42.969065 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:18:42.969065 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:18:42.970771 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 37/74] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:18:42 2022] GET /identity/v3/users/438e8adacb8940c696f3738e6ff13c30 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:42.970837 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 38/75] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 14:18:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:18:42.970899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552aba5d-2a68-4173-bb9b-cb8fee0df732 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:42.970899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552aba5d-2a68-4173-bb9b-cb8fee0df732 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:42.970899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552aba5d-2a68-4173-bb9b-cb8fee0df732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:42.972074 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ef8a9-1924-4ab0-9a1c-1a6995b35b21 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:42.983841 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:42.990720 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-552aba5d-2a68-4173-bb9b-cb8fee0df732 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:42.991926 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-552aba5d-2a68-4173-bb9b-cb8fee0df732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:43.058328 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 38/76] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:18:43.059164 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552aba5d-2a68-4173-bb9b-cb8fee0df732 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:43.089650 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ef8a9-1924-4ab0-9a1c-1a6995b35b21 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:43.123641 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c32843-c957-4868-a6d4-c2c9e3f940c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:43.124268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c32843-c957-4868-a6d4-c2c9e3f940c4 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:43.124552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c32843-c957-4868-a6d4-c2c9e3f940c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:43.124834 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c32843-c957-4868-a6d4-c2c9e3f940c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:43.125522 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c32843-c957-4868-a6d4-c2c9e3f940c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:43.126556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c32843-c957-4868-a6d4-c2c9e3f940c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:43.128475 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c32843-c957-4868-a6d4-c2c9e3f940c4 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:43.137131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 39/77] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 14:18:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:43.137846 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c32843-c957-4868-a6d4-c2c9e3f940c4 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:43.167259 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552aba5d-2a68-4173-bb9b-cb8fee0df732 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:43.196774 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:43.203178 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b4861-8cb0-4555-a015-91c08a8e7288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:43.204391 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b4861-8cb0-4555-a015-91c08a8e7288 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:43.204680 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b4861-8cb0-4555-a015-91c08a8e7288 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:43.204953 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b4861-8cb0-4555-a015-91c08a8e7288 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:43.206755 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b4861-8cb0-4555-a015-91c08a8e7288 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:43.207719 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b4861-8cb0-4555-a015-91c08a8e7288 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:43.209591 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 39/78] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:18:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:43.211589 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b4861-8cb0-4555-a015-91c08a8e7288 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:43.216653 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:43.248880 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c32843-c957-4868-a6d4-c2c9e3f940c4 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:43.288855 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9cd80f-244b-4caa-97e9-6b560cdb9f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:43.289622 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cd80f-244b-4caa-97e9-6b560cdb9f70 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:43.289945 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cd80f-244b-4caa-97e9-6b560cdb9f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:43.291015 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cd80f-244b-4caa-97e9-6b560cdb9f70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:43.322974 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b4861-8cb0-4555-a015-91c08a8e7288 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:43.356954 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1b154-dce5-46a0-90a1-a42c09232b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:43.357556 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1b154-dce5-46a0-90a1-a42c09232b14 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:43.357860 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1b154-dce5-46a0-90a1-a42c09232b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:43.358133 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1b154-dce5-46a0-90a1-a42c09232b14 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:43.358794 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1b154-dce5-46a0-90a1-a42c09232b14 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:43.359093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1b154-dce5-46a0-90a1-a42c09232b14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:43.360488 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1b154-dce5-46a0-90a1-a42c09232b14 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:43.367066 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9cd80f-244b-4caa-97e9-6b560cdb9f70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:43.368162 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 40/79] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:18:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:43.368938 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1b154-dce5-46a0-90a1-a42c09232b14 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:43.369570 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9cd80f-244b-4caa-97e9-6b560cdb9f70 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:43.427443 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:43.437000 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:43.468012 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1b154-dce5-46a0-90a1-a42c09232b14 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:43.468378 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 40/80] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:18:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:18:43.469193 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9cd80f-244b-4caa-97e9-6b560cdb9f70 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:43.501813 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0278b2e-d492-4d81-baaa-8881db4285c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:43.502441 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0278b2e-d492-4d81-baaa-8881db4285c5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:43.502721 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0278b2e-d492-4d81-baaa-8881db4285c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:43.503005 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0278b2e-d492-4d81-baaa-8881db4285c5 None admin] PATH_INFO: `/v3/users/26be6d4d0994465aa60353e2ce00c1d9` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:43.517946 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0278b2e-d492-4d81-baaa-8881db4285c5 None admin] RBAC: Authorizing `identity:get_user(user_id=26be6d4d0994465aa60353e2ce00c1d9)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:43.519404 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0278b2e-d492-4d81-baaa-8881db4285c5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:43.521039 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 41/81] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:18:43 2022] GET /identity/v3/users/26be6d4d0994465aa60353e2ce00c1d9 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:43.522543 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0278b2e-d492-4d81-baaa-8881db4285c5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:43.569590 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9cd80f-244b-4caa-97e9-6b560cdb9f70 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:43.603347 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68737728-fc96-4ed8-89cc-f7a03b1593c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:43.603883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68737728-fc96-4ed8-89cc-f7a03b1593c9 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:43.604167 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68737728-fc96-4ed8-89cc-f7a03b1593c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:43.604442 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68737728-fc96-4ed8-89cc-f7a03b1593c9 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:43.605091 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68737728-fc96-4ed8-89cc-f7a03b1593c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:43.606568 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68737728-fc96-4ed8-89cc-f7a03b1593c9 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:43.621287 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0278b2e-d492-4d81-baaa-8881db4285c5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:43.638444 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:43.654579 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17c6be-8f1d-420a-9cba-996b07b260e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:43.655209 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17c6be-8f1d-420a-9cba-996b07b260e7 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:43.655492 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17c6be-8f1d-420a-9cba-996b07b260e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:43.655769 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17c6be-8f1d-420a-9cba-996b07b260e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:43.666229 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17c6be-8f1d-420a-9cba-996b07b260e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:18:43.670998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-8e17c6be-8f1d-420a-9cba-996b07b260e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:18:43.670998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:18:43.670998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:18:43.670998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:18:43.670998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:18:43.670998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:18:43.670998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:18:43.670998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:18:43.670998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:18:43.670998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:18:43.670998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:18:43.670998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:18:43.670998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:18:43.670998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:18:43.670998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:18:43.670998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:18:43.671842 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:18:43.671842 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:18:43.671842 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:18:43.671842 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:18:43.671842 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:18:43.671842 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:18:43.671842 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:18:43.671842 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:18:43.671842 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:18:43.671842 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:18:43.671842 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:18:43.671842 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:18:43.671842 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:18:43.671842 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:18:43.671842 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:18:43.671842 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:18:43.672703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:18:43.672703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:18:43.672703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:18:43.672703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:18:43.672703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:18:43.672703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:18:43.672703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:18:43.672703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:18:43.672703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:18:43.672703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:18:43.672703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:18:43.672703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:18:43.672703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 42/82] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:18:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:18:43.674168 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17c6be-8f1d-420a-9cba-996b07b260e7 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:43.687873 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 41/83] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 14:18:43 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:18:43.688714 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68737728-fc96-4ed8-89cc-f7a03b1593c9 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:43.718674 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:43.787606 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17c6be-8f1d-420a-9cba-996b07b260e7 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:43.803504 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68737728-fc96-4ed8-89cc-f7a03b1593c9 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:43.827513 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0b808-0632-4f9e-a471-46b2f781aed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:43.828152 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0b808-0632-4f9e-a471-46b2f781aed1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:43.828430 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0b808-0632-4f9e-a471-46b2f781aed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:43.828710 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0b808-0632-4f9e-a471-46b2f781aed1 None admin] PATH_INFO: `/v3/users/26be6d4d0994465aa60353e2ce00c1d9` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:43.831290 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0b808-0632-4f9e-a471-46b2f781aed1 None admin] RBAC: Authorizing `identity:get_user(user_id=26be6d4d0994465aa60353e2ce00c1d9)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:43.831811 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0b808-0632-4f9e-a471-46b2f781aed1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:43.834212 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 43/84] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:18:43 2022] GET /identity/v3/users/26be6d4d0994465aa60353e2ce00c1d9 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:43.834345 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0b808-0632-4f9e-a471-46b2f781aed1 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:43.852178 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a8c92-c317-4084-9adb-5cf1e759c61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:43.852827 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a8c92-c317-4084-9adb-5cf1e759c61b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:43.853111 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a8c92-c317-4084-9adb-5cf1e759c61b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:43.853509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a8c92-c317-4084-9adb-5cf1e759c61b None admin] PATH_INFO: `/v3/projects/590e1563f57b4a089845f805f9cb48c1` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:43.854701 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a8c92-c317-4084-9adb-5cf1e759c61b None admin] RBAC: Authorizing `identity:get_project(project_id=590e1563f57b4a089845f805f9cb48c1)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:43.856166 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a8c92-c317-4084-9adb-5cf1e759c61b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:43.857811 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 42/85] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:18:43 2022] GET /identity/v3/projects/590e1563f57b4a089845f805f9cb48c1 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:43.858567 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a8c92-c317-4084-9adb-5cf1e759c61b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:43.890542 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:43.953352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0b808-0632-4f9e-a471-46b2f781aed1 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:43.980172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:43.991929 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a8c92-c317-4084-9adb-5cf1e759c61b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:43.998494 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f7dfe-c0e1-4586-81ee-3834adcaf41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:43.999662 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f7dfe-c0e1-4586-81ee-3834adcaf41c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:43.999945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f7dfe-c0e1-4586-81ee-3834adcaf41c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:44.000293 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f7dfe-c0e1-4586-81ee-3834adcaf41c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:44.039928 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f2ab4-848d-4585-8402-78838ef2aefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:44.040550 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f2ab4-848d-4585-8402-78838ef2aefd None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:44.040855 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f2ab4-848d-4585-8402-78838ef2aefd None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:44.041112 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f2ab4-848d-4585-8402-78838ef2aefd None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:44.041877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f2ab4-848d-4585-8402-78838ef2aefd None admin] RBAC: Adding query filter params (name=member) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:44.042190 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f2ab4-848d-4585-8402-78838ef2aefd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:44.043607 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f2ab4-848d-4585-8402-78838ef2aefd None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:44.052975 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 43/86] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 14:18:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:44.053792 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f2ab4-848d-4585-8402-78838ef2aefd None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:44.084589 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f7dfe-c0e1-4586-81ee-3834adcaf41c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:44.086491 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f7dfe-c0e1-4586-81ee-3834adcaf41c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:44.135684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:44.156899 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f2ab4-848d-4585-8402-78838ef2aefd None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:44.197720 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 44/87] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:18:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:18:44.198375 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b06884-f27a-444e-98f4-58671d58d968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:44.199000 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b06884-f27a-444e-98f4-58671d58d968 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:44.199288 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b06884-f27a-444e-98f4-58671d58d968 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:44.199566 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b06884-f27a-444e-98f4-58671d58d968 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:44.199897 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f7dfe-c0e1-4586-81ee-3834adcaf41c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:44.266169 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:44.291346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b06884-f27a-444e-98f4-58671d58d968 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:44.293848 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b06884-f27a-444e-98f4-58671d58d968 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:44.319484 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f7dfe-c0e1-4586-81ee-3834adcaf41c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:44.358808 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdc0f7-9cfb-44dc-9c51-0e396b9d1961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:44.359426 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdc0f7-9cfb-44dc-9c51-0e396b9d1961 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:44.359710 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdc0f7-9cfb-44dc-9c51-0e396b9d1961 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:44.360018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdc0f7-9cfb-44dc-9c51-0e396b9d1961 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:44.361282 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbdc0f7-9cfb-44dc-9c51-0e396b9d1961 None admin] RBAC: Adding query filter params (role.id=b779073cee3c470ca4ad7a7b27d72c5e, scope.project.id=590e1563f57b4a089845f805f9cb48c1, user.id=438e8adacb8940c696f3738e6ff13c30) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:44.361588 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbdc0f7-9cfb-44dc-9c51-0e396b9d1961 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:44.363073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbdc0f7-9cfb-44dc-9c51-0e396b9d1961 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:44.368868 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 45/88] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:18:44 2022] GET /identity/v3/role_assignments?user.id=438e8adacb8940c696f3738e6ff13c30&scope.project.id=590e1563f57b4a089845f805f9cb48c1&role.id=b779073cee3c470ca4ad7a7b27d72c5e => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:44.369699 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdc0f7-9cfb-44dc-9c51-0e396b9d1961 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:44.400709 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:44.458639 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 44/89] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:18:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:18:44.459536 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b06884-f27a-444e-98f4-58671d58d968 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:44.583456 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:44.606007 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdc0f7-9cfb-44dc-9c51-0e396b9d1961 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:44.666382 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b06884-f27a-444e-98f4-58671d58d968 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:44.666892 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895a95b-c575-416e-83aa-16ddfcbabb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:44.667535 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895a95b-c575-416e-83aa-16ddfcbabb25 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:44.667971 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895a95b-c575-416e-83aa-16ddfcbabb25 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:44.668250 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895a95b-c575-416e-83aa-16ddfcbabb25 None admin] PATH_INFO: `/v3/users/26be6d4d0994465aa60353e2ce00c1d9` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:44.674503 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895a95b-c575-416e-83aa-16ddfcbabb25 None admin] RBAC: Authorizing `identity:get_user(user_id=26be6d4d0994465aa60353e2ce00c1d9)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:44.675966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895a95b-c575-416e-83aa-16ddfcbabb25 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:44.677899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 46/90] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:18:44 2022] GET /identity/v3/users/26be6d4d0994465aa60353e2ce00c1d9 => generated 275 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:44.678434 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895a95b-c575-416e-83aa-16ddfcbabb25 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:44.739394 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59581cae-913f-4033-a4b6-7c3dc742e1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:44.740394 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59581cae-913f-4033-a4b6-7c3dc742e1e3 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:44.740895 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59581cae-913f-4033-a4b6-7c3dc742e1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:44.741363 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59581cae-913f-4033-a4b6-7c3dc742e1e3 None admin] PATH_INFO: `/v3/projects/590e1563f57b4a089845f805f9cb48c1` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:44.747679 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59581cae-913f-4033-a4b6-7c3dc742e1e3 None admin] RBAC: Authorizing `identity:get_project(project_id=590e1563f57b4a089845f805f9cb48c1)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:44.749396 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59581cae-913f-4033-a4b6-7c3dc742e1e3 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:44.754455 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 45/91] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:18:44 2022] GET /identity/v3/projects/590e1563f57b4a089845f805f9cb48c1 => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:44.755498 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59581cae-913f-4033-a4b6-7c3dc742e1e3 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:44.834154 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:44.872791 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895a95b-c575-416e-83aa-16ddfcbabb25 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:44.915127 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59581cae-913f-4033-a4b6-7c3dc742e1e3 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:44.942104 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:44.953535 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31954096-ee77-407f-9c9a-6b0f992581ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:44.954275 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31954096-ee77-407f-9c9a-6b0f992581ec None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:44.956018 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31954096-ee77-407f-9c9a-6b0f992581ec None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:44.956018 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31954096-ee77-407f-9c9a-6b0f992581ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:44.956181 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd8db4-9445-4ae8-b436-ce3203fb547e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:44.956181 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd8db4-9445-4ae8-b436-ce3203fb547e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:44.956181 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd8db4-9445-4ae8-b436-ce3203fb547e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:44.956510 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd8db4-9445-4ae8-b436-ce3203fb547e None admin] PATH_INFO: `/v3/projects/590e1563f57b4a089845f805f9cb48c1` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:44.962595 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd8db4-9445-4ae8-b436-ce3203fb547e None admin] RBAC: Authorizing `identity:get_project(project_id=590e1563f57b4a089845f805f9cb48c1)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:44.964105 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd8db4-9445-4ae8-b436-ce3203fb547e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:44.966104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 47/92] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:18:44 2022] GET /identity/v3/projects/590e1563f57b4a089845f805f9cb48c1 => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:44.966756 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd8db4-9445-4ae8-b436-ce3203fb547e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:45.040623 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31954096-ee77-407f-9c9a-6b0f992581ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:45.042184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31954096-ee77-407f-9c9a-6b0f992581ec None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:45.135988 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd8db4-9445-4ae8-b436-ce3203fb547e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:45.147473 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 46/93] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:18:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:18:45.148247 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31954096-ee77-407f-9c9a-6b0f992581ec None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:45.174702 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:45.199974 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd30b9-ba43-4e04-adba-09934a7272d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:45.200547 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd30b9-ba43-4e04-adba-09934a7272d2 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:45.200832 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd30b9-ba43-4e04-adba-09934a7272d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:45.201109 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd30b9-ba43-4e04-adba-09934a7272d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:45.201888 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd30b9-ba43-4e04-adba-09934a7272d2 None admin] RBAC: Adding query filter params (role.id=a5c4bcef93884b89bf10b2f011d880c8, scope.project.id=590e1563f57b4a089845f805f9cb48c1, user.id=26be6d4d0994465aa60353e2ce00c1d9) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:45.202203 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd30b9-ba43-4e04-adba-09934a7272d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:45.203648 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd30b9-ba43-4e04-adba-09934a7272d2 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:45.217174 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 48/94] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:18:44 2022] GET /identity/v3/role_assignments?user.id=26be6d4d0994465aa60353e2ce00c1d9&scope.project.id=590e1563f57b4a089845f805f9cb48c1&role.id=a5c4bcef93884b89bf10b2f011d880c8 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:45.219446 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd30b9-ba43-4e04-adba-09934a7272d2 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:45.246179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:45.256577 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31954096-ee77-407f-9c9a-6b0f992581ec None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:45.295418 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e953710-2a57-4017-8e6d-0d32c2f281b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:45.296400 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e953710-2a57-4017-8e6d-0d32c2f281b1 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:45.296783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e953710-2a57-4017-8e6d-0d32c2f281b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:45.297163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e953710-2a57-4017-8e6d-0d32c2f281b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:45.299211 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e953710-2a57-4017-8e6d-0d32c2f281b1 None admin] RBAC: Adding query filter params (role.id=eb8377ab1ad14341a780bc4acdfa2275, scope.project.id=590e1563f57b4a089845f805f9cb48c1, user.id=26be6d4d0994465aa60353e2ce00c1d9) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:45.299634 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e953710-2a57-4017-8e6d-0d32c2f281b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:45.301339 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e953710-2a57-4017-8e6d-0d32c2f281b1 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:45.314196 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 47/95] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:18:45 2022] GET /identity/v3/role_assignments?user.id=26be6d4d0994465aa60353e2ce00c1d9&scope.project.id=590e1563f57b4a089845f805f9cb48c1&role.id=eb8377ab1ad14341a780bc4acdfa2275 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:45.396072 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd30b9-ba43-4e04-adba-09934a7272d2 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:45.434768 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47f64b-2653-433c-b095-a6ebab77cce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:45.435429 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47f64b-2653-433c-b095-a6ebab77cce6 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:45.435712 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47f64b-2653-433c-b095-a6ebab77cce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:45.435990 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47f64b-2653-433c-b095-a6ebab77cce6 None admin] PATH_INFO: `/v3/projects/5c450ff5079c44d38f40071b4f7be9f0` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:45.437282 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47f64b-2653-433c-b095-a6ebab77cce6 None admin] RBAC: Authorizing `identity:get_project(project_id=5c450ff5079c44d38f40071b4f7be9f0)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:45.438911 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47f64b-2653-433c-b095-a6ebab77cce6 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:45.440906 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 49/96] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:18:45 2022] GET /identity/v3/projects/5c450ff5079c44d38f40071b4f7be9f0 => generated 312 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:45.448291 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e953710-2a57-4017-8e6d-0d32c2f281b1 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:45.592469 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e953710-2a57-4017-8e6d-0d32c2f281b1 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:45.601098 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:45.630418 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c9344-c837-4693-acdd-2ecd95526808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:45.631395 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c9344-c837-4693-acdd-2ecd95526808 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:45.631725 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c9344-c837-4693-acdd-2ecd95526808 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:45.632006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c9344-c837-4693-acdd-2ecd95526808 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:45.632743 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c9344-c837-4693-acdd-2ecd95526808 None admin] RBAC: Adding query filter params (role.id=a5c4bcef93884b89bf10b2f011d880c8, scope.project.id=5c450ff5079c44d38f40071b4f7be9f0, user.id=26be6d4d0994465aa60353e2ce00c1d9) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:45.633052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c9344-c837-4693-acdd-2ecd95526808 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:45.634528 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c9344-c837-4693-acdd-2ecd95526808 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:45.645936 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 48/97] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:18:45 2022] GET /identity/v3/role_assignments?user.id=26be6d4d0994465aa60353e2ce00c1d9&scope.project.id=5c450ff5079c44d38f40071b4f7be9f0&role.id=a5c4bcef93884b89bf10b2f011d880c8 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:46.107133 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2b8c4-3a3e-45a5-a380-2ab245c152d2 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:46.107524 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2b8c4-3a3e-45a5-a380-2ab245c152d2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:46.107702 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2b8c4-3a3e-45a5-a380-2ab245c152d2 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:46.109187 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 50/98] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:18:46.114831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a6a3d-e1de-4cbb-8d6b-08f30842747e None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:46.115272 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a6a3d-e1de-4cbb-8d6b-08f30842747e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:46.115588 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a6a3d-e1de-4cbb-8d6b-08f30842747e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:46.137561 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a06a6a3d-e1de-4cbb-8d6b-08f30842747e None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:46.139128 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a06a6a3d-e1de-4cbb-8d6b-08f30842747e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:46.197860 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4d462-01aa-4473-a2c5-533e1d77009e None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:46.198807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4d462-01aa-4473-a2c5-533e1d77009e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:46.199381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4d462-01aa-4473-a2c5-533e1d77009e None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:46.201174 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 51/99] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:18:46.207913 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ecce2-6c22-41ba-85fc-8eb662fbc64b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:46.208450 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ecce2-6c22-41ba-85fc-8eb662fbc64b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:46.208924 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ecce2-6c22-41ba-85fc-8eb662fbc64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:46.213795 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 49/100] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:18:46.241240 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-7f1ecce2-6c22-41ba-85fc-8eb662fbc64b None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:46.242843 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7f1ecce2-6c22-41ba-85fc-8eb662fbc64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:46.376458 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 52/101] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:18:46.510662 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a6a3d-e1de-4cbb-8d6b-08f30842747e None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:46.616032 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:46.635521 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a6a3d-e1de-4cbb-8d6b-08f30842747e None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:46.682986 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8b76e-b950-44fb-9ab4-a5abbfcb87a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:46.683628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8b76e-b950-44fb-9ab4-a5abbfcb87a8 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:46.683908 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8b76e-b950-44fb-9ab4-a5abbfcb87a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:46.684179 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8b76e-b950-44fb-9ab4-a5abbfcb87a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:46.685293 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8b76e-b950-44fb-9ab4-a5abbfcb87a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:46.686862 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8b76e-b950-44fb-9ab4-a5abbfcb87a8 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:46.689043 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 50/102] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:18:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:46.695528 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ecce2-6c22-41ba-85fc-8eb662fbc64b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:46.715310 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:46.815827 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ecce2-6c22-41ba-85fc-8eb662fbc64b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:46.852351 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090970b4-c506-4127-b758-f6cd7f48c2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:46.852969 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090970b4-c506-4127-b758-f6cd7f48c2af None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:46.853250 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090970b4-c506-4127-b758-f6cd7f48c2af None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:46.853525 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090970b4-c506-4127-b758-f6cd7f48c2af None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:46.854213 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090970b4-c506-4127-b758-f6cd7f48c2af None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:46.855679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090970b4-c506-4127-b758-f6cd7f48c2af None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:46.911651 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8b76e-b950-44fb-9ab4-a5abbfcb87a8 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:46.955883 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 53/103] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 14:18:46 2022] POST /identity/v3/projects => generated 302 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:18:47.047681 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8b76e-b950-44fb-9ab4-a5abbfcb87a8 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:47.095288 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e42470-b6c7-4f3f-b685-58c22ae60e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:47.096302 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e42470-b6c7-4f3f-b685-58c22ae60e19 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:47.096782 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e42470-b6c7-4f3f-b685-58c22ae60e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:47.097269 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e42470-b6c7-4f3f-b685-58c22ae60e19 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:47.109043 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06735c9-cfb0-442c-9a4c-ec9eb2ef5351 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:47.109700 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06735c9-cfb0-442c-9a4c-ec9eb2ef5351 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:47.110470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06735c9-cfb0-442c-9a4c-ec9eb2ef5351 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:47.112310 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 54/104] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:18:47.114562 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e42470-b6c7-4f3f-b685-58c22ae60e19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:18:47.118366 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68cdf7-9643-4985-ab48-e8b3a9717eb8 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:47.118947 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68cdf7-9643-4985-ab48-e8b3a9717eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:47.119448 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68cdf7-9643-4985-ab48-e8b3a9717eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:47.119630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-44e42470-b6c7-4f3f-b685-58c22ae60e19 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:18:47.119630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:18:47.119630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:18:47.119630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:18:47.119630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:18:47.119630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:18:47.119630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:18:47.119630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:18:47.119630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:18:47.119630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:18:47.119630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:18:47.119630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:18:47.119630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:18:47.119630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:18:47.119630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:18:47.119630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:18:47.120802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:18:47.120802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:18:47.120802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:18:47.120802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:18:47.120802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:18:47.120802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:18:47.120802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:18:47.120802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:18:47.120802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:18:47.120802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:18:47.120802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:18:47.120802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:18:47.120802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:18:47.120802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:18:47.120802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:18:47.120802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:18:47.121548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:18:47.121548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:18:47.121548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:18:47.121548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:18:47.121548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:18:47.121548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:18:47.121548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:18:47.121548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:18:47.121548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:18:47.121548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:18:47.121548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:18:47.121548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:18:47.121548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 51/105] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:18:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:18:47.126604 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e42470-b6c7-4f3f-b685-58c22ae60e19 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:47.142625 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:47.160131 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ab68cdf7-9643-4985-ab48-e8b3a9717eb8 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:47.161870 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ab68cdf7-9643-4985-ab48-e8b3a9717eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:47.278121 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:47.285369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 55/106] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:18:47.301174 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e42470-b6c7-4f3f-b685-58c22ae60e19 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:47.337168 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41761fe5-d204-4569-bb40-ab3bcd9d67ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:47.337801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41761fe5-d204-4569-bb40-ab3bcd9d67ae None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:47.338088 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41761fe5-d204-4569-bb40-ab3bcd9d67ae None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:47.338358 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41761fe5-d204-4569-bb40-ab3bcd9d67ae None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:47.339346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41761fe5-d204-4569-bb40-ab3bcd9d67ae None admin] RBAC: Adding query filter params (name=reader) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:47.339461 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41761fe5-d204-4569-bb40-ab3bcd9d67ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:47.340822 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41761fe5-d204-4569-bb40-ab3bcd9d67ae None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:47.350232 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 52/107] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 14:18:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:47.355640 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68cdf7-9643-4985-ab48-e8b3a9717eb8 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:47.482444 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68cdf7-9643-4985-ab48-e8b3a9717eb8 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:47.524781 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0afbdad-4a53-4306-bdf4-f1c9ab53b7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:47.525416 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afbdad-4a53-4306-bdf4-f1c9ab53b7db None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:47.525692 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afbdad-4a53-4306-bdf4-f1c9ab53b7db None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:47.525990 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afbdad-4a53-4306-bdf4-f1c9ab53b7db None admin] PATH_INFO: `/v3/users/68d5fec81ab947a69ce7a4b40a4d768c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:47.546414 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0afbdad-4a53-4306-bdf4-f1c9ab53b7db None admin] RBAC: Authorizing `identity:get_user(user_id=68d5fec81ab947a69ce7a4b40a4d768c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:47.548668 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0afbdad-4a53-4306-bdf4-f1c9ab53b7db None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:47.550485 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 56/108] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:18:47 2022] GET /identity/v3/users/68d5fec81ab947a69ce7a4b40a4d768c => generated 289 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:47.556429 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41761fe5-d204-4569-bb40-ab3bcd9d67ae None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:47.599085 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0afbdad-4a53-4306-bdf4-f1c9ab53b7db None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:47.659470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:47.678142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:47.711019 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41761fe5-d204-4569-bb40-ab3bcd9d67ae None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:47.722247 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0afbdad-4a53-4306-bdf4-f1c9ab53b7db None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:47.746868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2e18b-165a-4bbe-9bfa-1e235976606a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:47.747395 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2e18b-165a-4bbe-9bfa-1e235976606a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:47.747676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2e18b-165a-4bbe-9bfa-1e235976606a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:47.747947 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2e18b-165a-4bbe-9bfa-1e235976606a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:47.758220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304a8a4-4deb-4332-ae01-f6e0d06d3f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:47.758857 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304a8a4-4deb-4332-ae01-f6e0d06d3f83 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:47.759137 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304a8a4-4deb-4332-ae01-f6e0d06d3f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:47.759409 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304a8a4-4deb-4332-ae01-f6e0d06d3f83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:47.770090 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304a8a4-4deb-4332-ae01-f6e0d06d3f83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:18:47.775097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-c304a8a4-4deb-4332-ae01-f6e0d06d3f83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:18:47.775097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:18:47.775097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:18:47.775097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:18:47.775097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:18:47.775097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:18:47.775097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:18:47.775097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:18:47.775097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:18:47.775097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:18:47.775097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:18:47.775097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:18:47.775097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:18:47.775097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:18:47.775097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:18:47.775097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:18:47.775958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:18:47.775958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:18:47.775958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:18:47.775958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:18:47.775958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:18:47.775958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:18:47.775958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:18:47.775958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:18:47.775958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:18:47.775958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:18:47.775958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:18:47.775958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:18:47.775958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:18:47.775958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:18:47.775958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:18:47.775958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:18:47.776707 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:18:47.776707 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:18:47.776707 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:18:47.776707 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:18:47.776707 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:18:47.776707 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:18:47.776707 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:18:47.776707 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:18:47.776707 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:18:47.776707 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:18:47.776707 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:18:47.776707 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:18:47.776707 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 57/109] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:18:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:18:47.783280 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304a8a4-4deb-4332-ae01-f6e0d06d3f83 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:47.823074 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2e18b-165a-4bbe-9bfa-1e235976606a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:47.824535 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2e18b-165a-4bbe-9bfa-1e235976606a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:47.886589 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304a8a4-4deb-4332-ae01-f6e0d06d3f83 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:47.898253 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:47.902571 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:47.921950 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e2e35-d207-4905-ab9b-c4db4a8f800e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:47.923218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e2e35-d207-4905-ab9b-c4db4a8f800e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:47.923474 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e2e35-d207-4905-ab9b-c4db4a8f800e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:47.923728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e2e35-d207-4905-ab9b-c4db4a8f800e None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:47.924352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e2e35-d207-4905-ab9b-c4db4a8f800e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:47.924656 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e2e35-d207-4905-ab9b-c4db4a8f800e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:47.926050 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e2e35-d207-4905-ab9b-c4db4a8f800e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:47.937805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 58/111] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:18:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:47.938119 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 53/111] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:18:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:18:47.940904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e2e35-d207-4905-ab9b-c4db4a8f800e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:47.942253 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2e18b-165a-4bbe-9bfa-1e235976606a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:48.061372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2e18b-165a-4bbe-9bfa-1e235976606a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:48.079378 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e2e35-d207-4905-ab9b-c4db4a8f800e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:48.098463 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33814d62-d608-4510-adfb-49cbc00585a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:48.099421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33814d62-d608-4510-adfb-49cbc00585a2 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:48.099853 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33814d62-d608-4510-adfb-49cbc00585a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:48.100265 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33814d62-d608-4510-adfb-49cbc00585a2 None admin] PATH_INFO: `/v3/projects/590e1563f57b4a089845f805f9cb48c1` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:48.101662 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33814d62-d608-4510-adfb-49cbc00585a2 None admin] RBAC: Authorizing `identity:get_project(project_id=590e1563f57b4a089845f805f9cb48c1)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:48.103384 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33814d62-d608-4510-adfb-49cbc00585a2 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:48.105346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 54/112] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:18:47 2022] GET /identity/v3/projects/590e1563f57b4a089845f805f9cb48c1 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:48.114816 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33814d62-d608-4510-adfb-49cbc00585a2 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:48.136977 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dea804-58e2-4d40-bcdc-a673728a1346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:48.137804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dea804-58e2-4d40-bcdc-a673728a1346 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:48.138090 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dea804-58e2-4d40-bcdc-a673728a1346 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:48.138399 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dea804-58e2-4d40-bcdc-a673728a1346 None admin] PATH_INFO: `/v3/users/438e8adacb8940c696f3738e6ff13c30` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:48.139676 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dea804-58e2-4d40-bcdc-a673728a1346 None admin] RBAC: Authorizing `identity:get_user(user_id=438e8adacb8940c696f3738e6ff13c30)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:48.142126 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dea804-58e2-4d40-bcdc-a673728a1346 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:48.146477 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 59/113] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:18:47 2022] GET /identity/v3/users/438e8adacb8940c696f3738e6ff13c30 => generated 247 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:18:48.153534 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dea804-58e2-4d40-bcdc-a673728a1346 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:48.200123 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:48.221089 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:48.318435 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dea804-58e2-4d40-bcdc-a673728a1346 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:48.356083 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533e10f-9dc8-46d7-bed7-73ac569a91ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:48.356724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533e10f-9dc8-46d7-bed7-73ac569a91ad None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:48.357057 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533e10f-9dc8-46d7-bed7-73ac569a91ad None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:48.357339 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533e10f-9dc8-46d7-bed7-73ac569a91ad None admin] PATH_INFO: `/v3/projects/590e1563f57b4a089845f805f9cb48c1` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:48.358629 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533e10f-9dc8-46d7-bed7-73ac569a91ad None admin] RBAC: Authorizing `identity:get_project(project_id=590e1563f57b4a089845f805f9cb48c1)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:48.360173 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533e10f-9dc8-46d7-bed7-73ac569a91ad None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:48.361853 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 60/114] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:18:48 2022] GET /identity/v3/projects/590e1563f57b4a089845f805f9cb48c1 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:48.362729 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33814d62-d608-4510-adfb-49cbc00585a2 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:48.362981 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c624f-862e-49d5-ab7b-9730753a35ef None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:48.363266 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c624f-862e-49d5-ab7b-9730753a35ef None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:48.363541 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c624f-862e-49d5-ab7b-9730753a35ef None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:48.364749 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 61/115] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:18:48.370252 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b09cfb-a143-4478-ab00-ba2696316eb2 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:48.370537 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b09cfb-a143-4478-ab00-ba2696316eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:48.370817 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b09cfb-a143-4478-ab00-ba2696316eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:48.390611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-05b09cfb-a143-4478-ab00-ba2696316eb2 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:48.397771 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-05b09cfb-a143-4478-ab00-ba2696316eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:48.447002 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497ca8c-9c0e-41f1-a081-e35812676adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:48.447988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497ca8c-9c0e-41f1-a081-e35812676adf None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:48.448466 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497ca8c-9c0e-41f1-a081-e35812676adf None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:48.448935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497ca8c-9c0e-41f1-a081-e35812676adf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:48.449922 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497ca8c-9c0e-41f1-a081-e35812676adf None admin] RBAC: Adding query filter params (role.id=97d4738e1d3946aead178d02f1a88861, scope.project.id=590e1563f57b4a089845f805f9cb48c1, user.id=68d5fec81ab947a69ce7a4b40a4d768c) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:48.450427 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497ca8c-9c0e-41f1-a081-e35812676adf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:48.452072 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497ca8c-9c0e-41f1-a081-e35812676adf None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:48.459200 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 55/116] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:18:48 2022] GET /identity/v3/role_assignments?user.id=68d5fec81ab947a69ce7a4b40a4d768c&scope.project.id=590e1563f57b4a089845f805f9cb48c1&role.id=97d4738e1d3946aead178d02f1a88861 => generated 259 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:48.460234 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497ca8c-9c0e-41f1-a081-e35812676adf None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:48.497811 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 62/117] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:18:48.639132 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497ca8c-9c0e-41f1-a081-e35812676adf None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:48.646908 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:48.687535 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db439360-36f8-4f90-9d32-844fd3f5d11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:48.690576 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db439360-36f8-4f90-9d32-844fd3f5d11f None admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:48.691261 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db439360-36f8-4f90-9d32-844fd3f5d11f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:48.691821 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db439360-36f8-4f90-9d32-844fd3f5d11f None admin] PATH_INFO: `/v3/projects/590e1563f57b4a089845f805f9cb48c1/users/438e8adacb8940c696f3738e6ff13c30/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:48.694409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db439360-36f8-4f90-9d32-844fd3f5d11f None admin] RBAC: Authorizing `identity:create_grant(project_id=590e1563f57b4a089845f805f9cb48c1, user_id=438e8adacb8940c696f3738e6ff13c30, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:48.695862 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db439360-36f8-4f90-9d32-844fd3f5d11f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:48.737479 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f88a03-a64a-43eb-b4d7-0d82236b646b None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:48.737851 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f88a03-a64a-43eb-b4d7-0d82236b646b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:48.738177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f88a03-a64a-43eb-b4d7-0d82236b646b None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:48.739718 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 63/118] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:18:48.744697 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77406f-0ab7-44fc-8b2f-0a69e50892bd None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:48.745058 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77406f-0ab7-44fc-8b2f-0a69e50892bd None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:48.745379 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77406f-0ab7-44fc-8b2f-0a69e50892bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:48.775094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-1c77406f-0ab7-44fc-8b2f-0a69e50892bd None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:48.776311 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1c77406f-0ab7-44fc-8b2f-0a69e50892bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:48.800740 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 56/119] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 14:18:48 2022] PUT /identity/v3/projects/590e1563f57b4a089845f805f9cb48c1/users/438e8adacb8940c696f3738e6ff13c30/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:18:48.810559 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3737d7-3214-4875-9c2d-047c1b8f18e1 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:48.810888 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3737d7-3214-4875-9c2d-047c1b8f18e1 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:48.811131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3737d7-3214-4875-9c2d-047c1b8f18e1 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:48.812550 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 57/120] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:18:48.818829 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80cfe2-32a7-4e32-a6eb-b292dd85dcab None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:48.819118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80cfe2-32a7-4e32-a6eb-b292dd85dcab None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:48.819515 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80cfe2-32a7-4e32-a6eb-b292dd85dcab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:48.825648 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:48.841044 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ac80cfe2-32a7-4e32-a6eb-b292dd85dcab None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:48.842685 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ac80cfe2-32a7-4e32-a6eb-b292dd85dcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:48.911270 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 64/121] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:18:48.920868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 58/122] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:18:49.020113 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77406f-0ab7-44fc-8b2f-0a69e50892bd None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:49.139775 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77406f-0ab7-44fc-8b2f-0a69e50892bd None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:49.180871 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d8c46-4c55-4e4b-bf62-2dc8f485af2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:49.181438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d8c46-4c55-4e4b-bf62-2dc8f485af2b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:49.181718 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d8c46-4c55-4e4b-bf62-2dc8f485af2b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:49.182024 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d8c46-4c55-4e4b-bf62-2dc8f485af2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:49.198883 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d8c46-4c55-4e4b-bf62-2dc8f485af2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:18:49.203685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-dd0d8c46-4c55-4e4b-bf62-2dc8f485af2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:18:49.203685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:18:49.203685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:18:49.203685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:18:49.203685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:18:49.203685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:18:49.203685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:18:49.203685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:18:49.203685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:18:49.203685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:18:49.203685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:18:49.203685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:18:49.203685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:18:49.203685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:18:49.203685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:18:49.203685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:18:49.204622 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:18:49.204622 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:18:49.204622 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:18:49.204622 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:18:49.204622 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:18:49.204622 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:18:49.204622 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:18:49.204622 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:18:49.204622 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:18:49.204622 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:18:49.204622 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:18:49.204622 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:18:49.204622 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:18:49.204622 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:18:49.204622 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:18:49.204622 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:18:49.205374 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:18:49.205374 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:18:49.205374 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:18:49.205374 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:18:49.205374 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:18:49.205374 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:18:49.205374 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:18:49.205374 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:18:49.205374 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:18:49.205374 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:18:49.205374 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:18:49.205374 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:18:49.205374 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 65/123] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:18:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:18:49.212145 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80cfe2-32a7-4e32-a6eb-b292dd85dcab None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:49.278101 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d8c46-4c55-4e4b-bf62-2dc8f485af2b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:49.327151 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:49.394154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:49.402568 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80cfe2-32a7-4e32-a6eb-b292dd85dcab None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:49.440030 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec82cf-292d-4bca-bf27-b6baa5f08c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:49.440974 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec82cf-292d-4bca-bf27-b6baa5f08c2a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:49.441457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec82cf-292d-4bca-bf27-b6baa5f08c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:49.441983 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec82cf-292d-4bca-bf27-b6baa5f08c2a None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:49.443109 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec82cf-292d-4bca-bf27-b6baa5f08c2a None admin] RBAC: Adding query filter params (name=member) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:49.443627 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec82cf-292d-4bca-bf27-b6baa5f08c2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:49.445275 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec82cf-292d-4bca-bf27-b6baa5f08c2a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:49.454105 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 59/124] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 14:18:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:49.455448 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec82cf-292d-4bca-bf27-b6baa5f08c2a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:49.509870 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d8c46-4c55-4e4b-bf62-2dc8f485af2b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:49.568349 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75134b3-de5b-46ce-9d52-e7b530fcdfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:49.569003 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75134b3-de5b-46ce-9d52-e7b530fcdfcf None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:49.569279 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75134b3-de5b-46ce-9d52-e7b530fcdfcf None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:49.569556 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75134b3-de5b-46ce-9d52-e7b530fcdfcf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:49.589904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75134b3-de5b-46ce-9d52-e7b530fcdfcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:18:49.595302 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-b75134b3-de5b-46ce-9d52-e7b530fcdfcf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:18:49.595302 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:18:49.595302 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:18:49.595302 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:18:49.595302 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:18:49.595302 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:18:49.595302 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:18:49.595302 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:18:49.595302 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:18:49.595302 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:18:49.595302 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:18:49.595302 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:18:49.595302 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:18:49.595302 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:18:49.595302 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:18:49.595302 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:18:49.596144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:18:49.596144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:18:49.596144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:18:49.596144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:18:49.596144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:18:49.596144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:18:49.596144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:18:49.596144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:18:49.596144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:18:49.596144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:18:49.596144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:18:49.596144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:18:49.596144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:18:49.596144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:18:49.596144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:18:49.596144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:18:49.596937 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:18:49.596937 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:18:49.596937 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:18:49.596937 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:18:49.596937 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:18:49.596937 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:18:49.596937 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:18:49.596937 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:18:49.596937 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:18:49.596937 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:18:49.596937 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:18:49.596937 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:18:49.596937 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 66/125] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:18:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:18:49.597564 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75134b3-de5b-46ce-9d52-e7b530fcdfcf None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:49.603331 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec82cf-292d-4bca-bf27-b6baa5f08c2a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:49.647483 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355f472-d13f-407f-bc0c-78d5bddac04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:49.648118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355f472-d13f-407f-bc0c-78d5bddac04f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:49.648401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355f472-d13f-407f-bc0c-78d5bddac04f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:49.648674 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355f472-d13f-407f-bc0c-78d5bddac04f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:49.668350 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355f472-d13f-407f-bc0c-78d5bddac04f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:18:49.682630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-d355f472-d13f-407f-bc0c-78d5bddac04f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:18:49.682630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:18:49.682630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:18:49.682630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:18:49.682630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:18:49.682630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:18:49.682630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:18:49.682630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:18:49.682630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:18:49.682630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:18:49.682630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:18:49.682630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:18:49.682630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:18:49.682630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:18:49.682630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:18:49.682630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:18:49.683542 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:18:49.683542 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:18:49.683542 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:18:49.683542 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:18:49.683542 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:18:49.683542 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:18:49.683542 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:18:49.683542 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:18:49.683542 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:18:49.683542 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:18:49.683542 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:18:49.683542 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:18:49.683542 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:18:49.683542 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:18:49.683542 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:18:49.683542 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:18:49.684377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:18:49.684377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:18:49.684377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:18:49.684377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:18:49.684377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:18:49.684377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:18:49.684377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:18:49.684377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:18:49.684377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:18:49.684377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:18:49.684377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:18:49.684377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:18:49.684377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 60/126] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 14:18:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:18:49.685007 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355f472-d13f-407f-bc0c-78d5bddac04f None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:49.706291 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:49.788648 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:49.808480 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75134b3-de5b-46ce-9d52-e7b530fcdfcf None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:49.850633 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03da8b-918e-4720-b86f-1442a280b287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:49.851452 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03da8b-918e-4720-b86f-1442a280b287 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:49.851834 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03da8b-918e-4720-b86f-1442a280b287 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:49.857770 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03da8b-918e-4720-b86f-1442a280b287 None admin] PATH_INFO: `/v3/users/26be6d4d0994465aa60353e2ce00c1d9` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:49.857770 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03da8b-918e-4720-b86f-1442a280b287 None admin] RBAC: Authorizing `identity:get_user(user_id=26be6d4d0994465aa60353e2ce00c1d9)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:49.857770 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03da8b-918e-4720-b86f-1442a280b287 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:49.857770 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 67/127] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:18:49 2022] GET /identity/v3/users/26be6d4d0994465aa60353e2ce00c1d9 => generated 275 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:49.857770 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03da8b-918e-4720-b86f-1442a280b287 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:49.877998 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355f472-d13f-407f-bc0c-78d5bddac04f None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:49.964698 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ce4c9-24f9-401c-b122-f16d00fab02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:49.965550 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ce4c9-24f9-401c-b122-f16d00fab02b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:49.966019 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ce4c9-24f9-401c-b122-f16d00fab02b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:49.966435 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ce4c9-24f9-401c-b122-f16d00fab02b None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:49.967378 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ce4c9-24f9-401c-b122-f16d00fab02b None admin] RBAC: Adding query filter params (name=member) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:49.967921 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ce4c9-24f9-401c-b122-f16d00fab02b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:49.970057 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ce4c9-24f9-401c-b122-f16d00fab02b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:49.977772 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03da8b-918e-4720-b86f-1442a280b287 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:49.991594 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 61/128] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 14:18:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:49.992607 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ce4c9-24f9-401c-b122-f16d00fab02b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:50.014210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d773d3-a034-4091-bb63-197fab2d9cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:50.015214 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d773d3-a034-4091-bb63-197fab2d9cfd None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:50.015596 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d773d3-a034-4091-bb63-197fab2d9cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:50.016604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d773d3-a034-4091-bb63-197fab2d9cfd None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:50.017802 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d773d3-a034-4091-bb63-197fab2d9cfd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:50.018299 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d773d3-a034-4091-bb63-197fab2d9cfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:50.020179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d773d3-a034-4091-bb63-197fab2d9cfd None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:50.029740 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 68/129] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:18:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:50.034734 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d773d3-a034-4091-bb63-197fab2d9cfd None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:50.057786 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:50.149389 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d773d3-a034-4091-bb63-197fab2d9cfd None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:50.187537 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068d344-cc73-46c4-a1d7-4df757f8c15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:50.188898 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068d344-cc73-46c4-a1d7-4df757f8c15c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:50.189355 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068d344-cc73-46c4-a1d7-4df757f8c15c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:50.189730 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068d344-cc73-46c4-a1d7-4df757f8c15c None admin] PATH_INFO: `/v3/users/26be6d4d0994465aa60353e2ce00c1d9` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:50.191387 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068d344-cc73-46c4-a1d7-4df757f8c15c None admin] RBAC: Authorizing `identity:get_user(user_id=26be6d4d0994465aa60353e2ce00c1d9)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:50.193382 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068d344-cc73-46c4-a1d7-4df757f8c15c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:50.195464 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 69/130] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:18:50 2022] GET /identity/v3/users/26be6d4d0994465aa60353e2ce00c1d9 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:50.196329 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068d344-cc73-46c4-a1d7-4df757f8c15c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:50.227543 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:50.276765 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ce4c9-24f9-401c-b122-f16d00fab02b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:50.346128 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:50.360580 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c83015-2b29-4222-b945-2688a6e374a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:50.361225 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c83015-2b29-4222-b945-2688a6e374a4 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:50.361506 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c83015-2b29-4222-b945-2688a6e374a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:50.361799 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c83015-2b29-4222-b945-2688a6e374a4 None admin] PATH_INFO: `/v3/projects/590e1563f57b4a089845f805f9cb48c1` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:50.362963 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c83015-2b29-4222-b945-2688a6e374a4 None admin] RBAC: Authorizing `identity:get_project(project_id=590e1563f57b4a089845f805f9cb48c1)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:50.368528 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c83015-2b29-4222-b945-2688a6e374a4 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:50.373631 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 62/131] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:18:49 2022] GET /identity/v3/projects/590e1563f57b4a089845f805f9cb48c1 => generated 298 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:50.376502 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068d344-cc73-46c4-a1d7-4df757f8c15c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:50.376915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c83015-2b29-4222-b945-2688a6e374a4 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:50.455253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1b7c9-6ef4-4903-8506-e77c951a6deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:50.455900 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1b7c9-6ef4-4903-8506-e77c951a6deb None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:50.456182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1b7c9-6ef4-4903-8506-e77c951a6deb None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:50.456458 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1b7c9-6ef4-4903-8506-e77c951a6deb None admin] PATH_INFO: `/v3/users/26be6d4d0994465aa60353e2ce00c1d9` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:50.458194 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1b7c9-6ef4-4903-8506-e77c951a6deb None admin] RBAC: Authorizing `identity:get_user(user_id=26be6d4d0994465aa60353e2ce00c1d9)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:50.462789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1b7c9-6ef4-4903-8506-e77c951a6deb None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:50.466377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 70/132] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:18:50 2022] GET /identity/v3/users/26be6d4d0994465aa60353e2ce00c1d9 => generated 275 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:50.467168 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1b7c9-6ef4-4903-8506-e77c951a6deb None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:50.537453 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c83015-2b29-4222-b945-2688a6e374a4 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:50.580531 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cf0b3-892a-4dff-ac74-a8d962e0441f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:50.581180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cf0b3-892a-4dff-ac74-a8d962e0441f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:50.581823 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cf0b3-892a-4dff-ac74-a8d962e0441f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:50.582117 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cf0b3-892a-4dff-ac74-a8d962e0441f None admin] PATH_INFO: `/v3/projects/5c450ff5079c44d38f40071b4f7be9f0` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:50.583571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38cf0b3-892a-4dff-ac74-a8d962e0441f None admin] RBAC: Authorizing `identity:get_project(project_id=5c450ff5079c44d38f40071b4f7be9f0)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:50.585591 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38cf0b3-892a-4dff-ac74-a8d962e0441f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:50.587717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 63/133] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:18:50 2022] GET /identity/v3/projects/5c450ff5079c44d38f40071b4f7be9f0 => generated 312 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:50.588488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cf0b3-892a-4dff-ac74-a8d962e0441f None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:50.609561 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:50.612733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1b7c9-6ef4-4903-8506-e77c951a6deb None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:50.660843 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f0337-3358-4260-9743-00fd86ed4104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:50.661818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f0337-3358-4260-9743-00fd86ed4104 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:50.662110 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f0337-3358-4260-9743-00fd86ed4104 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:50.662389 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f0337-3358-4260-9743-00fd86ed4104 None admin] PATH_INFO: `/v3/projects/590e1563f57b4a089845f805f9cb48c1/users/26be6d4d0994465aa60353e2ce00c1d9/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:50.664868 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f0337-3358-4260-9743-00fd86ed4104 None admin] RBAC: Authorizing `identity:create_grant(project_id=590e1563f57b4a089845f805f9cb48c1, user_id=26be6d4d0994465aa60353e2ce00c1d9, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:50.666609 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f0337-3358-4260-9743-00fd86ed4104 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:50.706942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cf0b3-892a-4dff-ac74-a8d962e0441f None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:50.740551 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844b391-14e5-4159-b5f4-1a9cfeb60f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:50.741184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844b391-14e5-4159-b5f4-1a9cfeb60f6b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:50.741474 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844b391-14e5-4159-b5f4-1a9cfeb60f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:50.741760 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844b391-14e5-4159-b5f4-1a9cfeb60f6b None admin] PATH_INFO: `/v3/projects/590e1563f57b4a089845f805f9cb48c1` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:50.742906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844b391-14e5-4159-b5f4-1a9cfeb60f6b None admin] RBAC: Authorizing `identity:get_project(project_id=590e1563f57b4a089845f805f9cb48c1)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:50.744506 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844b391-14e5-4159-b5f4-1a9cfeb60f6b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:50.746194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 64/134] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:18:50 2022] GET /identity/v3/projects/590e1563f57b4a089845f805f9cb48c1 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:50.747296 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9e97b-e4cd-4212-af4e-950941b45cc1 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:50.747581 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9e97b-e4cd-4212-af4e-950941b45cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:50.747858 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9e97b-e4cd-4212-af4e-950941b45cc1 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:50.753814 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 65/135] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:18:50.753814 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9e97b-e4cd-4212-af4e-950941b45cc1 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:50.761807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 71/136] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 14:18:50 2022] PUT /identity/v3/projects/590e1563f57b4a089845f805f9cb48c1/users/26be6d4d0994465aa60353e2ce00c1d9/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:18:50.763472 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd16fd1-221e-482e-845b-2d561ddedbd8 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:50.763924 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd16fd1-221e-482e-845b-2d561ddedbd8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:50.764360 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd16fd1-221e-482e-845b-2d561ddedbd8 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:50.766043 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 72/137] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:18:50.767131 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd16fd1-221e-482e-845b-2d561ddedbd8 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:50.786958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:50.875429 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:50.888684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd16fd1-221e-482e-845b-2d561ddedbd8 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:50.903268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9e97b-e4cd-4212-af4e-950941b45cc1 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:50.936169 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59525b58-df47-4567-9fb2-4be9849349e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:50.936988 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59525b58-df47-4567-9fb2-4be9849349e2 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:50.937627 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59525b58-df47-4567-9fb2-4be9849349e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:50.938701 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59525b58-df47-4567-9fb2-4be9849349e2 None admin] PATH_INFO: `/v3/projects/590e1563f57b4a089845f805f9cb48c1/users/26be6d4d0994465aa60353e2ce00c1d9/roles/eb8377ab1ad14341a780bc4acdfa2275` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:50.942499 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59525b58-df47-4567-9fb2-4be9849349e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=590e1563f57b4a089845f805f9cb48c1, user_id=26be6d4d0994465aa60353e2ce00c1d9, role_id=eb8377ab1ad14341a780bc4acdfa2275)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:50.943993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59525b58-df47-4567-9fb2-4be9849349e2 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:50.952127 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299a82b-8cb4-4101-9bd6-5aa25b472ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:50.953182 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299a82b-8cb4-4101-9bd6-5aa25b472ff1 None admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:50.953182 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299a82b-8cb4-4101-9bd6-5aa25b472ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:50.953424 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299a82b-8cb4-4101-9bd6-5aa25b472ff1 None admin] PATH_INFO: `/v3/projects/5c450ff5079c44d38f40071b4f7be9f0/users/26be6d4d0994465aa60353e2ce00c1d9/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:50.955562 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299a82b-8cb4-4101-9bd6-5aa25b472ff1 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c450ff5079c44d38f40071b4f7be9f0, user_id=26be6d4d0994465aa60353e2ce00c1d9, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:50.957222 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299a82b-8cb4-4101-9bd6-5aa25b472ff1 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:51.013856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 73/138] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 14:18:50 2022] PUT /identity/v3/projects/590e1563f57b4a089845f805f9cb48c1/users/26be6d4d0994465aa60353e2ce00c1d9/roles/eb8377ab1ad14341a780bc4acdfa2275 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:18:51.019269 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d37748-77ac-482c-a754-6635476bb382 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:51.019972 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d37748-77ac-482c-a754-6635476bb382 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:51.020543 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d37748-77ac-482c-a754-6635476bb382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:51.043329 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-58d37748-77ac-482c-a754-6635476bb382 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:51.048066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-58d37748-77ac-482c-a754-6635476bb382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:51.048884 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 66/139] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 14:18:50 2022] PUT /identity/v3/projects/5c450ff5079c44d38f40071b4f7be9f0/users/26be6d4d0994465aa60353e2ce00c1d9/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:18:51.050237 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaab294-4c89-4ec4-aa08-e8a2934e5599 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:51.050476 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaab294-4c89-4ec4-aa08-e8a2934e5599 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:51.058076 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaab294-4c89-4ec4-aa08-e8a2934e5599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:51.106955 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-bbaab294-4c89-4ec4-aa08-e8a2934e5599 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:51.108183 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-bbaab294-4c89-4ec4-aa08-e8a2934e5599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:51.180106 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 74/140] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:18:51.211543 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7e71d-3362-4b05-a6df-1bfaaff8cc26 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:51.211871 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7e71d-3362-4b05-a6df-1bfaaff8cc26 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:51.212109 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7e71d-3362-4b05-a6df-1bfaaff8cc26 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:51.213639 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 75/141] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:18:51.219954 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba268a-2d37-4a49-98da-6f5221d07d0f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:51.220397 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba268a-2d37-4a49-98da-6f5221d07d0f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:51.220674 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba268a-2d37-4a49-98da-6f5221d07d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:51.237252 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 67/142] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:18:51.240884 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:51.278924 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ceba268a-2d37-4a49-98da-6f5221d07d0f None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:51.280172 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ceba268a-2d37-4a49-98da-6f5221d07d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:51.368666 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 76/143] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:18:51.547936 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaab294-4c89-4ec4-aa08-e8a2934e5599 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:51.606098 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba268a-2d37-4a49-98da-6f5221d07d0f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:51.670128 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:51.713616 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaab294-4c89-4ec4-aa08-e8a2934e5599 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:51.751770 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba268a-2d37-4a49-98da-6f5221d07d0f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:51.782516 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:51.784939 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347f3d5-04a0-4a1b-a9f4-2fdcee83e381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:51.785592 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347f3d5-04a0-4a1b-a9f4-2fdcee83e381 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:51.785985 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347f3d5-04a0-4a1b-a9f4-2fdcee83e381 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:51.786379 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347f3d5-04a0-4a1b-a9f4-2fdcee83e381 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:51.787397 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582f2e7-73d0-4d66-82c1-f31e8b2dd7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:51.788044 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582f2e7-73d0-4d66-82c1-f31e8b2dd7a2 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:51.794646 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582f2e7-73d0-4d66-82c1-f31e8b2dd7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:51.794646 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582f2e7-73d0-4d66-82c1-f31e8b2dd7a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:51.794646 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582f2e7-73d0-4d66-82c1-f31e8b2dd7a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:51.794646 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582f2e7-73d0-4d66-82c1-f31e8b2dd7a2 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:51.794646 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 77/144] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:18:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:18:51.798724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582f2e7-73d0-4d66-82c1-f31e8b2dd7a2 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:51.813513 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e347f3d5-04a0-4a1b-a9f4-2fdcee83e381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:18:51.819445 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-e347f3d5-04a0-4a1b-a9f4-2fdcee83e381 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:18:51.819445 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:18:51.819445 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:18:51.819445 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:18:51.819445 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:18:51.819445 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:18:51.819445 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:18:51.819445 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:18:51.819445 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:18:51.819445 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:18:51.819445 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:18:51.819445 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:18:51.819445 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:18:51.819445 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:18:51.819445 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:18:51.819445 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:18:51.820287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:18:51.820287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:18:51.820287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:18:51.820287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:18:51.820287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:18:51.820287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:18:51.820287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:18:51.820287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:18:51.820287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:18:51.820287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:18:51.820287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:18:51.820287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:18:51.820287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:18:51.820287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:18:51.820287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:18:51.820287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:18:51.821025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:18:51.821025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:18:51.821025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:18:51.821025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:18:51.821025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:18:51.821025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:18:51.821025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:18:51.821025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:18:51.821025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:18:51.821025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:18:51.821025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:18:51.821025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:18:51.821025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 68/145] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:18:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:18:51.828063 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347f3d5-04a0-4a1b-a9f4-2fdcee83e381 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:51.901731 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582f2e7-73d0-4d66-82c1-f31e8b2dd7a2 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:51.945615 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ce6de-e241-466c-8168-7a92048405d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:51.946882 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ce6de-e241-466c-8168-7a92048405d4 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:51.947165 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ce6de-e241-466c-8168-7a92048405d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:51.947438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ce6de-e241-466c-8168-7a92048405d4 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:51.948104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ce6de-e241-466c-8168-7a92048405d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:51.949548 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ce6de-e241-466c-8168-7a92048405d4 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:52.008443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347f3d5-04a0-4a1b-a9f4-2fdcee83e381 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:52.043053 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:52.049209 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6f0f0-23d2-4600-9cb0-53b8e76d4acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:52.049771 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6f0f0-23d2-4600-9cb0-53b8e76d4acf None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:52.050066 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6f0f0-23d2-4600-9cb0-53b8e76d4acf None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:52.050341 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6f0f0-23d2-4600-9cb0-53b8e76d4acf None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:52.051015 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6f0f0-23d2-4600-9cb0-53b8e76d4acf None admin] RBAC: Adding query filter params (name=reader) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:52.051322 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6f0f0-23d2-4600-9cb0-53b8e76d4acf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:52.053006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6f0f0-23d2-4600-9cb0-53b8e76d4acf None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:52.061973 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 69/146] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 14:18:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:52.062899 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6f0f0-23d2-4600-9cb0-53b8e76d4acf None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:52.088404 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 78/147] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 14:18:51 2022] POST /identity/v3/users => generated 283 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:18:52.089360 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ce6de-e241-466c-8168-7a92048405d4 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:52.215244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6f0f0-23d2-4600-9cb0-53b8e76d4acf None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:52.253143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9a3e3-7a97-4abf-b6e6-fe601055cd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:52.254583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9a3e3-7a97-4abf-b6e6-fe601055cd56 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:52.255085 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9a3e3-7a97-4abf-b6e6-fe601055cd56 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:52.255551 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9a3e3-7a97-4abf-b6e6-fe601055cd56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:52.268359 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9a3e3-7a97-4abf-b6e6-fe601055cd56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:18:52.273078 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:52.274830 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-0db9a3e3-7a97-4abf-b6e6-fe601055cd56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:18:52.274830 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:18:52.274830 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:18:52.274830 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:18:52.274830 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:18:52.274830 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:18:52.274830 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:18:52.274830 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:18:52.274830 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:18:52.274830 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:18:52.274830 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:18:52.274830 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:18:52.274830 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:18:52.274830 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:18:52.274830 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:18:52.274830 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:18:52.275658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:18:52.275658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:18:52.275658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:18:52.275658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:18:52.275658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:18:52.275658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:18:52.275658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:18:52.275658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:18:52.275658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:18:52.275658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:18:52.275658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:18:52.275658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:18:52.275658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:18:52.275658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:18:52.275658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:18:52.275658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:18:52.276398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:18:52.276398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:18:52.276398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:18:52.276398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:18:52.276398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:18:52.276398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:18:52.276398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:18:52.276398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:18:52.276398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:18:52.276398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:18:52.276398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:18:52.276398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:18:52.278706 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 70/148] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:18:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:18:52.287873 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9a3e3-7a97-4abf-b6e6-fe601055cd56 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:52.336002 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ce6de-e241-466c-8168-7a92048405d4 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:52.373787 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:52.401778 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ecc05-406a-4bee-aba0-308626144e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:52.401778 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ecc05-406a-4bee-aba0-308626144e94 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:52.401778 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ecc05-406a-4bee-aba0-308626144e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:52.401778 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ecc05-406a-4bee-aba0-308626144e94 None admin] PATH_INFO: `/v3/users/68d5fec81ab947a69ce7a4b40a4d768c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:52.402484 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ecc05-406a-4bee-aba0-308626144e94 None admin] RBAC: Authorizing `identity:get_user(user_id=68d5fec81ab947a69ce7a4b40a4d768c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:52.402865 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ecc05-406a-4bee-aba0-308626144e94 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:52.404864 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 79/149] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:18:52 2022] GET /identity/v3/users/68d5fec81ab947a69ce7a4b40a4d768c => generated 289 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:52.410669 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ecc05-406a-4bee-aba0-308626144e94 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:52.442263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9a3e3-7a97-4abf-b6e6-fe601055cd56 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:52.507171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca047fe-3e90-4940-879c-803829435df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:52.507796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca047fe-3e90-4940-879c-803829435df0 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:52.508081 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca047fe-3e90-4940-879c-803829435df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:52.508464 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca047fe-3e90-4940-879c-803829435df0 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:52.509250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca047fe-3e90-4940-879c-803829435df0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:52.509561 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca047fe-3e90-4940-879c-803829435df0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:52.513866 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca047fe-3e90-4940-879c-803829435df0 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:52.517948 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ecc05-406a-4bee-aba0-308626144e94 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:52.527620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 71/150] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:18:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:52.546260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:52.549273 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca047fe-3e90-4940-879c-803829435df0 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:52.558621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2a445-4647-4ebb-a8f6-cda9566122df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:52.559268 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2a445-4647-4ebb-a8f6-cda9566122df None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:52.559550 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2a445-4647-4ebb-a8f6-cda9566122df None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:52.561931 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2a445-4647-4ebb-a8f6-cda9566122df None admin] PATH_INFO: `/v3/projects/590e1563f57b4a089845f805f9cb48c1` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:52.561931 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2a445-4647-4ebb-a8f6-cda9566122df None admin] RBAC: Authorizing `identity:get_project(project_id=590e1563f57b4a089845f805f9cb48c1)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:52.562519 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2a445-4647-4ebb-a8f6-cda9566122df None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:52.564498 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 80/151] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:18:52 2022] GET /identity/v3/projects/590e1563f57b4a089845f805f9cb48c1 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:52.570255 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2a445-4647-4ebb-a8f6-cda9566122df None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:52.676751 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2a445-4647-4ebb-a8f6-cda9566122df None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:52.711610 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d04a80-07e4-4046-88ad-0136b7d51513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:52.712274 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d04a80-07e4-4046-88ad-0136b7d51513 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:52.712553 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d04a80-07e4-4046-88ad-0136b7d51513 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:52.712828 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d04a80-07e4-4046-88ad-0136b7d51513 None admin] PATH_INFO: `/v3/projects/590e1563f57b4a089845f805f9cb48c1/users/68d5fec81ab947a69ce7a4b40a4d768c/roles/97d4738e1d3946aead178d02f1a88861` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:52.714805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d04a80-07e4-4046-88ad-0136b7d51513 None admin] RBAC: Authorizing `identity:create_grant(project_id=590e1563f57b4a089845f805f9cb48c1, user_id=68d5fec81ab947a69ce7a4b40a4d768c, role_id=97d4738e1d3946aead178d02f1a88861)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:52.716265 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d04a80-07e4-4046-88ad-0136b7d51513 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:52.737095 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca047fe-3e90-4940-879c-803829435df0 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:52.757459 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:52.776720 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa555f2f-89b2-4e35-992a-20371df2c9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:52.777360 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa555f2f-89b2-4e35-992a-20371df2c9f5 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:52.777642 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa555f2f-89b2-4e35-992a-20371df2c9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:52.777967 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa555f2f-89b2-4e35-992a-20371df2c9f5 None admin] PATH_INFO: `/v3/users/438e8adacb8940c696f3738e6ff13c30` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:52.779307 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa555f2f-89b2-4e35-992a-20371df2c9f5 None admin] RBAC: Authorizing `identity:get_user(user_id=438e8adacb8940c696f3738e6ff13c30)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:52.780864 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa555f2f-89b2-4e35-992a-20371df2c9f5 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:52.783402 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 72/152] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:18:52 2022] GET /identity/v3/users/438e8adacb8940c696f3738e6ff13c30 => generated 247 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:18:52.789053 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa555f2f-89b2-4e35-992a-20371df2c9f5 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:52.797228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 81/153] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 14:18:52 2022] PUT /identity/v3/projects/590e1563f57b4a089845f805f9cb48c1/users/68d5fec81ab947a69ce7a4b40a4d768c/roles/97d4738e1d3946aead178d02f1a88861 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:18:52.911039 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa555f2f-89b2-4e35-992a-20371df2c9f5 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:52.949409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03736c5c-c4aa-44f8-a155-40b003016a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:52.949965 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03736c5c-c4aa-44f8-a155-40b003016a5b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:52.950315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03736c5c-c4aa-44f8-a155-40b003016a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:52.950596 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03736c5c-c4aa-44f8-a155-40b003016a5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:53.010148 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:53.026897 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03736c5c-c4aa-44f8-a155-40b003016a5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:53.028590 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03736c5c-c4aa-44f8-a155-40b003016a5b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:53.107522 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347e385-c8f0-4f3c-8faf-7b74a1b1bd5f None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:53.107836 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347e385-c8f0-4f3c-8faf-7b74a1b1bd5f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:53.108855 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347e385-c8f0-4f3c-8faf-7b74a1b1bd5f None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:53.114161 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 82/154] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:18:53.127883 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69271133-20a9-47fd-8089-99e885b05c6d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:53.128506 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69271133-20a9-47fd-8089-99e885b05c6d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:53.129125 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69271133-20a9-47fd-8089-99e885b05c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:53.164806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-69271133-20a9-47fd-8089-99e885b05c6d None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:53.166031 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-69271133-20a9-47fd-8089-99e885b05c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:53.168450 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 73/155] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:18:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 14:18:53.174882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03736c5c-c4aa-44f8-a155-40b003016a5b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:53.242961 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:53.275593 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 83/156] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:18:53.296788 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:53.322951 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03736c5c-c4aa-44f8-a155-40b003016a5b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:53.375035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5dc9d6-2433-4273-b1ea-4ddbe06f70ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:53.375975 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dc9d6-2433-4273-b1ea-4ddbe06f70ed None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:53.376332 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dc9d6-2433-4273-b1ea-4ddbe06f70ed None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:53.376611 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dc9d6-2433-4273-b1ea-4ddbe06f70ed None admin] PATH_INFO: `/v3/projects/590e1563f57b4a089845f805f9cb48c1` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:53.377808 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5dc9d6-2433-4273-b1ea-4ddbe06f70ed None admin] RBAC: Authorizing `identity:get_project(project_id=590e1563f57b4a089845f805f9cb48c1)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:53.379263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5dc9d6-2433-4273-b1ea-4ddbe06f70ed None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:53.381354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 74/157] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:18:53 2022] GET /identity/v3/projects/590e1563f57b4a089845f805f9cb48c1 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:18:53.387310 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69271133-20a9-47fd-8089-99e885b05c6d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:53.518384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69271133-20a9-47fd-8089-99e885b05c6d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:53.560322 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683a8ab-c792-4379-8f61-fc16f80adfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:53.560942 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683a8ab-c792-4379-8f61-fc16f80adfdd None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:53.561223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683a8ab-c792-4379-8f61-fc16f80adfdd None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:53.561497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683a8ab-c792-4379-8f61-fc16f80adfdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:53.562278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683a8ab-c792-4379-8f61-fc16f80adfdd None admin] RBAC: Adding query filter params (role.id=b779073cee3c470ca4ad7a7b27d72c5e, scope.project.id=590e1563f57b4a089845f805f9cb48c1, user.id=438e8adacb8940c696f3738e6ff13c30) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:53.562587 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683a8ab-c792-4379-8f61-fc16f80adfdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:53.564839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683a8ab-c792-4379-8f61-fc16f80adfdd None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:53.571634 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 84/158] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:18:53 2022] GET /identity/v3/role_assignments?user.id=438e8adacb8940c696f3738e6ff13c30&scope.project.id=590e1563f57b4a089845f805f9cb48c1&role.id=b779073cee3c470ca4ad7a7b27d72c5e => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:53.793014 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5dc9d6-2433-4273-b1ea-4ddbe06f70ed None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:53.919267 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5dc9d6-2433-4273-b1ea-4ddbe06f70ed None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:53.960407 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b635794-96d5-4e81-b0ef-d41b2aa89de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:53.961413 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b635794-96d5-4e81-b0ef-d41b2aa89de3 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:53.961946 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b635794-96d5-4e81-b0ef-d41b2aa89de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:53.962435 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b635794-96d5-4e81-b0ef-d41b2aa89de3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:53.974001 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b635794-96d5-4e81-b0ef-d41b2aa89de3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:18:53.979050 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-1b635794-96d5-4e81-b0ef-d41b2aa89de3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:18:53.979050 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:18:53.979050 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:18:53.979050 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:18:53.979050 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:18:53.979050 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:18:53.979050 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:18:53.979050 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:18:53.979050 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:18:53.979050 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:18:53.979050 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:18:53.979050 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:18:53.979050 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:18:53.979050 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:18:53.979050 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:18:53.979050 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:18:53.979886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:18:53.979886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:18:53.979886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:18:53.979886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:18:53.979886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:18:53.979886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:18:53.979886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:18:53.979886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:18:53.979886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:18:53.979886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:18:53.979886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:18:53.979886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:18:53.979886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:18:53.979886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:18:53.979886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:18:53.979886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:18:53.980632 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:18:53.980632 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:18:53.980632 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:18:53.980632 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:18:53.980632 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:18:53.980632 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:18:53.980632 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:18:53.980632 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:18:53.980632 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:18:53.980632 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:18:53.980632 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:18:53.980632 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:18:53.982936 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 75/159] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:18:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:18:53.990873 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683a8ab-c792-4379-8f61-fc16f80adfdd None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:54.073421 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:54.137864 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683a8ab-c792-4379-8f61-fc16f80adfdd None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:54.180850 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5076e-8a87-4ebd-98a8-b7f5207784c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:54.181473 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5076e-8a87-4ebd-98a8-b7f5207784c8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:54.181768 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5076e-8a87-4ebd-98a8-b7f5207784c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:54.182054 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5076e-8a87-4ebd-98a8-b7f5207784c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:54.182736 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5076e-8a87-4ebd-98a8-b7f5207784c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:54.183040 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5076e-8a87-4ebd-98a8-b7f5207784c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:54.184409 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5076e-8a87-4ebd-98a8-b7f5207784c8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:54.196155 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 85/160] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 14:18:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:54.202870 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b635794-96d5-4e81-b0ef-d41b2aa89de3 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:54.226463 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:54.298746 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e36a2d-f6ba-4fbb-95a8-048928177ffa None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:54.299049 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e36a2d-f6ba-4fbb-95a8-048928177ffa None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:54.299321 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e36a2d-f6ba-4fbb-95a8-048928177ffa None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:54.300690 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 86/161] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:18:54.309559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1fc02-2193-4746-b69f-f9f4f449b321 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:54.309867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1fc02-2193-4746-b69f-f9f4f449b321 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:54.310139 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1fc02-2193-4746-b69f-f9f4f449b321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:54.345604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-43e1fc02-2193-4746-b69f-f9f4f449b321 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:54.347135 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-43e1fc02-2193-4746-b69f-f9f4f449b321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:54.393916 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b635794-96d5-4e81-b0ef-d41b2aa89de3 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:54.470883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd0823-4126-4ad8-bf73-fa8f1cbcf6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:54.471518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd0823-4126-4ad8-bf73-fa8f1cbcf6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:54.471795 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd0823-4126-4ad8-bf73-fa8f1cbcf6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:54.472067 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd0823-4126-4ad8-bf73-fa8f1cbcf6f1 None admin] PATH_INFO: `/v3/users/26be6d4d0994465aa60353e2ce00c1d9` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:54.474036 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd0823-4126-4ad8-bf73-fa8f1cbcf6f1 None admin] RBAC: Authorizing `identity:get_user(user_id=26be6d4d0994465aa60353e2ce00c1d9)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:54.475550 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd0823-4126-4ad8-bf73-fa8f1cbcf6f1 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:54.477148 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 76/162] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:18:54 2022] GET /identity/v3/users/26be6d4d0994465aa60353e2ce00c1d9 => generated 275 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:54.486597 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd0823-4126-4ad8-bf73-fa8f1cbcf6f1 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:54.486956 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 87/163] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:18:54.588968 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:54.614235 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd0823-4126-4ad8-bf73-fa8f1cbcf6f1 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:54.655349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d47b54-8482-4133-b540-c22bed688e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:54.656306 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d47b54-8482-4133-b540-c22bed688e6f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:54.657030 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d47b54-8482-4133-b540-c22bed688e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:54.657721 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d47b54-8482-4133-b540-c22bed688e6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:54.746166 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d47b54-8482-4133-b540-c22bed688e6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:54.748007 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d47b54-8482-4133-b540-c22bed688e6f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:54.839130 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1fc02-2193-4746-b69f-f9f4f449b321 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:54.857336 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:54.893460 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 77/164] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:18:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 14:18:54.894825 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bd47f-54b8-4a88-9e17-429e6bd9a0b6 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:54.895121 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bd47f-54b8-4a88-9e17-429e6bd9a0b6 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:54.899990 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bd47f-54b8-4a88-9e17-429e6bd9a0b6 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:54.901517 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 78/165] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:18:54.902646 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3bd47f-54b8-4a88-9e17-429e6bd9a0b6 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:54.923698 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:55.055919 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1fc02-2193-4746-b69f-f9f4f449b321 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:55.122436 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9c9ec-eeda-4e9a-8c80-3d7c9b17af31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:55.123085 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9c9ec-eeda-4e9a-8c80-3d7c9b17af31 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:55.123367 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9c9ec-eeda-4e9a-8c80-3d7c9b17af31 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:55.123645 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9c9ec-eeda-4e9a-8c80-3d7c9b17af31 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:55.127705 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3bd47f-54b8-4a88-9e17-429e6bd9a0b6 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:55.158737 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9c9ec-eeda-4e9a-8c80-3d7c9b17af31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:18:55.163501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-15a9c9ec-eeda-4e9a-8c80-3d7c9b17af31 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:18:55.163501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:18:55.163501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:18:55.163501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:18:55.163501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:18:55.163501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:18:55.163501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:18:55.163501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:18:55.163501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:18:55.163501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:18:55.163501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:18:55.163501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:18:55.163501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:18:55.163501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:18:55.163501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:18:55.163501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:18:55.164363 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:18:55.164363 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:18:55.164363 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:18:55.164363 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:18:55.164363 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:18:55.164363 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:18:55.164363 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:18:55.164363 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:18:55.164363 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:18:55.164363 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:18:55.164363 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:18:55.164363 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:18:55.164363 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:18:55.164363 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:18:55.164363 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:18:55.164363 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:18:55.165294 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:18:55.165294 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:18:55.165294 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:18:55.165294 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:18:55.165294 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:18:55.165294 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:18:55.165294 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:18:55.165294 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:18:55.165294 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:18:55.165294 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:18:55.165294 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:18:55.165294 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:18:55.165294 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 88/166] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 14:18:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:18:55.165952 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c67954-ad77-4bbc-b56f-4e6897423b72 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:55.166770 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c67954-ad77-4bbc-b56f-4e6897423b72 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:55.166770 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c67954-ad77-4bbc-b56f-4e6897423b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:55.198044 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f587c96-e9f6-4045-99e6-32b30ac91ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:55.198674 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f587c96-e9f6-4045-99e6-32b30ac91ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:55.198953 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f587c96-e9f6-4045-99e6-32b30ac91ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:55.199224 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f587c96-e9f6-4045-99e6-32b30ac91ac5 None admin] PATH_INFO: `/v3/projects/590e1563f57b4a089845f805f9cb48c1` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:55.200347 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f587c96-e9f6-4045-99e6-32b30ac91ac5 None admin] RBAC: Authorizing `identity:get_project(project_id=590e1563f57b4a089845f805f9cb48c1)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:55.201833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f587c96-e9f6-4045-99e6-32b30ac91ac5 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:55.202721 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-94c67954-ad77-4bbc-b56f-4e6897423b72 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:55.204478 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-94c67954-ad77-4bbc-b56f-4e6897423b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:55.210236 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 79/167] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:18:54 2022] GET /identity/v3/projects/590e1563f57b4a089845f805f9cb48c1 => generated 298 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:55.211054 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f587c96-e9f6-4045-99e6-32b30ac91ac5 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:55.292344 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:55.341458 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 89/168] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:18:55.342367 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c67954-ad77-4bbc-b56f-4e6897423b72 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:55.348593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f587c96-e9f6-4045-99e6-32b30ac91ac5 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:55.392734 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:55.405218 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7ecb4-18bc-4061-9a50-33886e7e0b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:55.407388 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7ecb4-18bc-4061-9a50-33886e7e0b81 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:55.407813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7ecb4-18bc-4061-9a50-33886e7e0b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:55.408260 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7ecb4-18bc-4061-9a50-33886e7e0b81 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:55.409239 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7ecb4-18bc-4061-9a50-33886e7e0b81 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:55.409684 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7ecb4-18bc-4061-9a50-33886e7e0b81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:55.411219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7ecb4-18bc-4061-9a50-33886e7e0b81 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:55.426002 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 80/169] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:18:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:55.432184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7ecb4-18bc-4061-9a50-33886e7e0b81 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:55.501410 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c67954-ad77-4bbc-b56f-4e6897423b72 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:55.547337 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7ecb4-18bc-4061-9a50-33886e7e0b81 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:55.558755 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:55.562497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cb22f-51f0-4398-87f7-756beb66b87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:55.563888 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cb22f-51f0-4398-87f7-756beb66b87e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:55.564628 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cb22f-51f0-4398-87f7-756beb66b87e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:55.564628 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cb22f-51f0-4398-87f7-756beb66b87e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:55.565335 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6cb22f-51f0-4398-87f7-756beb66b87e None admin] RBAC: Adding query filter params (role.id=a5c4bcef93884b89bf10b2f011d880c8, scope.project.id=590e1563f57b4a089845f805f9cb48c1, user.id=26be6d4d0994465aa60353e2ce00c1d9) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:55.565649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6cb22f-51f0-4398-87f7-756beb66b87e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:55.567142 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6cb22f-51f0-4398-87f7-756beb66b87e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:55.573473 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 90/170] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:18:55 2022] GET /identity/v3/role_assignments?user.id=26be6d4d0994465aa60353e2ce00c1d9&scope.project.id=590e1563f57b4a089845f805f9cb48c1&role.id=a5c4bcef93884b89bf10b2f011d880c8 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:55.593412 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b7f86-57ed-4b2a-a743-9cb91282f898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:55.595234 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b7f86-57ed-4b2a-a743-9cb91282f898 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:55.595783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b7f86-57ed-4b2a-a743-9cb91282f898 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:55.596203 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b7f86-57ed-4b2a-a743-9cb91282f898 None admin] PATH_INFO: `/v3/users/26be6d4d0994465aa60353e2ce00c1d9` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:55.602447 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b7f86-57ed-4b2a-a743-9cb91282f898 None admin] RBAC: Authorizing `identity:get_user(user_id=26be6d4d0994465aa60353e2ce00c1d9)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:55.604195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b7f86-57ed-4b2a-a743-9cb91282f898 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:55.606571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 81/171] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:18:55 2022] GET /identity/v3/users/26be6d4d0994465aa60353e2ce00c1d9 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:55.613349 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cb22f-51f0-4398-87f7-756beb66b87e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:55.719648 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:55.735483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cb22f-51f0-4398-87f7-756beb66b87e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:55.777011 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bee04a-9509-433e-9444-7c9b2234fe69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:55.777640 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bee04a-9509-433e-9444-7c9b2234fe69 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:55.777953 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bee04a-9509-433e-9444-7c9b2234fe69 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:55.778231 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bee04a-9509-433e-9444-7c9b2234fe69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:55.875704 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bee04a-9509-433e-9444-7c9b2234fe69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:55.877411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bee04a-9509-433e-9444-7c9b2234fe69 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:55.976412 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b7f86-57ed-4b2a-a743-9cb91282f898 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:55.997996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 91/172] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:18:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:18:55.998695 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:56.005468 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bee04a-9509-433e-9444-7c9b2234fe69 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:56.102249 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b7f86-57ed-4b2a-a743-9cb91282f898 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:56.139738 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bee04a-9509-433e-9444-7c9b2234fe69 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:56.148494 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39df7aa-f08f-4f74-a084-82841fdcac27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:56.149432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39df7aa-f08f-4f74-a084-82841fdcac27 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:56.149982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39df7aa-f08f-4f74-a084-82841fdcac27 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:56.150523 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39df7aa-f08f-4f74-a084-82841fdcac27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:56.162831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39df7aa-f08f-4f74-a084-82841fdcac27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:18:56.168409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-c39df7aa-f08f-4f74-a084-82841fdcac27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:18:56.168409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:18:56.168409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:18:56.168409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:18:56.168409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:18:56.168409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:18:56.168409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:18:56.168409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:18:56.168409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:18:56.168409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:18:56.168409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:18:56.168409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:18:56.168409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:18:56.168409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:18:56.168409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:18:56.168409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:18:56.169349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:18:56.169349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:18:56.169349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:18:56.169349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:18:56.169349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:18:56.169349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:18:56.169349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:18:56.169349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:18:56.169349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:18:56.169349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:18:56.169349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:18:56.169349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:18:56.169349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:18:56.169349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:18:56.169349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:18:56.169349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:18:56.170154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:18:56.170154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:18:56.170154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:18:56.170154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:18:56.170154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:18:56.170154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:18:56.170154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:18:56.170154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:18:56.170154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:18:56.170154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:18:56.170154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:18:56.170154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:18:56.173636 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 82/173] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:18:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:18:56.179127 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39df7aa-f08f-4f74-a084-82841fdcac27 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:56.192881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08995b-9a2d-4d37-9268-04c7c869f090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:56.193494 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08995b-9a2d-4d37-9268-04c7c869f090 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:56.193795 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08995b-9a2d-4d37-9268-04c7c869f090 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:56.194071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08995b-9a2d-4d37-9268-04c7c869f090 None admin] PATH_INFO: `/v3/projects/590e1563f57b4a089845f805f9cb48c1` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:56.198443 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08995b-9a2d-4d37-9268-04c7c869f090 None admin] RBAC: Authorizing `identity:get_project(project_id=590e1563f57b4a089845f805f9cb48c1)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:56.199918 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08995b-9a2d-4d37-9268-04c7c869f090 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:56.205772 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 92/174] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:18:56 2022] GET /identity/v3/projects/590e1563f57b4a089845f805f9cb48c1 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:18:56.224844 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08995b-9a2d-4d37-9268-04c7c869f090 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:56.229782 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:56.299804 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39df7aa-f08f-4f74-a084-82841fdcac27 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:56.341362 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98230f9-5332-4682-970d-547faf298e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:56.342416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98230f9-5332-4682-970d-547faf298e7a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:56.343573 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98230f9-5332-4682-970d-547faf298e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:56.345054 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98230f9-5332-4682-970d-547faf298e7a None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:56.347300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98230f9-5332-4682-970d-547faf298e7a None admin] RBAC: Adding query filter params (name=member) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:56.347812 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98230f9-5332-4682-970d-547faf298e7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:56.349529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98230f9-5332-4682-970d-547faf298e7a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:56.368323 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 83/175] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 14:18:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:56.372336 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98230f9-5332-4682-970d-547faf298e7a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:56.379249 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:56.465842 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08995b-9a2d-4d37-9268-04c7c869f090 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:56.542677 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f50505-4b84-44aa-9177-3140d6aae036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:56.543306 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f50505-4b84-44aa-9177-3140d6aae036 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:56.543583 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f50505-4b84-44aa-9177-3140d6aae036 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:56.544061 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f50505-4b84-44aa-9177-3140d6aae036 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:56.544645 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f50505-4b84-44aa-9177-3140d6aae036 None admin] RBAC: Adding query filter params (role.id=eb8377ab1ad14341a780bc4acdfa2275, scope.project.id=590e1563f57b4a089845f805f9cb48c1, user.id=26be6d4d0994465aa60353e2ce00c1d9) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:56.544954 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f50505-4b84-44aa-9177-3140d6aae036 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:56.546423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f50505-4b84-44aa-9177-3140d6aae036 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:56.548390 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:56.552711 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98230f9-5332-4682-970d-547faf298e7a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:56.565200 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 93/176] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:18:56 2022] GET /identity/v3/role_assignments?user.id=26be6d4d0994465aa60353e2ce00c1d9&scope.project.id=590e1563f57b4a089845f805f9cb48c1&role.id=eb8377ab1ad14341a780bc4acdfa2275 => generated 608 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:18:56.565200 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71833e42-cc29-44b7-ab9b-b0db3fe54553 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:56.565200 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71833e42-cc29-44b7-ab9b-b0db3fe54553 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:56.565200 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71833e42-cc29-44b7-ab9b-b0db3fe54553 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:56.565200 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 94/177] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:18:56.565200 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2ca93-9ee0-427d-bc08-932318911ae4 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:56.565684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2ca93-9ee0-427d-bc08-932318911ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:56.565684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2ca93-9ee0-427d-bc08-932318911ae4 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:56.565684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 95/178] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:18:56.572417 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72031af-1b7d-4863-adef-0db44348e29e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:56.572720 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72031af-1b7d-4863-adef-0db44348e29e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:56.572969 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72031af-1b7d-4863-adef-0db44348e29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:56.605966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e72031af-1b7d-4863-adef-0db44348e29e None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:56.611800 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e72031af-1b7d-4863-adef-0db44348e29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:56.636424 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86869ff4-128c-4930-8c72-a4e9be9f7b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:56.637119 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86869ff4-128c-4930-8c72-a4e9be9f7b12 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:56.637403 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86869ff4-128c-4930-8c72-a4e9be9f7b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:56.637676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86869ff4-128c-4930-8c72-a4e9be9f7b12 None admin] PATH_INFO: `/v3/users/26be6d4d0994465aa60353e2ce00c1d9` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:56.639429 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86869ff4-128c-4930-8c72-a4e9be9f7b12 None admin] RBAC: Authorizing `identity:get_user(user_id=26be6d4d0994465aa60353e2ce00c1d9)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:56.640955 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86869ff4-128c-4930-8c72-a4e9be9f7b12 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:56.643855 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 84/179] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:18:56 2022] GET /identity/v3/users/26be6d4d0994465aa60353e2ce00c1d9 => generated 275 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:56.647095 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a22aae-67b2-45a5-b393-847d54e41a22 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:56.648506 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a22aae-67b2-45a5-b393-847d54e41a22 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:56.648612 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a22aae-67b2-45a5-b393-847d54e41a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:56.687368 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-39a22aae-67b2-45a5-b393-847d54e41a22 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:56.689182 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-39a22aae-67b2-45a5-b393-847d54e41a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:56.749093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 96/180] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:18:56.749721 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72031af-1b7d-4863-adef-0db44348e29e None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:56.802727 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 85/181] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:18:56.804163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f97020-b327-4938-8b37-769e6f2ece83 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:56.804520 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f97020-b327-4938-8b37-769e6f2ece83 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:56.804864 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f97020-b327-4938-8b37-769e6f2ece83 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:56.806576 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 86/182] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:18:56.812188 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20c582-0030-4af7-a2ac-c1e22743ba71 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:56.813214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20c582-0030-4af7-a2ac-c1e22743ba71 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:56.817306 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20c582-0030-4af7-a2ac-c1e22743ba71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:56.835455 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-0e20c582-0030-4af7-a2ac-c1e22743ba71 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:56.836870 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0e20c582-0030-4af7-a2ac-c1e22743ba71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:56.850095 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:56.926433 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72031af-1b7d-4863-adef-0db44348e29e None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:56.970500 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 87/183] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:18:56.975590 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b401bc-2f97-4937-baed-35afc98f4dfe None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:56.975879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b401bc-2f97-4937-baed-35afc98f4dfe None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:56.976158 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b401bc-2f97-4937-baed-35afc98f4dfe None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:56.978540 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 88/184] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:18:56.983302 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fb9b7-5fea-4651-8694-1ae8e9532cca None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:56.983588 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fb9b7-5fea-4651-8694-1ae8e9532cca None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:56.983866 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fb9b7-5fea-4651-8694-1ae8e9532cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:56.988563 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef347390-25ae-467d-b119-efd62fdfdfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:56.989395 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef347390-25ae-467d-b119-efd62fdfdfc5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:56.990217 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef347390-25ae-467d-b119-efd62fdfdfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:56.990714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef347390-25ae-467d-b119-efd62fdfdfc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:57.014240 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-f96fb9b7-5fea-4651-8694-1ae8e9532cca None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:18:57.015559 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f96fb9b7-5fea-4651-8694-1ae8e9532cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:18:57.064964 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:57.108422 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef347390-25ae-467d-b119-efd62fdfdfc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:57.110451 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef347390-25ae-467d-b119-efd62fdfdfc5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:57.129979 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 89/185] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:18:57.131501 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fb9b7-5fea-4651-8694-1ae8e9532cca None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:57.219837 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 97/186] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:18:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:18:57.220817 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef347390-25ae-467d-b119-efd62fdfdfc5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:57.234096 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:57.234476 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fb9b7-5fea-4651-8694-1ae8e9532cca None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:57.283226 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4341077-039c-446b-9968-bf15b84c8627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:57.284509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4341077-039c-446b-9968-bf15b84c8627 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:57.285247 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4341077-039c-446b-9968-bf15b84c8627 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:57.285730 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4341077-039c-446b-9968-bf15b84c8627 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:57.299906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4341077-039c-446b-9968-bf15b84c8627 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:18:57.306608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-c4341077-039c-446b-9968-bf15b84c8627 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:18:57.306608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:18:57.306608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:18:57.306608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:18:57.306608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:18:57.306608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:18:57.306608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:18:57.306608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:18:57.306608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:18:57.306608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:18:57.306608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:18:57.306608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:18:57.306608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:18:57.306608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:18:57.306608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:18:57.306608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:18:57.307551 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:18:57.307551 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:18:57.307551 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:18:57.307551 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:18:57.307551 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:18:57.307551 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:18:57.307551 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:18:57.307551 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:18:57.307551 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:18:57.307551 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:18:57.307551 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:18:57.307551 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:18:57.307551 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:18:57.307551 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:18:57.307551 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:18:57.307551 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:18:57.308355 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:18:57.308355 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:18:57.308355 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:18:57.308355 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:18:57.308355 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:18:57.308355 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:18:57.308355 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:18:57.308355 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:18:57.308355 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:18:57.308355 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:18:57.308355 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:18:57.308355 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:18:57.311298 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 90/187] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:18:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:18:57.312301 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4341077-039c-446b-9968-bf15b84c8627 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:57.335120 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef347390-25ae-467d-b119-efd62fdfdfc5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:57.340965 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:57.370540 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9e718-edae-4b59-a7e3-96b93d59e07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:57.371167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9e718-edae-4b59-a7e3-96b93d59e07f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:57.371445 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9e718-edae-4b59-a7e3-96b93d59e07f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:57.371707 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9e718-edae-4b59-a7e3-96b93d59e07f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:57.383293 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9e718-edae-4b59-a7e3-96b93d59e07f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:18:57.388016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-2cb9e718-edae-4b59-a7e3-96b93d59e07f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:18:57.388016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:18:57.388016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:18:57.388016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:18:57.388016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:18:57.388016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:18:57.388016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:18:57.388016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:18:57.388016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:18:57.388016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:18:57.388016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:18:57.388016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:18:57.388016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:18:57.388016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:18:57.388016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:18:57.388016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:18:57.388896 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:18:57.388896 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:18:57.388896 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:18:57.388896 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:18:57.388896 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:18:57.388896 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:18:57.388896 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:18:57.388896 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:18:57.388896 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:18:57.388896 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:18:57.388896 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:18:57.388896 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:18:57.388896 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:18:57.388896 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:18:57.388896 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:18:57.388896 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:18:57.390067 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:18:57.390067 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:18:57.390067 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:18:57.390067 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:18:57.390067 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:18:57.390067 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:18:57.390067 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:18:57.390067 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:18:57.390067 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:18:57.390067 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:18:57.390067 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:18:57.390067 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:18:57.390067 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 98/188] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:18:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:18:57.390067 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9e718-edae-4b59-a7e3-96b93d59e07f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:57.412631 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:57.432548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4341077-039c-446b-9968-bf15b84c8627 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:57.467189 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce81cf-83cd-48b1-bd16-e0887858b800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:57.467820 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce81cf-83cd-48b1-bd16-e0887858b800 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:57.468095 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce81cf-83cd-48b1-bd16-e0887858b800 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:57.468371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce81cf-83cd-48b1-bd16-e0887858b800 None admin] PATH_INFO: `/v3/projects/5c450ff5079c44d38f40071b4f7be9f0` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:57.470198 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce81cf-83cd-48b1-bd16-e0887858b800 None admin] RBAC: Authorizing `identity:get_project(project_id=5c450ff5079c44d38f40071b4f7be9f0)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:57.471639 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce81cf-83cd-48b1-bd16-e0887858b800 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:57.473298 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 91/189] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:18:57 2022] GET /identity/v3/projects/5c450ff5079c44d38f40071b4f7be9f0 => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:57.474088 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce81cf-83cd-48b1-bd16-e0887858b800 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:57.502708 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9e718-edae-4b59-a7e3-96b93d59e07f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:57.537244 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575770ff-125a-4165-bba8-830d352dab09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:57.537879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575770ff-125a-4165-bba8-830d352dab09 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:57.538158 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575770ff-125a-4165-bba8-830d352dab09 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:57.538431 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575770ff-125a-4165-bba8-830d352dab09 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:57.539091 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575770ff-125a-4165-bba8-830d352dab09 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:57.539388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575770ff-125a-4165-bba8-830d352dab09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:57.540743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575770ff-125a-4165-bba8-830d352dab09 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:57.548730 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 99/190] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 14:18:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:57.553742 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575770ff-125a-4165-bba8-830d352dab09 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:57.559177 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:57.574092 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce81cf-83cd-48b1-bd16-e0887858b800 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:57.608095 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d7079-96a3-4e62-a3c3-85e6754f92d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:57.608644 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d7079-96a3-4e62-a3c3-85e6754f92d4 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:57.608925 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d7079-96a3-4e62-a3c3-85e6754f92d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:57.609197 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d7079-96a3-4e62-a3c3-85e6754f92d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:57.621011 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d7079-96a3-4e62-a3c3-85e6754f92d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:18:57.624591 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:57.625732 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-093d7079-96a3-4e62-a3c3-85e6754f92d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:18:57.625732 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:18:57.625732 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:18:57.625732 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:18:57.625732 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:18:57.625732 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:18:57.625732 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:18:57.625732 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:18:57.625732 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:18:57.625732 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:18:57.625732 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:18:57.625732 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:18:57.625732 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:18:57.625732 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:18:57.625732 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:18:57.625732 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:18:57.626877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:18:57.626877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:18:57.626877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:18:57.626877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:18:57.626877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:18:57.626877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:18:57.626877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:18:57.626877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:18:57.626877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:18:57.626877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:18:57.626877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:18:57.626877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:18:57.626877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:18:57.626877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:18:57.626877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:18:57.626877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:18:57.627676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:18:57.627676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:18:57.627676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:18:57.627676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:18:57.627676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:18:57.627676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:18:57.627676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:18:57.627676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:18:57.627676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:18:57.627676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:18:57.627676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:18:57.627676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:18:57.627676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 92/191] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 14:18:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:18:57.628328 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d7079-96a3-4e62-a3c3-85e6754f92d4 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:57.654874 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575770ff-125a-4165-bba8-830d352dab09 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:57.689734 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee73ccc-254b-4ca9-84b6-104caa524a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:57.690372 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee73ccc-254b-4ca9-84b6-104caa524a59 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:57.690651 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee73ccc-254b-4ca9-84b6-104caa524a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:57.690927 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee73ccc-254b-4ca9-84b6-104caa524a59 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:57.691593 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee73ccc-254b-4ca9-84b6-104caa524a59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:57.691898 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee73ccc-254b-4ca9-84b6-104caa524a59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:57.693266 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee73ccc-254b-4ca9-84b6-104caa524a59 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:57.701572 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 100/192] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:18:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:57.702385 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee73ccc-254b-4ca9-84b6-104caa524a59 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:57.728382 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d7079-96a3-4e62-a3c3-85e6754f92d4 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:57.761788 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa86cb-c5ed-4659-a355-2179d8c0af8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:57.762405 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa86cb-c5ed-4659-a355-2179d8c0af8c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:57.762687 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa86cb-c5ed-4659-a355-2179d8c0af8c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:57.762961 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa86cb-c5ed-4659-a355-2179d8c0af8c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:57.764176 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa86cb-c5ed-4659-a355-2179d8c0af8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:57.766214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa86cb-c5ed-4659-a355-2179d8c0af8c None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:57.767790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 93/193] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:18:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:57.768625 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa86cb-c5ed-4659-a355-2179d8c0af8c None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:57.784189 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:57.805252 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee73ccc-254b-4ca9-84b6-104caa524a59 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:57.838987 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690a657-7aee-423e-9726-3a30c7b808c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:57.839820 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690a657-7aee-423e-9726-3a30c7b808c8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:57.840094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690a657-7aee-423e-9726-3a30c7b808c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:57.840364 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690a657-7aee-423e-9726-3a30c7b808c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:57.841081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6690a657-7aee-423e-9726-3a30c7b808c8 None admin] RBAC: Adding query filter params (role.id=a5c4bcef93884b89bf10b2f011d880c8, scope.project.id=5c450ff5079c44d38f40071b4f7be9f0, user.id=26be6d4d0994465aa60353e2ce00c1d9) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:57.841384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6690a657-7aee-423e-9726-3a30c7b808c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:57.842843 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6690a657-7aee-423e-9726-3a30c7b808c8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:57.848692 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 101/194] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:18:57 2022] GET /identity/v3/role_assignments?user.id=26be6d4d0994465aa60353e2ce00c1d9&scope.project.id=5c450ff5079c44d38f40071b4f7be9f0&role.id=a5c4bcef93884b89bf10b2f011d880c8 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:57.849457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690a657-7aee-423e-9726-3a30c7b808c8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:57.851866 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:57.885890 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa86cb-c5ed-4659-a355-2179d8c0af8c None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:57.923818 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff1668-490d-4319-aca0-2528b96d7815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:57.924556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff1668-490d-4319-aca0-2528b96d7815 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:57.924903 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff1668-490d-4319-aca0-2528b96d7815 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:57.925244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff1668-490d-4319-aca0-2528b96d7815 None admin] PATH_INFO: `/v3/users/68d5fec81ab947a69ce7a4b40a4d768c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:57.926587 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff1668-490d-4319-aca0-2528b96d7815 None admin] RBAC: Authorizing `identity:get_user(user_id=68d5fec81ab947a69ce7a4b40a4d768c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:57.928211 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff1668-490d-4319-aca0-2528b96d7815 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:57.930346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 94/195] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:18:57 2022] GET /identity/v3/users/68d5fec81ab947a69ce7a4b40a4d768c => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:57.931225 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff1668-490d-4319-aca0-2528b96d7815 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:57.967218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690a657-7aee-423e-9726-3a30c7b808c8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:58.009252 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388e933-6807-44d4-a0fb-baaa8c4bcbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:58.009252 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388e933-6807-44d4-a0fb-baaa8c4bcbe1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:58.009252 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388e933-6807-44d4-a0fb-baaa8c4bcbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:58.009252 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388e933-6807-44d4-a0fb-baaa8c4bcbe1 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:58.009660 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388e933-6807-44d4-a0fb-baaa8c4bcbe1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:58.009660 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388e933-6807-44d4-a0fb-baaa8c4bcbe1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:58.011057 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388e933-6807-44d4-a0fb-baaa8c4bcbe1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:58.019839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 102/196] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:18:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:58.020645 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388e933-6807-44d4-a0fb-baaa8c4bcbe1 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:58.041925 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:58.062148 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff1668-490d-4319-aca0-2528b96d7815 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:58.091780 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:58.097728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276d5ee-3c0c-4565-aabb-6704641c472b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:58.102355 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276d5ee-3c0c-4565-aabb-6704641c472b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:58.102355 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276d5ee-3c0c-4565-aabb-6704641c472b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:58.102355 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276d5ee-3c0c-4565-aabb-6704641c472b None admin] PATH_INFO: `/v3/users/f7f3ced8f8bc458da764cf5ce0d33a3d` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:58.112172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276d5ee-3c0c-4565-aabb-6704641c472b None admin] RBAC: Authorizing `identity:get_user(user_id=f7f3ced8f8bc458da764cf5ce0d33a3d)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:58.113611 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276d5ee-3c0c-4565-aabb-6704641c472b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:58.115307 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 95/197] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:18:57 2022] GET /identity/v3/users/f7f3ced8f8bc458da764cf5ce0d33a3d => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:58.116818 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276d5ee-3c0c-4565-aabb-6704641c472b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:58.130780 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388e933-6807-44d4-a0fb-baaa8c4bcbe1 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:58.165515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ab9fb-47fb-4e96-bae3-6c52611d1349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:58.166074 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ab9fb-47fb-4e96-bae3-6c52611d1349 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:58.166352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ab9fb-47fb-4e96-bae3-6c52611d1349 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:58.166630 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ab9fb-47fb-4e96-bae3-6c52611d1349 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:58.167270 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ab9fb-47fb-4e96-bae3-6c52611d1349 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:58.168701 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ab9fb-47fb-4e96-bae3-6c52611d1349 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:58.214935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276d5ee-3c0c-4565-aabb-6704641c472b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:58.249203 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7aa0e-b664-4bfa-b61d-c2076df7e3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:58.249823 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7aa0e-b664-4bfa-b61d-c2076df7e3c0 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:58.250100 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7aa0e-b664-4bfa-b61d-c2076df7e3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:58.250369 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7aa0e-b664-4bfa-b61d-c2076df7e3c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:58.259492 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 103/198] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 14:18:58 2022] POST /identity/v3/users => generated 297 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:18:58.260374 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ab9fb-47fb-4e96-bae3-6c52611d1349 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:58.270107 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:58.341897 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7aa0e-b664-4bfa-b61d-c2076df7e3c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:58.343395 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7aa0e-b664-4bfa-b61d-c2076df7e3c0 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:58.378175 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ab9fb-47fb-4e96-bae3-6c52611d1349 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:58.400645 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:58.422767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2b213-8d6d-47a6-86e1-69430d4e063d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:58.424603 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2b213-8d6d-47a6-86e1-69430d4e063d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:58.424603 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2b213-8d6d-47a6-86e1-69430d4e063d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:58.424603 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2b213-8d6d-47a6-86e1-69430d4e063d None admin] PATH_INFO: `/v3/users/f7f3ced8f8bc458da764cf5ce0d33a3d` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:58.425071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2b213-8d6d-47a6-86e1-69430d4e063d None admin] RBAC: Authorizing `identity:get_user(user_id=f7f3ced8f8bc458da764cf5ce0d33a3d)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:58.426618 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2b213-8d6d-47a6-86e1-69430d4e063d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:58.428684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 104/199] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:18:58 2022] GET /identity/v3/users/f7f3ced8f8bc458da764cf5ce0d33a3d => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:58.429581 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2b213-8d6d-47a6-86e1-69430d4e063d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:58.456466 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 96/200] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:18:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:18:58.458701 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7aa0e-b664-4bfa-b61d-c2076df7e3c0 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:58.511006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:58.561133 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2b213-8d6d-47a6-86e1-69430d4e063d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:58.585364 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7aa0e-b664-4bfa-b61d-c2076df7e3c0 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:58.598638 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df74ad7-8dfc-4c26-8980-497658356af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:58.598638 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df74ad7-8dfc-4c26-8980-497658356af4 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:58.598882 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df74ad7-8dfc-4c26-8980-497658356af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:58.599100 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df74ad7-8dfc-4c26-8980-497658356af4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:58.630260 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05f244-254e-437d-8196-5fa692764122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:58.631167 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05f244-254e-437d-8196-5fa692764122 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:58.632024 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05f244-254e-437d-8196-5fa692764122 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:58.632024 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05f244-254e-437d-8196-5fa692764122 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:58.668650 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:58.682798 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df74ad7-8dfc-4c26-8980-497658356af4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:58.684213 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df74ad7-8dfc-4c26-8980-497658356af4 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:58.712479 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05f244-254e-437d-8196-5fa692764122 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:58.714399 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05f244-254e-437d-8196-5fa692764122 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:58.760510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:58.793426 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 105/201] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:18:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:18:58.794643 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df74ad7-8dfc-4c26-8980-497658356af4 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:58.825911 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 97/202] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:18:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:18:58.829468 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05f244-254e-437d-8196-5fa692764122 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:58.940956 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05f244-254e-437d-8196-5fa692764122 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:58.961121 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:58.980158 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcefde9-e94b-4d3c-96c8-66acd8fc3b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:58.981050 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcefde9-e94b-4d3c-96c8-66acd8fc3b82 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:58.981478 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcefde9-e94b-4d3c-96c8-66acd8fc3b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:58.981936 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcefde9-e94b-4d3c-96c8-66acd8fc3b82 None admin] PATH_INFO: `/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:58.983266 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcefde9-e94b-4d3c-96c8-66acd8fc3b82 None admin] RBAC: Authorizing `identity:get_project(project_id=fedc7eace6da4d0e82c913b2b5c17e17)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:58.983622 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df74ad7-8dfc-4c26-8980-497658356af4 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:58.987003 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcefde9-e94b-4d3c-96c8-66acd8fc3b82 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:58.989484 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 98/203] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:18:58 2022] GET /identity/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:58.990432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcefde9-e94b-4d3c-96c8-66acd8fc3b82 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:59.024456 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88836241-232e-4339-8341-b634983a099e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:59.025246 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88836241-232e-4339-8341-b634983a099e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:59.025625 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88836241-232e-4339-8341-b634983a099e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:59.029783 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88836241-232e-4339-8341-b634983a099e None admin] PATH_INFO: `/v3/projects/590e1563f57b4a089845f805f9cb48c1` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:59.029783 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88836241-232e-4339-8341-b634983a099e None admin] RBAC: Authorizing `identity:get_project(project_id=590e1563f57b4a089845f805f9cb48c1)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:59.029783 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88836241-232e-4339-8341-b634983a099e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:59.034020 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 106/204] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:18:58 2022] GET /identity/v3/projects/590e1563f57b4a089845f805f9cb48c1 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:59.034020 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88836241-232e-4339-8341-b634983a099e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:59.039394 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:59.203672 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcefde9-e94b-4d3c-96c8-66acd8fc3b82 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:59.215935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88836241-232e-4339-8341-b634983a099e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:59.290828 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66aeb1c-76a4-42cc-92ca-53937d75f27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:59.291471 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66aeb1c-76a4-42cc-92ca-53937d75f27b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:59.291752 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66aeb1c-76a4-42cc-92ca-53937d75f27b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:59.292026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66aeb1c-76a4-42cc-92ca-53937d75f27b None admin] PATH_INFO: `/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:59.299629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66aeb1c-76a4-42cc-92ca-53937d75f27b None admin] RBAC: Authorizing `identity:get_project(project_id=fedc7eace6da4d0e82c913b2b5c17e17)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:59.301110 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66aeb1c-76a4-42cc-92ca-53937d75f27b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:59.304089 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 99/205] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:18:58 2022] GET /identity/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17 => generated 302 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:59.304210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb4548-a115-493e-a1e3-829ebee52bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:59.304302 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66aeb1c-76a4-42cc-92ca-53937d75f27b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:59.304379 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb4548-a115-493e-a1e3-829ebee52bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:59.304917 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb4548-a115-493e-a1e3-829ebee52bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:59.305391 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb4548-a115-493e-a1e3-829ebee52bb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:59.306705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb4548-a115-493e-a1e3-829ebee52bb0 None admin] RBAC: Adding query filter params (role.id=b779073cee3c470ca4ad7a7b27d72c5e, scope.project.id=fedc7eace6da4d0e82c913b2b5c17e17, user.id=f7f3ced8f8bc458da764cf5ce0d33a3d) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:59.307233 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb4548-a115-493e-a1e3-829ebee52bb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:59.309872 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb4548-a115-493e-a1e3-829ebee52bb0 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:59.326183 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 107/206] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:18:59 2022] GET /identity/v3/role_assignments?user.id=f7f3ced8f8bc458da764cf5ce0d33a3d&scope.project.id=fedc7eace6da4d0e82c913b2b5c17e17&role.id=b779073cee3c470ca4ad7a7b27d72c5e => generated 259 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:59.327477 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb4548-a115-493e-a1e3-829ebee52bb0 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:18:59.382269 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:59.486917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:18:59.512879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66aeb1c-76a4-42cc-92ca-53937d75f27b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:59.552670 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972c521-fa5b-486c-888b-6dfead7fec37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:59.553472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972c521-fa5b-486c-888b-6dfead7fec37 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:59.553776 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972c521-fa5b-486c-888b-6dfead7fec37 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:59.554062 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972c521-fa5b-486c-888b-6dfead7fec37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:59.554834 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972c521-fa5b-486c-888b-6dfead7fec37 None admin] RBAC: Adding query filter params (role.id=97d4738e1d3946aead178d02f1a88861, scope.project.id=590e1563f57b4a089845f805f9cb48c1, user.id=68d5fec81ab947a69ce7a4b40a4d768c) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:59.555153 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972c521-fa5b-486c-888b-6dfead7fec37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:59.556663 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972c521-fa5b-486c-888b-6dfead7fec37 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:59.563815 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 100/207] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:18:59 2022] GET /identity/v3/role_assignments?user.id=68d5fec81ab947a69ce7a4b40a4d768c&scope.project.id=590e1563f57b4a089845f805f9cb48c1&role.id=97d4738e1d3946aead178d02f1a88861 => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:18:59.592320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb4548-a115-493e-a1e3-829ebee52bb0 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:18:59.657206 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b173580-6001-436a-b566-29b06d5320da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:18:59.658144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b173580-6001-436a-b566-29b06d5320da None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:18:59.658426 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b173580-6001-436a-b566-29b06d5320da None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:18:59.658693 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b173580-6001-436a-b566-29b06d5320da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:18:59.659441 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b173580-6001-436a-b566-29b06d5320da None admin] RBAC: Adding query filter params (role.id=eb8377ab1ad14341a780bc4acdfa2275, scope.project.id=fedc7eace6da4d0e82c913b2b5c17e17, user.id=f7f3ced8f8bc458da764cf5ce0d33a3d) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:18:59.659746 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b173580-6001-436a-b566-29b06d5320da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:18:59.661201 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b173580-6001-436a-b566-29b06d5320da None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:18:59.670172 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 108/208] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:18:59 2022] GET /identity/v3/role_assignments?user.id=f7f3ced8f8bc458da764cf5ce0d33a3d&scope.project.id=fedc7eace6da4d0e82c913b2b5c17e17&role.id=eb8377ab1ad14341a780bc4acdfa2275 => generated 259 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:00.428447 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514e20a-34de-41c8-b692-f8b74ae2c280 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:00.428942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514e20a-34de-41c8-b692-f8b74ae2c280 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:00.434698 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514e20a-34de-41c8-b692-f8b74ae2c280 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:00.434698 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 101/209] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:00.436920 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c76b45-e4f9-45ce-9707-0190bd2a428e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:00.438668 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c76b45-e4f9-45ce-9707-0190bd2a428e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:00.439147 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c76b45-e4f9-45ce-9707-0190bd2a428e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:00.458960 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-00c76b45-e4f9-45ce-9707-0190bd2a428e None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:00.460624 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-00c76b45-e4f9-45ce-9707-0190bd2a428e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:00.562167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 109/210] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:19:00.602130 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ac160-f3ff-4425-b229-25265612b0b0 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:00.602637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ac160-f3ff-4425-b229-25265612b0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:00.603046 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ac160-f3ff-4425-b229-25265612b0b0 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:00.604829 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 102/211] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:00.610969 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07858a2f-bf3f-432f-861b-c36be9ccaf89 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:00.611412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07858a2f-bf3f-432f-861b-c36be9ccaf89 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:00.611825 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07858a2f-bf3f-432f-861b-c36be9ccaf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:00.630033 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-07858a2f-bf3f-432f-861b-c36be9ccaf89 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:00.631689 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-07858a2f-bf3f-432f-861b-c36be9ccaf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:00.641933 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:00.705695 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 110/212] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:00.849223 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ac160-f3ff-4425-b229-25265612b0b0 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:00.958399 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ac160-f3ff-4425-b229-25265612b0b0 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:00.979947 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07858a2f-bf3f-432f-861b-c36be9ccaf89 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:00.993588 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e6066-03dc-450a-a80a-58c17a067b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:00.994253 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e6066-03dc-450a-a80a-58c17a067b75 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:00.994533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e6066-03dc-450a-a80a-58c17a067b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:00.994806 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e6066-03dc-450a-a80a-58c17a067b75 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:01.009135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e6066-03dc-450a-a80a-58c17a067b75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:01.016664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-870e6066-03dc-450a-a80a-58c17a067b75 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:19:01.016664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:01.016664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:01.016664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:01.016664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:01.016664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:01.016664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:01.016664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:01.016664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:01.016664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:01.016664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:01.016664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:01.016664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:01.016664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:01.016664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:01.016664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:01.017655 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:01.017655 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:01.017655 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:01.017655 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:01.017655 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:01.017655 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:01.017655 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:01.017655 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:01.017655 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:01.017655 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:01.017655 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:01.017655 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:01.017655 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:01.017655 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:01.017655 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:01.017655 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:01.018741 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:01.018741 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:01.018741 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:01.018741 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:01.018741 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:01.018741 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:01.018741 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:01.018741 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:01.018741 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:01.018741 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:01.018741 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:19:01.018741 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:01.018741 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 103/213] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:19:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:01.018741 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:01.023542 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e6066-03dc-450a-a80a-58c17a067b75 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:01.090689 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07858a2f-bf3f-432f-861b-c36be9ccaf89 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:01.126174 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e6066-03dc-450a-a80a-58c17a067b75 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:01.128094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0417b0-3802-449e-b444-2010a058a681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:01.129868 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0417b0-3802-449e-b444-2010a058a681 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:01.130669 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0417b0-3802-449e-b444-2010a058a681 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:01.131156 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0417b0-3802-449e-b444-2010a058a681 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:01.132501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0417b0-3802-449e-b444-2010a058a681 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:01.134633 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0417b0-3802-449e-b444-2010a058a681 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:01.137108 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 111/214] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:01.144783 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0417b0-3802-449e-b444-2010a058a681 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:01.166839 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd622a6-ada7-44d2-b077-84375e875034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:01.167445 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd622a6-ada7-44d2-b077-84375e875034 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:01.167726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd622a6-ada7-44d2-b077-84375e875034 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:01.167998 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd622a6-ada7-44d2-b077-84375e875034 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:01.168668 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd622a6-ada7-44d2-b077-84375e875034 None admin] RBAC: Adding query filter params (name=member) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:01.168978 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd622a6-ada7-44d2-b077-84375e875034 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:01.170464 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd622a6-ada7-44d2-b077-84375e875034 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:01.180048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 104/215] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 14:19:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:01.185721 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd622a6-ada7-44d2-b077-84375e875034 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:01.186627 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:01.253740 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:01.293734 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0417b0-3802-449e-b444-2010a058a681 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:01.304656 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd622a6-ada7-44d2-b077-84375e875034 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:01.332147 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f18b5-cdb4-47ce-85bc-3a1f7619ee48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:01.332758 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f18b5-cdb4-47ce-85bc-3a1f7619ee48 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:01.333035 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f18b5-cdb4-47ce-85bc-3a1f7619ee48 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:01.333305 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f18b5-cdb4-47ce-85bc-3a1f7619ee48 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:01.333986 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4f18b5-cdb4-47ce-85bc-3a1f7619ee48 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:01.335437 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4f18b5-cdb4-47ce-85bc-3a1f7619ee48 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:01.351971 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9dba9-4b9b-4f9c-ba64-3055c7ec8bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:01.352631 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9dba9-4b9b-4f9c-ba64-3055c7ec8bbc None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:01.352898 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9dba9-4b9b-4f9c-ba64-3055c7ec8bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:01.353170 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9dba9-4b9b-4f9c-ba64-3055c7ec8bbc None admin] PATH_INFO: `/v3/users/0c96988302174c659b97f0d55467bd97` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:01.368379 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9dba9-4b9b-4f9c-ba64-3055c7ec8bbc None admin] RBAC: Authorizing `identity:get_user(user_id=0c96988302174c659b97f0d55467bd97)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:01.369866 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9dba9-4b9b-4f9c-ba64-3055c7ec8bbc None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:01.371857 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 105/216] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:19:01 2022] GET /identity/v3/users/0c96988302174c659b97f0d55467bd97 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:01.377355 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9dba9-4b9b-4f9c-ba64-3055c7ec8bbc None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:01.447570 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 112/217] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 14:19:01 2022] POST /identity/v3/users => generated 297 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:19:01.452598 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072553f5-8b1f-4067-b2a8-828d6dc70b78 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:01.453273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072553f5-8b1f-4067-b2a8-828d6dc70b78 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:01.454134 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072553f5-8b1f-4067-b2a8-828d6dc70b78 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:01.457932 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 113/218] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:01.461463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c66a43-deeb-409f-8a96-bc24dbe05745 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:01.461786 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c66a43-deeb-409f-8a96-bc24dbe05745 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:01.462045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c66a43-deeb-409f-8a96-bc24dbe05745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:01.486390 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-09c66a43-deeb-409f-8a96-bc24dbe05745 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:01.488432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-09c66a43-deeb-409f-8a96-bc24dbe05745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:01.499409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9dba9-4b9b-4f9c-ba64-3055c7ec8bbc None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:01.530066 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:01.548779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ed64c-7894-4812-8caf-f70ab09e0e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:01.549787 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ed64c-7894-4812-8caf-f70ab09e0e2a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:01.550084 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ed64c-7894-4812-8caf-f70ab09e0e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:01.550565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ed64c-7894-4812-8caf-f70ab09e0e2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:01.571680 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:01.584480 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 114/219] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:01.632843 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ed64c-7894-4812-8caf-f70ab09e0e2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:01.634279 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ed64c-7894-4812-8caf-f70ab09e0e2a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:01.679222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9850bcf-7c97-4f1b-8adf-5ac94c7a676b None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:01.679737 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9850bcf-7c97-4f1b-8adf-5ac94c7a676b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:01.680009 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9850bcf-7c97-4f1b-8adf-5ac94c7a676b None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:01.681363 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 115/220] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:01.687105 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44b3b7-f874-497e-a1cc-d5c25c185276 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:01.687659 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44b3b7-f874-497e-a1cc-d5c25c185276 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:01.688141 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44b3b7-f874-497e-a1cc-d5c25c185276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:01.708617 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-de44b3b7-f874-497e-a1cc-d5c25c185276 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:01.709499 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-de44b3b7-f874-497e-a1cc-d5c25c185276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:01.756012 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 106/221] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:19:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 14:19:01.762203 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ed64c-7894-4812-8caf-f70ab09e0e2a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:01.784837 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:01.792812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 116/222] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:19:01.870027 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ed64c-7894-4812-8caf-f70ab09e0e2a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:01.902929 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44b3b7-f874-497e-a1cc-d5c25c185276 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:01.910631 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46e003-a9d0-471c-a80f-1c40c905f9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:01.911279 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46e003-a9d0-471c-a80f-1c40c905f9fb None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:01.911558 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46e003-a9d0-471c-a80f-1c40c905f9fb None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:01.911831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46e003-a9d0-471c-a80f-1c40c905f9fb None admin] PATH_INFO: `/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:01.912985 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46e003-a9d0-471c-a80f-1c40c905f9fb None admin] RBAC: Authorizing `identity:get_project(project_id=fedc7eace6da4d0e82c913b2b5c17e17)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:01.914468 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46e003-a9d0-471c-a80f-1c40c905f9fb None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:01.916410 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 107/223] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:19:01 2022] GET /identity/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:01.922833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46e003-a9d0-471c-a80f-1c40c905f9fb None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:02.026401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:02.040113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46e003-a9d0-471c-a80f-1c40c905f9fb None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:02.052140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44b3b7-f874-497e-a1cc-d5c25c185276 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:02.084540 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6c218-77d6-4934-b0a4-c4d052ddefe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:02.085488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6c218-77d6-4934-b0a4-c4d052ddefe0 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:02.086014 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6c218-77d6-4934-b0a4-c4d052ddefe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:02.086501 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6c218-77d6-4934-b0a4-c4d052ddefe0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:02.087466 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6c218-77d6-4934-b0a4-c4d052ddefe0 None admin] RBAC: Adding query filter params (role.id=a5c4bcef93884b89bf10b2f011d880c8, scope.project.id=fedc7eace6da4d0e82c913b2b5c17e17, user.id=0c96988302174c659b97f0d55467bd97) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:02.088005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6c218-77d6-4934-b0a4-c4d052ddefe0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:02.089813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6c218-77d6-4934-b0a4-c4d052ddefe0 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:02.091469 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:02.098274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 108/224] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:19:01 2022] GET /identity/v3/role_assignments?user.id=0c96988302174c659b97f0d55467bd97&scope.project.id=fedc7eace6da4d0e82c913b2b5c17e17&role.id=a5c4bcef93884b89bf10b2f011d880c8 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:02.098504 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01392f6-2533-47ed-82a2-d0fc8c0cafcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:02.099369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01392f6-2533-47ed-82a2-d0fc8c0cafcc None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:02.099646 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01392f6-2533-47ed-82a2-d0fc8c0cafcc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:02.099916 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01392f6-2533-47ed-82a2-d0fc8c0cafcc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:02.100184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6c218-77d6-4934-b0a4-c4d052ddefe0 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:02.113005 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01392f6-2533-47ed-82a2-d0fc8c0cafcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:02.119383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-e01392f6-2533-47ed-82a2-d0fc8c0cafcc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:19:02.119383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:02.119383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:02.119383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:02.119383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:02.119383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:02.119383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:02.119383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:02.119383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:02.119383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:02.119383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:02.119383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:02.119383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:02.119383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:02.119383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:02.119383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:02.120310 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:02.120310 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:02.120310 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:02.120310 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:02.120310 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:02.120310 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:02.120310 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:02.120310 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:02.120310 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:02.120310 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:02.120310 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:02.120310 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:02.120310 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:02.120310 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:02.120310 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:02.120310 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:02.121124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:02.121124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:02.121124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:02.121124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:02.121124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:02.121124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:02.121124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:02.121124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:02.121124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:02.121124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:02.121124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:19:02.121124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:02.126348 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 117/225] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:19:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:02.129053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01392f6-2533-47ed-82a2-d0fc8c0cafcc None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:02.263249 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01392f6-2533-47ed-82a2-d0fc8c0cafcc None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:02.305558 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691eb217-eb88-4b12-9212-066bea9716ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:02.306207 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eb217-eb88-4b12-9212-066bea9716ef None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:02.306483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eb217-eb88-4b12-9212-066bea9716ef None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:02.307177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eb217-eb88-4b12-9212-066bea9716ef None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:02.308006 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691eb217-eb88-4b12-9212-066bea9716ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:02.308311 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691eb217-eb88-4b12-9212-066bea9716ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:02.309720 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691eb217-eb88-4b12-9212-066bea9716ef None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:02.321347 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 118/226] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:19:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:02.327322 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691eb217-eb88-4b12-9212-066bea9716ef None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:02.329874 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6c218-77d6-4934-b0a4-c4d052ddefe0 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:02.390040 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:02.390699 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f6f0f-27ca-4532-a6d5-a6856faa52a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:02.391306 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f6f0f-27ca-4532-a6d5-a6856faa52a5 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:02.391592 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f6f0f-27ca-4532-a6d5-a6856faa52a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:02.391868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f6f0f-27ca-4532-a6d5-a6856faa52a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:02.419555 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f6f0f-27ca-4532-a6d5-a6856faa52a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:02.430128 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-eb7f6f0f-27ca-4532-a6d5-a6856faa52a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:19:02.430128 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:02.430128 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:02.430128 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:02.430128 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:02.430128 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:02.430128 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:02.430128 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:02.430128 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:02.430128 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:02.430128 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:02.430128 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:02.430128 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:02.430128 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:02.430128 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:02.430128 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:02.431028 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:02.431028 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:02.431028 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:02.431028 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:02.431028 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:02.431028 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:02.431028 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:02.431028 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:02.431028 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:02.431028 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:02.431028 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:02.431028 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:02.431028 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:02.431028 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:02.431028 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:02.431028 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:02.431796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:02.431796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:02.431796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:02.431796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:02.431796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:02.431796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:02.431796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:02.431796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:02.431796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:02.431796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:02.431796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:19:02.431796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:02.431796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 109/227] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 14:19:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:02.437071 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f6f0f-27ca-4532-a6d5-a6856faa52a5 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:02.458141 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:02.479046 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691eb217-eb88-4b12-9212-066bea9716ef None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:02.525017 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a927b71-d6f9-4260-b9ab-74b69b53ecd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:02.526020 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a927b71-d6f9-4260-b9ab-74b69b53ecd3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:02.528219 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a927b71-d6f9-4260-b9ab-74b69b53ecd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:02.528695 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a927b71-d6f9-4260-b9ab-74b69b53ecd3 None admin] PATH_INFO: `/v3/users/f7f3ced8f8bc458da764cf5ce0d33a3d` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:02.530757 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a927b71-d6f9-4260-b9ab-74b69b53ecd3 None admin] RBAC: Authorizing `identity:get_user(user_id=f7f3ced8f8bc458da764cf5ce0d33a3d)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:02.534404 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a927b71-d6f9-4260-b9ab-74b69b53ecd3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:02.537333 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 119/228] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:19:02 2022] GET /identity/v3/users/f7f3ced8f8bc458da764cf5ce0d33a3d => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:02.547950 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a927b71-d6f9-4260-b9ab-74b69b53ecd3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:02.598628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f6f0f-27ca-4532-a6d5-a6856faa52a5 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:02.634910 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb8bdb-66a7-4238-b826-de49e17e220f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:02.635878 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb8bdb-66a7-4238-b826-de49e17e220f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:02.636369 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb8bdb-66a7-4238-b826-de49e17e220f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:02.636846 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb8bdb-66a7-4238-b826-de49e17e220f None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:02.637708 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb8bdb-66a7-4238-b826-de49e17e220f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:02.638244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb8bdb-66a7-4238-b826-de49e17e220f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:02.639826 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb8bdb-66a7-4238-b826-de49e17e220f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:02.649259 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 110/229] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:19:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:02.654463 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb8bdb-66a7-4238-b826-de49e17e220f None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:02.736576 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a927b71-d6f9-4260-b9ab-74b69b53ecd3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:02.758688 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:02.774924 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce29eda-6165-4d2a-8ed1-be683f96b353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:02.775665 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce29eda-6165-4d2a-8ed1-be683f96b353 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:02.775893 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce29eda-6165-4d2a-8ed1-be683f96b353 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:02.776170 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce29eda-6165-4d2a-8ed1-be683f96b353 None admin] PATH_INFO: `/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:02.777314 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce29eda-6165-4d2a-8ed1-be683f96b353 None admin] RBAC: Authorizing `identity:get_project(project_id=fedc7eace6da4d0e82c913b2b5c17e17)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:02.779200 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce29eda-6165-4d2a-8ed1-be683f96b353 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:02.782166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 120/230] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:19:02 2022] GET /identity/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17 => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:02.788317 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce29eda-6165-4d2a-8ed1-be683f96b353 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:02.823768 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:02.853928 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb8bdb-66a7-4238-b826-de49e17e220f None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:02.894719 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75dba1-a9e9-43c2-a75b-58dcc1e4fff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:02.895433 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75dba1-a9e9-43c2-a75b-58dcc1e4fff8 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:02.895726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75dba1-a9e9-43c2-a75b-58dcc1e4fff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:02.896000 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75dba1-a9e9-43c2-a75b-58dcc1e4fff8 None admin] PATH_INFO: `/v3/users/f7f3ced8f8bc458da764cf5ce0d33a3d` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:02.897507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75dba1-a9e9-43c2-a75b-58dcc1e4fff8 None admin] RBAC: Authorizing `identity:get_user(user_id=f7f3ced8f8bc458da764cf5ce0d33a3d)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:02.899996 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75dba1-a9e9-43c2-a75b-58dcc1e4fff8 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:02.902211 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 111/231] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:19:02 2022] GET /identity/v3/users/f7f3ced8f8bc458da764cf5ce0d33a3d => generated 283 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:02.911692 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75dba1-a9e9-43c2-a75b-58dcc1e4fff8 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:03.063469 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75dba1-a9e9-43c2-a75b-58dcc1e4fff8 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:03.071920 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce29eda-6165-4d2a-8ed1-be683f96b353 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:03.102225 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93b8bb-6c07-41f2-8ffb-27cbe934bdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:03.102879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93b8bb-6c07-41f2-8ffb-27cbe934bdbb None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:03.103162 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93b8bb-6c07-41f2-8ffb-27cbe934bdbb None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:03.103436 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93b8bb-6c07-41f2-8ffb-27cbe934bdbb None admin] PATH_INFO: `/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:03.104806 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93b8bb-6c07-41f2-8ffb-27cbe934bdbb None admin] RBAC: Authorizing `identity:get_project(project_id=fedc7eace6da4d0e82c913b2b5c17e17)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:03.106371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93b8bb-6c07-41f2-8ffb-27cbe934bdbb None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:03.109561 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 112/232] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:19:02 2022] GET /identity/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:03.117761 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93b8bb-6c07-41f2-8ffb-27cbe934bdbb None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:03.142276 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:03.143248 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1869dd6-70c4-44c0-8297-d3fd3d368088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:03.143922 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1869dd6-70c4-44c0-8297-d3fd3d368088 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:03.144199 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1869dd6-70c4-44c0-8297-d3fd3d368088 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:03.144469 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1869dd6-70c4-44c0-8297-d3fd3d368088 None admin] PATH_INFO: `/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17/users/f7f3ced8f8bc458da764cf5ce0d33a3d/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:03.147355 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1869dd6-70c4-44c0-8297-d3fd3d368088 None admin] RBAC: Authorizing `identity:create_grant(project_id=fedc7eace6da4d0e82c913b2b5c17e17, user_id=f7f3ced8f8bc458da764cf5ce0d33a3d, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:03.150280 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1869dd6-70c4-44c0-8297-d3fd3d368088 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:03.237292 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 121/233] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 14:19:02 2022] PUT /identity/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17/users/f7f3ced8f8bc458da764cf5ce0d33a3d/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:19:03.250673 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93b8bb-6c07-41f2-8ffb-27cbe934bdbb None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:03.319495 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa22364-f565-4ff3-8f05-bfe8f93ca335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:03.320100 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa22364-f565-4ff3-8f05-bfe8f93ca335 None admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:03.320382 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa22364-f565-4ff3-8f05-bfe8f93ca335 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:03.320658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa22364-f565-4ff3-8f05-bfe8f93ca335 None admin] PATH_INFO: `/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17/users/f7f3ced8f8bc458da764cf5ce0d33a3d/roles/eb8377ab1ad14341a780bc4acdfa2275` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:03.328813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa22364-f565-4ff3-8f05-bfe8f93ca335 None admin] RBAC: Authorizing `identity:create_grant(project_id=fedc7eace6da4d0e82c913b2b5c17e17, user_id=f7f3ced8f8bc458da764cf5ce0d33a3d, role_id=eb8377ab1ad14341a780bc4acdfa2275)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:03.330418 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa22364-f565-4ff3-8f05-bfe8f93ca335 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:03.442478 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 113/234] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 14:19:03 2022] PUT /identity/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17/users/f7f3ced8f8bc458da764cf5ce0d33a3d/roles/eb8377ab1ad14341a780bc4acdfa2275 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:19:03.892566 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe289b51-ab4f-49c7-a4c0-d799403fa26b None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:03.893081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe289b51-ab4f-49c7-a4c0-d799403fa26b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:03.893184 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe289b51-ab4f-49c7-a4c0-d799403fa26b None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:03.894549 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 122/235] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:03.900060 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392e18f-d2ea-4756-988f-f5ddde431259 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:03.900469 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392e18f-d2ea-4756-988f-f5ddde431259 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:03.900637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392e18f-d2ea-4756-988f-f5ddde431259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:03.919199 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-9392e18f-d2ea-4756-988f-f5ddde431259 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:03.920400 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9392e18f-d2ea-4756-988f-f5ddde431259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:03.980970 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cacdf-9ae4-4f98-9d60-e63ab0e7280c None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:03.981584 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cacdf-9ae4-4f98-9d60-e63ab0e7280c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:03.982081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cacdf-9ae4-4f98-9d60-e63ab0e7280c None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:03.983742 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 123/236] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:03.987089 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:03.989376 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184f514-0793-4d51-aaac-e4b18264f287 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:03.989908 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184f514-0793-4d51-aaac-e4b18264f287 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:03.990398 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184f514-0793-4d51-aaac-e4b18264f287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:03.994668 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 114/237] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:04.022898 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-0184f514-0793-4d51-aaac-e4b18264f287 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:04.024355 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0184f514-0793-4d51-aaac-e4b18264f287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:04.086167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:04.124268 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 124/238] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:19:04.365981 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce470afb-fd84-44e7-9c70-e1c90d5af254 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:04.366323 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce470afb-fd84-44e7-9c70-e1c90d5af254 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:04.366539 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce470afb-fd84-44e7-9c70-e1c90d5af254 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:04.368229 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 115/239] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:04.373464 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1c13b-f879-484c-80ee-b89bcec122b6 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:04.373767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1c13b-f879-484c-80ee-b89bcec122b6 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:04.374046 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1c13b-f879-484c-80ee-b89bcec122b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:04.396881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-32a1c13b-f879-484c-80ee-b89bcec122b6 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:04.397724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-32a1c13b-f879-484c-80ee-b89bcec122b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:04.468907 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce470afb-fd84-44e7-9c70-e1c90d5af254 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:04.489931 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 125/240] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:04.489931 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1c13b-f879-484c-80ee-b89bcec122b6 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:04.656984 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce470afb-fd84-44e7-9c70-e1c90d5af254 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:04.677549 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1c13b-f879-484c-80ee-b89bcec122b6 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:04.685496 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:04.717130 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673568d-45e7-48ab-bc09-457ad3312729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:04.718120 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673568d-45e7-48ab-bc09-457ad3312729 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:04.719356 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673568d-45e7-48ab-bc09-457ad3312729 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:04.719975 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673568d-45e7-48ab-bc09-457ad3312729 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:04.720346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b01da-46a9-416f-9e2c-f77e18866cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:04.720970 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b01da-46a9-416f-9e2c-f77e18866cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:04.721251 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b01da-46a9-416f-9e2c-f77e18866cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:04.721523 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b01da-46a9-416f-9e2c-f77e18866cf6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:04.722303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673568d-45e7-48ab-bc09-457ad3312729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:04.723935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673568d-45e7-48ab-bc09-457ad3312729 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:04.725823 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 126/241] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:04.731110 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673568d-45e7-48ab-bc09-457ad3312729 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:04.742837 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b01da-46a9-416f-9e2c-f77e18866cf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:04.755976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-e63b01da-46a9-416f-9e2c-f77e18866cf6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:19:04.755976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:04.755976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:04.755976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:04.755976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:04.755976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:04.755976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:04.755976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:04.755976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:04.755976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:04.755976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:04.755976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:04.755976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:04.755976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:04.755976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:04.755976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:04.756868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:04.756868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:04.756868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:04.756868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:04.756868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:04.756868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:04.756868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:04.756868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:04.756868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:04.756868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:04.756868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:04.756868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:04.756868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:04.756868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:04.756868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:04.756868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:04.757675 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:04.757675 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:04.757675 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:04.757675 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:04.757675 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:04.757675 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:04.757675 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:04.757675 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:04.757675 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:04.757675 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:04.757675 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:19:04.757675 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:04.757675 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 116/242] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:19:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:04.764980 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b01da-46a9-416f-9e2c-f77e18866cf6 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:04.860852 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:04.877768 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673568d-45e7-48ab-bc09-457ad3312729 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:04.903048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b01da-46a9-416f-9e2c-f77e18866cf6 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:04.915417 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbf68b-8e86-48e9-9190-28225314d867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:04.915964 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbf68b-8e86-48e9-9190-28225314d867 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:04.916231 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbf68b-8e86-48e9-9190-28225314d867 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:04.916508 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbf68b-8e86-48e9-9190-28225314d867 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:04.917162 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fbf68b-8e86-48e9-9190-28225314d867 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:04.918728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fbf68b-8e86-48e9-9190-28225314d867 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:04.940353 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10cb36c-d966-4daf-a41f-5a45e2635aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:04.944468 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cb36c-d966-4daf-a41f-5a45e2635aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:04.944468 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cb36c-d966-4daf-a41f-5a45e2635aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:04.944468 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cb36c-d966-4daf-a41f-5a45e2635aa5 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:04.944468 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10cb36c-d966-4daf-a41f-5a45e2635aa5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:04.944468 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10cb36c-d966-4daf-a41f-5a45e2635aa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:04.944468 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10cb36c-d966-4daf-a41f-5a45e2635aa5 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:04.952477 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 117/243] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 14:19:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:04.953788 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10cb36c-d966-4daf-a41f-5a45e2635aa5 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:04.997797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 127/244] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 14:19:04 2022] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:19:04.999737 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbf68b-8e86-48e9-9190-28225314d867 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:05.049543 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:05.127886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10cb36c-d966-4daf-a41f-5a45e2635aa5 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:05.144746 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbf68b-8e86-48e9-9190-28225314d867 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:05.185251 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:05.189961 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e01560-31a4-4f76-a2b9-aa5f9776e889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:05.191428 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e01560-31a4-4f76-a2b9-aa5f9776e889 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:05.192096 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e01560-31a4-4f76-a2b9-aa5f9776e889 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:05.192574 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e01560-31a4-4f76-a2b9-aa5f9776e889 None admin] PATH_INFO: `/v3/users/8f721cdc9fdf4092a1115a7291a1669e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:05.210445 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e01560-31a4-4f76-a2b9-aa5f9776e889 None admin] RBAC: Authorizing `identity:get_user(user_id=8f721cdc9fdf4092a1115a7291a1669e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:05.213321 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e01560-31a4-4f76-a2b9-aa5f9776e889 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:05.216359 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 128/245] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:19:04 2022] GET /identity/v3/users/8f721cdc9fdf4092a1115a7291a1669e => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:05.222945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e01560-31a4-4f76-a2b9-aa5f9776e889 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:05.234534 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02347398-f68b-4733-8cb3-7263205e129d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:05.235316 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02347398-f68b-4733-8cb3-7263205e129d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:05.235537 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02347398-f68b-4733-8cb3-7263205e129d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:05.235746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02347398-f68b-4733-8cb3-7263205e129d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:05.251794 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02347398-f68b-4733-8cb3-7263205e129d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:05.257935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-02347398-f68b-4733-8cb3-7263205e129d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:19:05.257935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:05.257935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:05.257935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:05.257935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:05.257935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:05.257935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:05.257935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:05.257935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:05.257935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:05.257935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:05.257935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:05.257935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:05.257935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:05.257935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:05.257935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:05.258825 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:05.258825 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:05.258825 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:05.258825 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:05.258825 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:05.258825 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:05.258825 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:05.258825 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:05.258825 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:05.258825 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:05.258825 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:05.258825 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:05.258825 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:05.258825 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:05.258825 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:05.258825 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:05.259651 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:05.259651 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:05.259651 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:05.259651 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:05.259651 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:05.259651 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:05.259651 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:05.259651 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:05.259651 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:05.259651 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:05.259651 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:19:05.259651 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:05.259651 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 118/246] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:19:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:05.271982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02347398-f68b-4733-8cb3-7263205e129d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:05.337376 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:05.353101 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e01560-31a4-4f76-a2b9-aa5f9776e889 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:05.399902 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17dcec-1434-411b-8e91-6aa4d0e049a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:05.403315 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17dcec-1434-411b-8e91-6aa4d0e049a3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:05.403315 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17dcec-1434-411b-8e91-6aa4d0e049a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:05.403514 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17dcec-1434-411b-8e91-6aa4d0e049a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:05.404579 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02347398-f68b-4733-8cb3-7263205e129d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:05.449309 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f4dbc-5de4-48dc-9b91-6e1754b364d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:05.449941 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f4dbc-5de4-48dc-9b91-6e1754b364d1 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:05.450478 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f4dbc-5de4-48dc-9b91-6e1754b364d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:05.450946 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f4dbc-5de4-48dc-9b91-6e1754b364d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:05.451885 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f4dbc-5de4-48dc-9b91-6e1754b364d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:05.452254 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f4dbc-5de4-48dc-9b91-6e1754b364d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:05.454564 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f4dbc-5de4-48dc-9b91-6e1754b364d1 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:05.464444 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 119/247] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 14:19:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:05.470248 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f4dbc-5de4-48dc-9b91-6e1754b364d1 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:05.515949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17dcec-1434-411b-8e91-6aa4d0e049a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:05.517869 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17dcec-1434-411b-8e91-6aa4d0e049a3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:05.521894 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:05.607189 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f4dbc-5de4-48dc-9b91-6e1754b364d1 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:05.646955 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91487d-e29c-4182-874a-2af06344088d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:05.647833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91487d-e29c-4182-874a-2af06344088d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:05.648283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91487d-e29c-4182-874a-2af06344088d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:05.648705 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91487d-e29c-4182-874a-2af06344088d None admin] PATH_INFO: `/v3/users/0c96988302174c659b97f0d55467bd97` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:05.649899 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91487d-e29c-4182-874a-2af06344088d None admin] RBAC: Authorizing `identity:get_user(user_id=0c96988302174c659b97f0d55467bd97)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:05.651355 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91487d-e29c-4182-874a-2af06344088d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:05.653230 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 120/248] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:19:05 2022] GET /identity/v3/users/0c96988302174c659b97f0d55467bd97 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:05.653723 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:05.654398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd5df9-d361-4aa9-b9ad-91a875c6aaba None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:05.654675 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd5df9-d361-4aa9-b9ad-91a875c6aaba None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:05.655022 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd5df9-d361-4aa9-b9ad-91a875c6aaba None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:05.656782 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 121/249] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:05.661528 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd5df9-d361-4aa9-b9ad-91a875c6aaba None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:05.674754 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 129/250] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:19:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 14:19:05.676967 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecbd59-1baa-4d40-9378-eda304c57b0a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:05.677480 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecbd59-1baa-4d40-9378-eda304c57b0a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:05.678388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecbd59-1baa-4d40-9378-eda304c57b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:05.705321 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f7ecbd59-1baa-4d40-9378-eda304c57b0a None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:05.707809 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f7ecbd59-1baa-4d40-9378-eda304c57b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:05.790624 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd5df9-d361-4aa9-b9ad-91a875c6aaba None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:05.800932 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 130/251] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:05.802758 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecbd59-1baa-4d40-9378-eda304c57b0a None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:05.806852 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:05.832720 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e17da-ca1c-4d60-b12b-e36b6cb38916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:05.833834 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e17da-ca1c-4d60-b12b-e36b6cb38916 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:05.834114 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e17da-ca1c-4d60-b12b-e36b6cb38916 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:05.834438 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e17da-ca1c-4d60-b12b-e36b6cb38916 None admin] PATH_INFO: `/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:05.835851 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e17da-ca1c-4d60-b12b-e36b6cb38916 None admin] RBAC: Authorizing `identity:get_project(project_id=fedc7eace6da4d0e82c913b2b5c17e17)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:05.837864 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e17da-ca1c-4d60-b12b-e36b6cb38916 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:05.845069 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 122/252] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:19:05 2022] GET /identity/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:05.846766 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e17da-ca1c-4d60-b12b-e36b6cb38916 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:05.919325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecbd59-1baa-4d40-9378-eda304c57b0a None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:05.938874 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:05.956610 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25c0ec-4faf-489f-b16b-741271f46ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:05.957172 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25c0ec-4faf-489f-b16b-741271f46ebc None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:05.957505 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25c0ec-4faf-489f-b16b-741271f46ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:05.957809 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25c0ec-4faf-489f-b16b-741271f46ebc None admin] PATH_INFO: `/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:05.958925 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25c0ec-4faf-489f-b16b-741271f46ebc None admin] RBAC: Authorizing `identity:get_project(project_id=fedc7eace6da4d0e82c913b2b5c17e17)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:05.960418 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25c0ec-4faf-489f-b16b-741271f46ebc None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:05.962552 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 131/253] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:19:05 2022] GET /identity/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:05.967283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e17da-ca1c-4d60-b12b-e36b6cb38916 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:05.970744 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25c0ec-4faf-489f-b16b-741271f46ebc None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:06.007930 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fc072-c959-434b-b914-6145f972e552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:06.008982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fc072-c959-434b-b914-6145f972e552 None admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:06.009462 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fc072-c959-434b-b914-6145f972e552 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:06.009969 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fc072-c959-434b-b914-6145f972e552 None admin] PATH_INFO: `/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17/users/0c96988302174c659b97f0d55467bd97/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:06.012127 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fc072-c959-434b-b914-6145f972e552 None admin] RBAC: Authorizing `identity:create_grant(project_id=fedc7eace6da4d0e82c913b2b5c17e17, user_id=0c96988302174c659b97f0d55467bd97, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:06.013810 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fc072-c959-434b-b914-6145f972e552 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:06.087262 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 123/254] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 14:19:05 2022] PUT /identity/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17/users/0c96988302174c659b97f0d55467bd97/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:19:06.118297 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6806136-1d8a-4363-87a5-70f85fb400fe None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:06.119406 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6806136-1d8a-4363-87a5-70f85fb400fe None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:06.120188 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6806136-1d8a-4363-87a5-70f85fb400fe None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:06.122863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 124/255] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:06.126716 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25c0ec-4faf-489f-b16b-741271f46ebc None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:06.129872 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923131ec-1098-4306-b7a1-fcdab6aa10d0 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:06.130718 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923131ec-1098-4306-b7a1-fcdab6aa10d0 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:06.131287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923131ec-1098-4306-b7a1-fcdab6aa10d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:06.154587 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-923131ec-1098-4306-b7a1-fcdab6aa10d0 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:06.157330 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-923131ec-1098-4306-b7a1-fcdab6aa10d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:06.204136 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:06.214628 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbf85c-d6ab-4c30-aca2-57d387e52ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:06.215171 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbf85c-d6ab-4c30-aca2-57d387e52ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:06.215451 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbf85c-d6ab-4c30-aca2-57d387e52ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:06.215720 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbf85c-d6ab-4c30-aca2-57d387e52ff0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:06.216469 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbf85c-d6ab-4c30-aca2-57d387e52ff0 None admin] RBAC: Adding query filter params (role.id=97d4738e1d3946aead178d02f1a88861, scope.project.id=fedc7eace6da4d0e82c913b2b5c17e17, user.id=8f721cdc9fdf4092a1115a7291a1669e) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:06.216772 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbf85c-d6ab-4c30-aca2-57d387e52ff0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:06.219077 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbf85c-d6ab-4c30-aca2-57d387e52ff0 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:06.236824 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 132/256] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:19:05 2022] GET /identity/v3/role_assignments?user.id=8f721cdc9fdf4092a1115a7291a1669e&scope.project.id=fedc7eace6da4d0e82c913b2b5c17e17&role.id=97d4738e1d3946aead178d02f1a88861 => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:06.237689 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbf85c-d6ab-4c30-aca2-57d387e52ff0 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:06.251329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 125/257] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:06.354628 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:06.433587 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbf85c-d6ab-4c30-aca2-57d387e52ff0 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:06.478206 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f391caf-6df7-461c-8a44-cf008aad8acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:06.479256 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f391caf-6df7-461c-8a44-cf008aad8acb None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:06.479809 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f391caf-6df7-461c-8a44-cf008aad8acb None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:06.480547 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f391caf-6df7-461c-8a44-cf008aad8acb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:06.495542 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f391caf-6df7-461c-8a44-cf008aad8acb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:06.502104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-5f391caf-6df7-461c-8a44-cf008aad8acb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:19:06.502104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:06.502104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:06.502104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:06.502104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:06.502104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:06.502104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:06.502104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:06.502104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:06.502104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:06.502104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:06.502104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:06.502104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:06.502104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:06.502104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:06.502104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:06.503022 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:06.503022 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:06.503022 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:06.503022 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:06.503022 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:06.503022 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:06.503022 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:06.503022 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:06.503022 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:06.503022 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:06.503022 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:06.503022 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:06.503022 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:06.503022 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:06.503022 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:06.503022 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:06.503815 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:06.503815 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:06.503815 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:06.503815 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:06.503815 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:06.503815 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:06.503815 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:06.503815 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:06.503815 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:06.503815 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:06.503815 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:19:06.503815 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:06.506654 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 133/258] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:19:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:06.512697 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923131ec-1098-4306-b7a1-fcdab6aa10d0 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:06.622474 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923131ec-1098-4306-b7a1-fcdab6aa10d0 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:06.663056 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f391caf-6df7-461c-8a44-cf008aad8acb None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:06.665388 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e22d06-08f1-46a4-a98d-25f9bab6cebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:06.666524 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e22d06-08f1-46a4-a98d-25f9bab6cebf None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:06.666997 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e22d06-08f1-46a4-a98d-25f9bab6cebf None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:06.667485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e22d06-08f1-46a4-a98d-25f9bab6cebf None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:06.668364 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e22d06-08f1-46a4-a98d-25f9bab6cebf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:06.668857 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e22d06-08f1-46a4-a98d-25f9bab6cebf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:06.670452 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e22d06-08f1-46a4-a98d-25f9bab6cebf None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:06.682384 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 126/259] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:19:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:06.689287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e22d06-08f1-46a4-a98d-25f9bab6cebf None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:06.735329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:06.856400 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e22d06-08f1-46a4-a98d-25f9bab6cebf None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:06.881587 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f391caf-6df7-461c-8a44-cf008aad8acb None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:06.895412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:06.936480 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70a926-e171-4861-9998-e03e5c567567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:06.937178 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70a926-e171-4861-9998-e03e5c567567 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:06.937615 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70a926-e171-4861-9998-e03e5c567567 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:06.938095 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70a926-e171-4861-9998-e03e5c567567 None admin] PATH_INFO: `/v3/users/f7f3ced8f8bc458da764cf5ce0d33a3d` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:06.939927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70a926-e171-4861-9998-e03e5c567567 None admin] RBAC: Authorizing `identity:get_user(user_id=f7f3ced8f8bc458da764cf5ce0d33a3d)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:06.941372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70a926-e171-4861-9998-e03e5c567567 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:06.944810 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 127/260] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:19:06 2022] GET /identity/v3/users/f7f3ced8f8bc458da764cf5ce0d33a3d => generated 283 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:06.946775 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c56011-1b30-47ab-a5cd-4ed88fbd6662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:06.947423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c56011-1b30-47ab-a5cd-4ed88fbd6662 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:06.947702 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c56011-1b30-47ab-a5cd-4ed88fbd6662 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:06.947976 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c56011-1b30-47ab-a5cd-4ed88fbd6662 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:06.949316 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70a926-e171-4861-9998-e03e5c567567 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:06.975195 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c56011-1b30-47ab-a5cd-4ed88fbd6662 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:06.979929 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-a8c56011-1b30-47ab-a5cd-4ed88fbd6662 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:19:06.979929 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:06.979929 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:06.979929 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:06.979929 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:06.979929 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:06.979929 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:06.979929 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:06.979929 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:06.979929 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:06.979929 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:06.979929 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:06.979929 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:06.979929 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:06.979929 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:06.979929 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:06.980861 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:06.980861 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:06.980861 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:06.980861 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:06.980861 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:06.980861 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:06.980861 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:06.980861 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:06.980861 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:06.980861 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:06.980861 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:06.980861 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:06.980861 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:06.980861 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:06.980861 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:06.980861 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:06.981655 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:06.981655 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:06.981655 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:06.981655 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:06.981655 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:06.981655 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:06.981655 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:06.981655 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:06.981655 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:06.981655 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:06.981655 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:19:06.981655 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:06.981655 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 134/261] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 14:19:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:19:07.004803 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c56011-1b30-47ab-a5cd-4ed88fbd6662 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:07.124561 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c56011-1b30-47ab-a5cd-4ed88fbd6662 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:07.164569 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcedb97-782c-4931-a5ac-1adf3cc7eb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:07.165186 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcedb97-782c-4931-a5ac-1adf3cc7eb2f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:07.165470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcedb97-782c-4931-a5ac-1adf3cc7eb2f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:07.165930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcedb97-782c-4931-a5ac-1adf3cc7eb2f None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:07.166922 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcedb97-782c-4931-a5ac-1adf3cc7eb2f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:07.167237 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcedb97-782c-4931-a5ac-1adf3cc7eb2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:07.168791 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcedb97-782c-4931-a5ac-1adf3cc7eb2f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:07.177768 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 135/262] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:19:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:07.179037 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:07.183704 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcedb97-782c-4931-a5ac-1adf3cc7eb2f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:07.187002 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70a926-e171-4861-9998-e03e5c567567 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:07.222585 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:07.284428 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a27a4-0035-4c16-802c-9e9b5ff7d2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:07.285042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a27a4-0035-4c16-802c-9e9b5ff7d2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:07.285316 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a27a4-0035-4c16-802c-9e9b5ff7d2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:07.285584 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a27a4-0035-4c16-802c-9e9b5ff7d2d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:07.302834 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcedb97-782c-4931-a5ac-1adf3cc7eb2f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:07.342405 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbe21e-3de8-4716-b712-0f0d3748a871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:07.343046 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbe21e-3de8-4716-b712-0f0d3748a871 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:07.344069 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbe21e-3de8-4716-b712-0f0d3748a871 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:07.344530 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbe21e-3de8-4716-b712-0f0d3748a871 None admin] PATH_INFO: `/v3/users/f7f3ced8f8bc458da764cf5ce0d33a3d` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:07.346113 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbe21e-3de8-4716-b712-0f0d3748a871 None admin] RBAC: Authorizing `identity:get_user(user_id=f7f3ced8f8bc458da764cf5ce0d33a3d)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:07.347718 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbe21e-3de8-4716-b712-0f0d3748a871 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:07.349661 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 136/263] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:19:07 2022] GET /identity/v3/users/f7f3ced8f8bc458da764cf5ce0d33a3d => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:07.355357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbe21e-3de8-4716-b712-0f0d3748a871 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:07.430272 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a27a4-0035-4c16-802c-9e9b5ff7d2d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:07.431742 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a27a4-0035-4c16-802c-9e9b5ff7d2d7 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:07.468661 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:07.472660 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbe21e-3de8-4716-b712-0f0d3748a871 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:07.511090 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fcacb-e3ac-4e3f-a2fe-0ebe16500251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:07.511939 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fcacb-e3ac-4e3f-a2fe-0ebe16500251 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:07.512358 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fcacb-e3ac-4e3f-a2fe-0ebe16500251 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:07.512768 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fcacb-e3ac-4e3f-a2fe-0ebe16500251 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:07.594333 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96fcacb-e3ac-4e3f-a2fe-0ebe16500251 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:07.596908 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96fcacb-e3ac-4e3f-a2fe-0ebe16500251 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:07.676862 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 128/264] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:19:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 728 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:19:07.677181 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:07.682469 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a27a4-0035-4c16-802c-9e9b5ff7d2d7 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:07.710017 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:07.714551 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 137/265] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:19:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 14:19:07.721860 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fcacb-e3ac-4e3f-a2fe-0ebe16500251 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:07.834497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fcacb-e3ac-4e3f-a2fe-0ebe16500251 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:07.872286 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f49362-500b-45a0-87da-fb84da1ac328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:07.873145 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f49362-500b-45a0-87da-fb84da1ac328 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:07.873584 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f49362-500b-45a0-87da-fb84da1ac328 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:07.874017 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f49362-500b-45a0-87da-fb84da1ac328 None admin] PATH_INFO: `/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:07.875568 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f49362-500b-45a0-87da-fb84da1ac328 None admin] RBAC: Authorizing `identity:get_project(project_id=fedc7eace6da4d0e82c913b2b5c17e17)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:07.877504 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f49362-500b-45a0-87da-fb84da1ac328 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:07.879675 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 138/266] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:19:07 2022] GET /identity/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:07.886181 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f49362-500b-45a0-87da-fb84da1ac328 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:07.957015 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a27a4-0035-4c16-802c-9e9b5ff7d2d7 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:07.963934 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:08.019990 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfd3eb-b64a-4d18-b891-4f616a59a950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:08.020637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfd3eb-b64a-4d18-b891-4f616a59a950 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:08.020916 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfd3eb-b64a-4d18-b891-4f616a59a950 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:08.021190 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfd3eb-b64a-4d18-b891-4f616a59a950 None admin] PATH_INFO: `/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:08.022371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abfd3eb-b64a-4d18-b891-4f616a59a950 None admin] RBAC: Authorizing `identity:get_project(project_id=fedc7eace6da4d0e82c913b2b5c17e17)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:08.023932 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abfd3eb-b64a-4d18-b891-4f616a59a950 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:08.026075 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 129/267] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:19:07 2022] GET /identity/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17 => generated 302 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:08.035184 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f49362-500b-45a0-87da-fb84da1ac328 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:08.043074 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfd3eb-b64a-4d18-b891-4f616a59a950 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:08.128910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6369531-98f8-469b-bd26-0e7d4d2f42aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:08.129444 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6369531-98f8-469b-bd26-0e7d4d2f42aa None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:08.129727 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6369531-98f8-469b-bd26-0e7d4d2f42aa None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:08.130022 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6369531-98f8-469b-bd26-0e7d4d2f42aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:08.131014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6369531-98f8-469b-bd26-0e7d4d2f42aa None admin] RBAC: Adding query filter params (role.id=eb8377ab1ad14341a780bc4acdfa2275, scope.project.id=fedc7eace6da4d0e82c913b2b5c17e17, user.id=f7f3ced8f8bc458da764cf5ce0d33a3d) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:08.131320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6369531-98f8-469b-bd26-0e7d4d2f42aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:08.132753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6369531-98f8-469b-bd26-0e7d4d2f42aa None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:08.148303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 139/268] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:19:07 2022] GET /identity/v3/role_assignments?user.id=f7f3ced8f8bc458da764cf5ce0d33a3d&scope.project.id=fedc7eace6da4d0e82c913b2b5c17e17&role.id=eb8377ab1ad14341a780bc4acdfa2275 => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:08.152748 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:08.164908 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e3f69-48f7-4317-9f66-96f213be8097 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:08.165189 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e3f69-48f7-4317-9f66-96f213be8097 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:08.165468 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e3f69-48f7-4317-9f66-96f213be8097 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:08.167300 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 140/269] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:19:08.175106 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522b06f-164a-4250-b344-f151044772f3 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:08.175385 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522b06f-164a-4250-b344-f151044772f3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:08.175662 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522b06f-164a-4250-b344-f151044772f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:08.210948 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c522b06f-164a-4250-b344-f151044772f3 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:08.212206 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c522b06f-164a-4250-b344-f151044772f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:08.226276 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfd3eb-b64a-4d18-b891-4f616a59a950 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:08.300532 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b626cf-39b2-4bf5-95b8-04adbb609a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:08.301143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b626cf-39b2-4bf5-95b8-04adbb609a88 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:08.301419 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b626cf-39b2-4bf5-95b8-04adbb609a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:08.301687 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b626cf-39b2-4bf5-95b8-04adbb609a88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:08.302462 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b626cf-39b2-4bf5-95b8-04adbb609a88 None admin] RBAC: Adding query filter params (role.id=b779073cee3c470ca4ad7a7b27d72c5e, scope.project.id=fedc7eace6da4d0e82c913b2b5c17e17, user.id=f7f3ced8f8bc458da764cf5ce0d33a3d) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:08.302765 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b626cf-39b2-4bf5-95b8-04adbb609a88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:08.304481 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b626cf-39b2-4bf5-95b8-04adbb609a88 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:08.311064 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 130/270] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:19:08 2022] GET /identity/v3/role_assignments?user.id=f7f3ced8f8bc458da764cf5ce0d33a3d&scope.project.id=fedc7eace6da4d0e82c913b2b5c17e17&role.id=b779073cee3c470ca4ad7a7b27d72c5e => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:08.361095 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 141/271] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:19:08.528406 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32978c6-9477-4c49-9d18-8b0164f57aa0 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:08.528742 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32978c6-9477-4c49-9d18-8b0164f57aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:08.528934 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32978c6-9477-4c49-9d18-8b0164f57aa0 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:08.530259 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 131/272] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:08.537260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d6a77-689a-4b39-ab5b-32a551135a14 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:08.537260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d6a77-689a-4b39-ab5b-32a551135a14 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:08.537260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d6a77-689a-4b39-ab5b-32a551135a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:08.559614 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b74d6a77-689a-4b39-ab5b-32a551135a14 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:08.560813 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b74d6a77-689a-4b39-ab5b-32a551135a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:08.631323 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:08.645116 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 142/273] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:08.710101 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32978c6-9477-4c49-9d18-8b0164f57aa0 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:08.825878 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32978c6-9477-4c49-9d18-8b0164f57aa0 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:08.856651 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:08.864255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acedea-f73f-4fab-8440-a32774e579e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:08.864887 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acedea-f73f-4fab-8440-a32774e579e7 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:08.867939 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acedea-f73f-4fab-8440-a32774e579e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:08.867939 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acedea-f73f-4fab-8440-a32774e579e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:08.867939 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acedea-f73f-4fab-8440-a32774e579e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:08.868147 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acedea-f73f-4fab-8440-a32774e579e7 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:08.873974 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 132/274] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:08.876369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d6a77-689a-4b39-ab5b-32a551135a14 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:08.937525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acedea-f73f-4fab-8440-a32774e579e7 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:09.002585 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d6a77-689a-4b39-ab5b-32a551135a14 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:09.045502 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c1c8d-9f69-4a7e-a14d-0a001ebb994f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:09.046456 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c1c8d-9f69-4a7e-a14d-0a001ebb994f None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:09.047099 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c1c8d-9f69-4a7e-a14d-0a001ebb994f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:09.047597 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c1c8d-9f69-4a7e-a14d-0a001ebb994f None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:09.048440 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c1c8d-9f69-4a7e-a14d-0a001ebb994f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:09.050122 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c1c8d-9f69-4a7e-a14d-0a001ebb994f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:09.067191 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acedea-f73f-4fab-8440-a32774e579e7 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:09.104141 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab3a5c-f895-44d2-a94a-99271a76b39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:09.104748 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab3a5c-f895-44d2-a94a-99271a76b39a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:09.105036 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab3a5c-f895-44d2-a94a-99271a76b39a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:09.105310 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab3a5c-f895-44d2-a94a-99271a76b39a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:09.115954 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab3a5c-f895-44d2-a94a-99271a76b39a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:09.121377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-adab3a5c-f895-44d2-a94a-99271a76b39a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:19:09.121377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:09.121377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:09.121377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:09.121377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:09.121377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:09.121377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:09.121377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:09.121377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:09.121377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:09.121377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:09.121377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:09.121377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:09.121377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:09.121377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:09.121377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:09.125979 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:09.125979 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:09.125979 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:09.125979 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:09.125979 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:09.125979 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:09.125979 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:09.125979 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:09.125979 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:09.125979 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:09.125979 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:09.125979 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:09.125979 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:09.125979 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:09.125979 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:09.125979 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:09.126799 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:09.126799 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:09.126799 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:09.126799 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:09.126799 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:09.126799 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:09.126799 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:09.126799 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:09.126799 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:09.126799 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:09.126799 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:19:09.126799 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:09.126799 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 133/275] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:19:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:09.126799 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b07c46-230f-4e7b-b7ac-61756cc0d8cd None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:09.127621 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b07c46-230f-4e7b-b7ac-61756cc0d8cd None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:09.127621 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b07c46-230f-4e7b-b7ac-61756cc0d8cd None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:09.127621 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 134/276] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:09.128975 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b07c46-230f-4e7b-b7ac-61756cc0d8cd None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:09.149626 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 143/277] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 14:19:08 2022] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:19:09.150671 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2ff9c-dace-495a-8ede-b20a413ff058 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:09.153804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2ff9c-dace-495a-8ede-b20a413ff058 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:09.153804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2ff9c-dace-495a-8ede-b20a413ff058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:09.176274 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-5ff2ff9c-dace-495a-8ede-b20a413ff058 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:09.177862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5ff2ff9c-dace-495a-8ede-b20a413ff058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:09.211202 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:09.233340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:09.270080 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 144/278] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:09.271787 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9b450-721b-44f9-8610-2952ddb0c6d4 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:09.272275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9b450-721b-44f9-8610-2952ddb0c6d4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:09.272748 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9b450-721b-44f9-8610-2952ddb0c6d4 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:09.274361 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 145/279] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:09.280095 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01675df-8617-4c20-9357-259fcd8dab42 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:09.281793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01675df-8617-4c20-9357-259fcd8dab42 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:09.282140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01675df-8617-4c20-9357-259fcd8dab42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:09.291324 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b07c46-230f-4e7b-b7ac-61756cc0d8cd None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:09.307504 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a01675df-8617-4c20-9357-259fcd8dab42 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:09.310563 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a01675df-8617-4c20-9357-259fcd8dab42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:09.335364 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d62788-f91b-4997-8c02-a9c52ea51f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:09.335963 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d62788-f91b-4997-8c02-a9c52ea51f5d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:09.336240 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d62788-f91b-4997-8c02-a9c52ea51f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:09.336505 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d62788-f91b-4997-8c02-a9c52ea51f5d None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:09.337167 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d62788-f91b-4997-8c02-a9c52ea51f5d None admin] RBAC: Adding query filter params (name=member) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:09.337467 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d62788-f91b-4997-8c02-a9c52ea51f5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:09.338882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d62788-f91b-4997-8c02-a9c52ea51f5d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:09.348152 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 135/280] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 14:19:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:09.354838 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d62788-f91b-4997-8c02-a9c52ea51f5d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:09.393184 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 146/281] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:19:09.461048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d62788-f91b-4997-8c02-a9c52ea51f5d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:09.485518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:09.497140 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44e278-4f09-437e-ae58-44e65b54ecff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:09.497786 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44e278-4f09-437e-ae58-44e65b54ecff None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:09.498148 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44e278-4f09-437e-ae58-44e65b54ecff None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:09.498451 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44e278-4f09-437e-ae58-44e65b54ecff None admin] PATH_INFO: `/v3/users/3d92625b0f0546f2973d91e8c2119226` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:09.514219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44e278-4f09-437e-ae58-44e65b54ecff None admin] RBAC: Authorizing `identity:get_user(user_id=3d92625b0f0546f2973d91e8c2119226)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:09.515854 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44e278-4f09-437e-ae58-44e65b54ecff None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:09.517853 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 136/282] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:19:09 2022] GET /identity/v3/users/3d92625b0f0546f2973d91e8c2119226 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:09.524037 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01675df-8617-4c20-9357-259fcd8dab42 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:09.559738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44e278-4f09-437e-ae58-44e65b54ecff None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:09.641623 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01675df-8617-4c20-9357-259fcd8dab42 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:09.652462 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:09.691185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44e278-4f09-437e-ae58-44e65b54ecff None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:09.693205 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8de1c-0224-4bc6-a86b-1bbf2e378bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:09.693861 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8de1c-0224-4bc6-a86b-1bbf2e378bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:09.694135 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8de1c-0224-4bc6-a86b-1bbf2e378bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:09.694400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8de1c-0224-4bc6-a86b-1bbf2e378bd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:09.695127 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8de1c-0224-4bc6-a86b-1bbf2e378bd0 None admin] RBAC: Adding query filter params (role.id=a5c4bcef93884b89bf10b2f011d880c8, user.id=3d92625b0f0546f2973d91e8c2119226, scope.system=all) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:09.695439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8de1c-0224-4bc6-a86b-1bbf2e378bd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:09.696875 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8de1c-0224-4bc6-a86b-1bbf2e378bd0 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:09.708039 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 147/283] 10.222.0.65 () {56 vars in 1308 bytes} [Wed Aug 24 14:19:09 2022] GET /identity/v3/role_assignments?user.id=3d92625b0f0546f2973d91e8c2119226&scope.system=all&role.id=a5c4bcef93884b89bf10b2f011d880c8 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:09.711083 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8de1c-0224-4bc6-a86b-1bbf2e378bd0 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:09.771192 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff11302-7934-4d2d-9a71-cbbb42c0f8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:09.771845 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff11302-7934-4d2d-9a71-cbbb42c0f8f4 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:09.772121 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff11302-7934-4d2d-9a71-cbbb42c0f8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:09.772390 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff11302-7934-4d2d-9a71-cbbb42c0f8f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:09.799326 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff11302-7934-4d2d-9a71-cbbb42c0f8f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:09.804263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-3ff11302-7934-4d2d-9a71-cbbb42c0f8f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:19:09.804263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:09.804263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:09.804263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:09.804263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:09.804263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:09.804263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:09.804263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:09.804263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:09.804263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:09.804263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:09.804263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:09.804263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:09.804263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:09.804263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:09.804263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:09.805185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:09.805185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:09.805185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:09.805185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:09.805185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:09.805185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:09.805185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:09.805185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:09.805185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:09.805185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:09.805185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:09.805185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:09.805185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:09.805185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:09.805185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:09.805185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:09.806013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:09.806013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:09.806013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:09.806013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:09.806013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:09.806013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:09.806013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:09.806013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:09.806013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:09.806013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:09.806013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:19:09.806013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:09.806013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 137/284] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:19:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:19:09.813082 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff11302-7934-4d2d-9a71-cbbb42c0f8f4 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:09.886815 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8de1c-0224-4bc6-a86b-1bbf2e378bd0 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:09.897322 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:09.939630 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862cfcdc-1a74-4b45-8300-19b738015480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:09.940521 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cfcdc-1a74-4b45-8300-19b738015480 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:09.940943 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cfcdc-1a74-4b45-8300-19b738015480 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:09.941355 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cfcdc-1a74-4b45-8300-19b738015480 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:09.953175 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862cfcdc-1a74-4b45-8300-19b738015480 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:09.958981 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-862cfcdc-1a74-4b45-8300-19b738015480 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:19:09.958981 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:09.958981 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:09.958981 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:09.958981 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:09.958981 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:09.958981 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:09.958981 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:09.958981 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:09.958981 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:09.958981 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:09.958981 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:09.958981 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:09.958981 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:09.958981 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:09.958981 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:09.960068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:09.960068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:09.960068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:09.960068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:09.960068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:09.960068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:09.960068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:09.960068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:09.960068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:09.960068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:09.960068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:09.960068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:09.960068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:09.960068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:09.960068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:09.960068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:09.961059 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:09.961059 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:09.961059 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:09.961059 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:09.961059 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:09.961059 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:09.961059 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:09.961059 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:09.961059 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:09.961059 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:09.961059 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:19:09.961059 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:09.965904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 148/285] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:19:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:09.969956 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862cfcdc-1a74-4b45-8300-19b738015480 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:10.008171 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:10.025235 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff11302-7934-4d2d-9a71-cbbb42c0f8f4 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:10.091310 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862cfcdc-1a74-4b45-8300-19b738015480 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:10.101352 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03680d9-54a8-4970-b792-4a67134cafa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:10.101994 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03680d9-54a8-4970-b792-4a67134cafa3 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:10.102273 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03680d9-54a8-4970-b792-4a67134cafa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:10.102543 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03680d9-54a8-4970-b792-4a67134cafa3 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:10.103218 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03680d9-54a8-4970-b792-4a67134cafa3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:10.103518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03680d9-54a8-4970-b792-4a67134cafa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:10.104906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03680d9-54a8-4970-b792-4a67134cafa3 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:10.126525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 138/286] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 14:19:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:10.132116 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03680d9-54a8-4970-b792-4a67134cafa3 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:10.133145 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f6ef0-9ec4-40d1-9f60-fd368200468b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:10.133996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f6ef0-9ec4-40d1-9f60-fd368200468b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:10.134504 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f6ef0-9ec4-40d1-9f60-fd368200468b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:10.134966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f6ef0-9ec4-40d1-9f60-fd368200468b None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:10.136011 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f6ef0-9ec4-40d1-9f60-fd368200468b None admin] RBAC: Adding query filter params (name=member) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:10.136519 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f6ef0-9ec4-40d1-9f60-fd368200468b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:10.138136 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f6ef0-9ec4-40d1-9f60-fd368200468b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:10.149568 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 149/287] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 14:19:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:10.162767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f6ef0-9ec4-40d1-9f60-fd368200468b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:10.307403 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:10.314167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f6ef0-9ec4-40d1-9f60-fd368200468b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:10.316083 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03680d9-54a8-4970-b792-4a67134cafa3 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:10.346759 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:10.350389 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e49ed8-4881-4202-bade-8c3980166e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:10.351194 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e49ed8-4881-4202-bade-8c3980166e66 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:10.351644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e49ed8-4881-4202-bade-8c3980166e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:10.352063 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e49ed8-4881-4202-bade-8c3980166e66 None admin] PATH_INFO: `/v3/users/0c96988302174c659b97f0d55467bd97` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:10.353354 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e49ed8-4881-4202-bade-8c3980166e66 None admin] RBAC: Authorizing `identity:get_user(user_id=0c96988302174c659b97f0d55467bd97)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:10.354999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e49ed8-4881-4202-bade-8c3980166e66 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:10.356745 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 150/288] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:19:10 2022] GET /identity/v3/users/0c96988302174c659b97f0d55467bd97 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:10.363065 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e49ed8-4881-4202-bade-8c3980166e66 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:10.380726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a5083-ac13-43c4-b57f-dd8a3cb4da9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:10.384214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a5083-ac13-43c4-b57f-dd8a3cb4da9e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:10.384214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a5083-ac13-43c4-b57f-dd8a3cb4da9e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:10.384214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a5083-ac13-43c4-b57f-dd8a3cb4da9e None admin] PATH_INFO: `/v3/users/8f721cdc9fdf4092a1115a7291a1669e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:10.384686 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a5083-ac13-43c4-b57f-dd8a3cb4da9e None admin] RBAC: Authorizing `identity:get_user(user_id=8f721cdc9fdf4092a1115a7291a1669e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:10.386227 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a5083-ac13-43c4-b57f-dd8a3cb4da9e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:10.388136 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 139/289] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:19:10 2022] GET /identity/v3/users/8f721cdc9fdf4092a1115a7291a1669e => generated 297 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:10.394811 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a5083-ac13-43c4-b57f-dd8a3cb4da9e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:10.473714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e49ed8-4881-4202-bade-8c3980166e66 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:10.511261 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97fad7-ea6f-472c-891f-44cd1e287ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:10.512219 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97fad7-ea6f-472c-891f-44cd1e287ddd None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:10.512787 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97fad7-ea6f-472c-891f-44cd1e287ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:10.513280 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97fad7-ea6f-472c-891f-44cd1e287ddd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:10.536863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a5083-ac13-43c4-b57f-dd8a3cb4da9e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:10.547833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:10.587996 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799cea0-e494-4545-947d-6ca0d6204da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:10.588658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799cea0-e494-4545-947d-6ca0d6204da4 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:10.589019 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799cea0-e494-4545-947d-6ca0d6204da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:10.589302 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799cea0-e494-4545-947d-6ca0d6204da4 None admin] PATH_INFO: `/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:10.589508 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97fad7-ea6f-472c-891f-44cd1e287ddd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:10.591816 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97fad7-ea6f-472c-891f-44cd1e287ddd None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:10.594522 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799cea0-e494-4545-947d-6ca0d6204da4 None admin] RBAC: Authorizing `identity:get_project(project_id=fedc7eace6da4d0e82c913b2b5c17e17)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:10.596314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799cea0-e494-4545-947d-6ca0d6204da4 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:10.598094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 140/290] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:19:10 2022] GET /identity/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:10.603732 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799cea0-e494-4545-947d-6ca0d6204da4 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:10.675666 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:10.704313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 151/291] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:19:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 14:19:10.711222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97fad7-ea6f-472c-891f-44cd1e287ddd None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:10.778219 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:10.779617 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799cea0-e494-4545-947d-6ca0d6204da4 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:10.820228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97fad7-ea6f-472c-891f-44cd1e287ddd None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:10.858389 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939ff22-834b-4abb-81c8-ba272c15dbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:10.859420 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939ff22-834b-4abb-81c8-ba272c15dbfc None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:10.859906 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939ff22-834b-4abb-81c8-ba272c15dbfc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:10.860409 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939ff22-834b-4abb-81c8-ba272c15dbfc None admin] PATH_INFO: `/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:10.861829 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0939ff22-834b-4abb-81c8-ba272c15dbfc None admin] RBAC: Authorizing `identity:get_project(project_id=fedc7eace6da4d0e82c913b2b5c17e17)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:10.863642 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0939ff22-834b-4abb-81c8-ba272c15dbfc None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:10.865805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 152/292] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:19:10 2022] GET /identity/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:10.865984 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0fb81-76f1-48c7-b1d7-37a4e92a0fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:10.869841 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0fb81-76f1-48c7-b1d7-37a4e92a0fae None admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:10.869841 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0fb81-76f1-48c7-b1d7-37a4e92a0fae None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:10.869841 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0fb81-76f1-48c7-b1d7-37a4e92a0fae None admin] PATH_INFO: `/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17/users/8f721cdc9fdf4092a1115a7291a1669e/roles/97d4738e1d3946aead178d02f1a88861` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:10.869841 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0fb81-76f1-48c7-b1d7-37a4e92a0fae None admin] RBAC: Authorizing `identity:create_grant(project_id=fedc7eace6da4d0e82c913b2b5c17e17, user_id=8f721cdc9fdf4092a1115a7291a1669e, role_id=97d4738e1d3946aead178d02f1a88861)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:10.870598 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0fb81-76f1-48c7-b1d7-37a4e92a0fae None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:10.872771 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939ff22-834b-4abb-81c8-ba272c15dbfc None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:10.955114 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 141/293] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 14:19:10 2022] PUT /identity/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17/users/8f721cdc9fdf4092a1115a7291a1669e/roles/97d4738e1d3946aead178d02f1a88861 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:19:10.982393 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939ff22-834b-4abb-81c8-ba272c15dbfc None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:11.014623 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:11.021317 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48eb61a-8ad8-4c60-8483-41c99de59db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:11.022045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48eb61a-8ad8-4c60-8483-41c99de59db2 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:11.022327 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48eb61a-8ad8-4c60-8483-41c99de59db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:11.022662 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48eb61a-8ad8-4c60-8483-41c99de59db2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:11.023429 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48eb61a-8ad8-4c60-8483-41c99de59db2 None admin] RBAC: Adding query filter params (role.id=a5c4bcef93884b89bf10b2f011d880c8, scope.project.id=fedc7eace6da4d0e82c913b2b5c17e17, user.id=0c96988302174c659b97f0d55467bd97) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:11.023718 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48eb61a-8ad8-4c60-8483-41c99de59db2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:11.025159 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48eb61a-8ad8-4c60-8483-41c99de59db2 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:11.032327 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 153/294] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:19:10 2022] GET /identity/v3/role_assignments?user.id=0c96988302174c659b97f0d55467bd97&scope.project.id=fedc7eace6da4d0e82c913b2b5c17e17&role.id=a5c4bcef93884b89bf10b2f011d880c8 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:11.589080 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b2092-5ccc-4da6-9ab4-dc14d14360c9 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:11.590116 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b2092-5ccc-4da6-9ab4-dc14d14360c9 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:11.590604 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b2092-5ccc-4da6-9ab4-dc14d14360c9 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:11.592199 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 142/295] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:11.598751 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a72e2-d310-4285-8782-7e96050fca36 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:11.599038 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a72e2-d310-4285-8782-7e96050fca36 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:11.599310 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a72e2-d310-4285-8782-7e96050fca36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:11.618631 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-156a72e2-d310-4285-8782-7e96050fca36 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:11.619824 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-156a72e2-d310-4285-8782-7e96050fca36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:11.691097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 154/296] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:19:11.887934 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcd236-be7f-4809-8622-40752baf95b0 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:11.888542 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcd236-be7f-4809-8622-40752baf95b0 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:11.889016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcd236-be7f-4809-8622-40752baf95b0 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:11.891228 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 143/297] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:11.896840 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac9047-50df-4d6b-8f6c-72beb32bc5d7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:11.897346 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac9047-50df-4d6b-8f6c-72beb32bc5d7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:11.897860 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac9047-50df-4d6b-8f6c-72beb32bc5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:11.917241 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-68ac9047-50df-4d6b-8f6c-72beb32bc5d7 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:11.918469 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-68ac9047-50df-4d6b-8f6c-72beb32bc5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:11.967379 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcd236-be7f-4809-8622-40752baf95b0 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:11.993178 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 155/298] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:12.003620 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0003879-2636-4951-a1d6-53f18904189d None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:12.003900 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0003879-2636-4951-a1d6-53f18904189d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:12.004172 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0003879-2636-4951-a1d6-53f18904189d None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:12.005975 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 156/299] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:19:12.010817 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52be63-5ec1-4833-b906-156b5c37cbc5 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:12.011098 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52be63-5ec1-4833-b906-156b5c37cbc5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:12.011368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52be63-5ec1-4833-b906-156b5c37cbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:12.031074 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-0c52be63-5ec1-4833-b906-156b5c37cbc5 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:12.032669 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0c52be63-5ec1-4833-b906-156b5c37cbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:12.080404 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:12.085462 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcd236-be7f-4809-8622-40752baf95b0 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:12.087231 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:12.112708 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 157/300] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:19:12.123678 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009ba64-5c94-4714-b9d7-630f9222e277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:12.125497 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009ba64-5c94-4714-b9d7-630f9222e277 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:12.126009 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009ba64-5c94-4714-b9d7-630f9222e277 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:12.126529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009ba64-5c94-4714-b9d7-630f9222e277 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:12.128037 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009ba64-5c94-4714-b9d7-630f9222e277 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:12.132565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009ba64-5c94-4714-b9d7-630f9222e277 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:12.132565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 144/301] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:12.137210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52be63-5ec1-4833-b906-156b5c37cbc5 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:12.250200 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52be63-5ec1-4833-b906-156b5c37cbc5 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:12.272688 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009ba64-5c94-4714-b9d7-630f9222e277 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:12.292989 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746987e1-d867-415d-932c-2b7537c2a50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:12.293607 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746987e1-d867-415d-932c-2b7537c2a50e None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:12.294068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746987e1-d867-415d-932c-2b7537c2a50e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:12.294340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746987e1-d867-415d-932c-2b7537c2a50e None admin] PATH_INFO: `/v3/groups` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:12.295288 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746987e1-d867-415d-932c-2b7537c2a50e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:12.297539 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746987e1-d867-415d-932c-2b7537c2a50e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:12.379935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 158/302] 10.222.0.65 () {60 vars in 1134 bytes} [Wed Aug 24 14:19:12 2022] POST /identity/v3/groups => generated 229 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:19:12.384700 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009ba64-5c94-4714-b9d7-630f9222e277 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:12.419366 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746987e1-d867-415d-932c-2b7537c2a50e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:12.426629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5b9fd-06b5-4903-a5b3-f2103c683b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:12.427271 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5b9fd-06b5-4903-a5b3-f2103c683b57 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:12.427646 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5b9fd-06b5-4903-a5b3-f2103c683b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:12.427921 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5b9fd-06b5-4903-a5b3-f2103c683b57 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:12.441121 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5b9fd-06b5-4903-a5b3-f2103c683b57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:12.446209 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-6ce5b9fd-06b5-4903-a5b3-f2103c683b57 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:19:12.446209 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:12.446209 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:12.446209 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:12.446209 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:12.446209 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:12.446209 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:12.446209 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:12.446209 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:12.446209 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:12.446209 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:12.446209 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:12.446209 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:12.446209 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:12.446209 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:12.446209 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:12.447171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:12.447171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:12.447171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:12.447171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:12.447171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:12.447171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:12.447171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:12.447171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:12.447171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:12.447171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:12.447171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:12.447171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:12.447171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:12.447171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:12.447171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:12.447171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:12.447982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:12.447982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:12.447982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:12.447982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:12.447982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:12.447982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:12.447982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:12.447982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:12.447982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:12.447982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:12.447982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:19:12.447982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:12.452675 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 145/303] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:19:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:19:12.454061 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5b9fd-06b5-4903-a5b3-f2103c683b57 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:12.487788 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:12.491046 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:12.566910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746987e1-d867-415d-932c-2b7537c2a50e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:12.576365 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5b9fd-06b5-4903-a5b3-f2103c683b57 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:12.619503 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598f53d-0196-480f-8c4d-24671c6f51c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:12.620601 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598f53d-0196-480f-8c4d-24671c6f51c5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:12.621048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2884d-54cf-4fb5-85c9-06bbcbc397af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:12.621653 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2884d-54cf-4fb5-85c9-06bbcbc397af None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:12.621923 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598f53d-0196-480f-8c4d-24671c6f51c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:12.622023 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2884d-54cf-4fb5-85c9-06bbcbc397af None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:12.622227 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2884d-54cf-4fb5-85c9-06bbcbc397af None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:12.622665 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598f53d-0196-480f-8c4d-24671c6f51c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:12.622893 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2884d-54cf-4fb5-85c9-06bbcbc397af None admin] RBAC: Adding query filter params (name=reader) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:12.623190 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2884d-54cf-4fb5-85c9-06bbcbc397af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:12.625422 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2884d-54cf-4fb5-85c9-06bbcbc397af None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:12.635104 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 146/304] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 14:19:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:12.637436 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598f53d-0196-480f-8c4d-24671c6f51c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:12.644148 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-c598f53d-0196-480f-8c4d-24671c6f51c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:19:12.644148 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:12.644148 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:12.644148 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:12.644148 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:12.644148 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:12.644148 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:12.644148 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:12.644148 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:12.644148 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:12.644148 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:12.644148 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:12.644148 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:12.644148 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:12.644148 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:12.644148 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:12.645077 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:12.645077 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:12.645077 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:12.645077 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:12.645077 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:12.645077 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:12.645077 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:12.645077 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:12.645077 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:12.645077 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:12.645077 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:12.645077 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:12.645077 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:12.645077 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:12.645077 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:12.645077 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:12.646004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:12.646004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:12.646004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:12.646004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:12.646004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:12.646004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:12.646004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:12.646004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:12.646004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:12.646004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:12.646004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:19:12.646004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:12.646581 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2884d-54cf-4fb5-85c9-06bbcbc397af None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:12.646658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 159/305] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:19:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:19:12.649476 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598f53d-0196-480f-8c4d-24671c6f51c5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:12.741063 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:12.754708 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2884d-54cf-4fb5-85c9-06bbcbc397af None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:12.758784 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598f53d-0196-480f-8c4d-24671c6f51c5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:12.761236 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:12.792985 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad68f0-045d-4719-b27e-12d6dbbc7e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:12.794005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad68f0-045d-4719-b27e-12d6dbbc7e73 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:12.794383 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad68f0-045d-4719-b27e-12d6dbbc7e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:12.794914 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad68f0-045d-4719-b27e-12d6dbbc7e73 None admin] PATH_INFO: `/v3/users/e5d25271ebe6417d9f9a2e40b08dc3f4` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:12.795391 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e327420-ef72-4efe-a322-1ab4b5627d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:12.796080 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e327420-ef72-4efe-a322-1ab4b5627d6d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:12.797070 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e327420-ef72-4efe-a322-1ab4b5627d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:12.797388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e327420-ef72-4efe-a322-1ab4b5627d6d None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:12.798200 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e327420-ef72-4efe-a322-1ab4b5627d6d None admin] RBAC: Adding query filter params (name=member) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:12.798507 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e327420-ef72-4efe-a322-1ab4b5627d6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:12.800041 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e327420-ef72-4efe-a322-1ab4b5627d6d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:12.810200 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 160/306] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 14:19:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:12.815602 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e327420-ef72-4efe-a322-1ab4b5627d6d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:12.818589 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad68f0-045d-4719-b27e-12d6dbbc7e73 None admin] RBAC: Authorizing `identity:get_user(user_id=e5d25271ebe6417d9f9a2e40b08dc3f4)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:12.820271 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad68f0-045d-4719-b27e-12d6dbbc7e73 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:12.822980 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 147/307] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:19:12 2022] GET /identity/v3/users/e5d25271ebe6417d9f9a2e40b08dc3f4 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:12.829724 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad68f0-045d-4719-b27e-12d6dbbc7e73 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:12.944710 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e327420-ef72-4efe-a322-1ab4b5627d6d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:12.960433 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad68f0-045d-4719-b27e-12d6dbbc7e73 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:12.980769 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5833345-79b9-466f-8699-60f4b118e844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:12.981773 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5833345-79b9-466f-8699-60f4b118e844 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:12.982250 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5833345-79b9-466f-8699-60f4b118e844 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:12.982741 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5833345-79b9-466f-8699-60f4b118e844 None admin] PATH_INFO: `/v3/users/3d92625b0f0546f2973d91e8c2119226` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:12.984248 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5833345-79b9-466f-8699-60f4b118e844 None admin] RBAC: Authorizing `identity:get_user(user_id=3d92625b0f0546f2973d91e8c2119226)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:12.985982 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5833345-79b9-466f-8699-60f4b118e844 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:12.987802 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 161/308] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:19:12 2022] GET /identity/v3/users/3d92625b0f0546f2973d91e8c2119226 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:12.993243 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5833345-79b9-466f-8699-60f4b118e844 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:13.002797 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6a8ca-67c9-4800-915e-a09b6692df35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:13.003869 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6a8ca-67c9-4800-915e-a09b6692df35 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:13.004390 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6a8ca-67c9-4800-915e-a09b6692df35 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:13.004854 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6a8ca-67c9-4800-915e-a09b6692df35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:13.006143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6a8ca-67c9-4800-915e-a09b6692df35 None admin] RBAC: Adding query filter params (role.id=97d4738e1d3946aead178d02f1a88861, user.id=e5d25271ebe6417d9f9a2e40b08dc3f4, scope.system=all) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:13.006668 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6a8ca-67c9-4800-915e-a09b6692df35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:13.008385 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6a8ca-67c9-4800-915e-a09b6692df35 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:13.014133 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 148/309] 10.222.0.65 () {56 vars in 1308 bytes} [Wed Aug 24 14:19:12 2022] GET /identity/v3/role_assignments?user.id=e5d25271ebe6417d9f9a2e40b08dc3f4&scope.system=all&role.id=97d4738e1d3946aead178d02f1a88861 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:13.040727 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:13.123293 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5833345-79b9-466f-8699-60f4b118e844 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:13.130548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e305a39-e052-4cbb-97b3-3e813a50ea2f None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:13.130846 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e305a39-e052-4cbb-97b3-3e813a50ea2f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:13.131108 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e305a39-e052-4cbb-97b3-3e813a50ea2f None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:13.132480 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 149/310] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:19:13.138118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5e782-e75a-4af1-9b8f-d18959373458 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:13.138506 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5e782-e75a-4af1-9b8f-d18959373458 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:13.138885 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5e782-e75a-4af1-9b8f-d18959373458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:13.159571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-bce5e782-e75a-4af1-9b8f-d18959373458 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:13.160994 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-bce5e782-e75a-4af1-9b8f-d18959373458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:13.165252 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:13.168892 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144c77b-1c2e-404f-8ae7-bb682e2b2cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:13.169560 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144c77b-1c2e-404f-8ae7-bb682e2b2cd6 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:13.169864 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144c77b-1c2e-404f-8ae7-bb682e2b2cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:13.170137 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144c77b-1c2e-404f-8ae7-bb682e2b2cd6 None admin] PATH_INFO: `/v3/system/users/3d92625b0f0546f2973d91e8c2119226/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:13.172780 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144c77b-1c2e-404f-8ae7-bb682e2b2cd6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3d92625b0f0546f2973d91e8c2119226, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:13.179230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144c77b-1c2e-404f-8ae7-bb682e2b2cd6 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:13.237007 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 150/311] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:19:13.265947 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 162/312] 10.222.0.65 () {58 vars in 1334 bytes} [Wed Aug 24 14:19:12 2022] PUT /identity/v3/system/users/3d92625b0f0546f2973d91e8c2119226/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:19:13.516955 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5e782-e75a-4af1-9b8f-d18959373458 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:13.645840 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5e782-e75a-4af1-9b8f-d18959373458 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:13.683042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89e33c-d759-4406-9236-6c0232537ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:13.684034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89e33c-d759-4406-9236-6c0232537ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:13.684514 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89e33c-d759-4406-9236-6c0232537ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:13.685004 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89e33c-d759-4406-9236-6c0232537ea4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:13.694022 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:13.697817 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89e33c-d759-4406-9236-6c0232537ea4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:13.702917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-fa89e33c-d759-4406-9236-6c0232537ea4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:19:13.702917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:13.702917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:13.702917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:13.702917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:13.702917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:13.702917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:13.702917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:13.702917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:13.702917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:13.702917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:13.702917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:13.702917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:13.702917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:13.702917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:13.702917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:13.703919 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:13.703919 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:13.703919 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:13.703919 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:13.703919 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:13.703919 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:13.703919 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:13.703919 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:13.703919 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:13.703919 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:13.703919 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:13.703919 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:13.703919 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:13.703919 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:13.703919 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:13.703919 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:13.704697 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:13.704697 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:13.704697 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:13.704697 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:13.704697 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:13.704697 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:13.704697 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:13.704697 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:13.704697 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:13.704697 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:13.704697 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:19:13.704697 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:13.707332 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 151/313] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:19:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:13.712697 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144c77b-1c2e-404f-8ae7-bb682e2b2cd6 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:13.820561 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144c77b-1c2e-404f-8ae7-bb682e2b2cd6 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:13.828495 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:13.855486 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d37029-7588-4e95-8cbc-f44fd7a67e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:13.856142 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d37029-7588-4e95-8cbc-f44fd7a67e77 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:13.856427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d37029-7588-4e95-8cbc-f44fd7a67e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:13.856702 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d37029-7588-4e95-8cbc-f44fd7a67e77 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:13.857369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d37029-7588-4e95-8cbc-f44fd7a67e77 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:13.857671 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d37029-7588-4e95-8cbc-f44fd7a67e77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:13.859198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d37029-7588-4e95-8cbc-f44fd7a67e77 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:13.868511 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 163/314] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 14:19:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:13.873989 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89e33c-d759-4406-9236-6c0232537ea4 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:13.984411 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89e33c-d759-4406-9236-6c0232537ea4 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:14.020033 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610824b-7ae2-41ec-b80d-4fbbf76b7d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:14.020668 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610824b-7ae2-41ec-b80d-4fbbf76b7d3d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:14.020944 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610824b-7ae2-41ec-b80d-4fbbf76b7d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:14.021218 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610824b-7ae2-41ec-b80d-4fbbf76b7d3d None admin] PATH_INFO: `/v3/users/8f721cdc9fdf4092a1115a7291a1669e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:14.022380 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610824b-7ae2-41ec-b80d-4fbbf76b7d3d None admin] RBAC: Authorizing `identity:get_user(user_id=8f721cdc9fdf4092a1115a7291a1669e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:14.023827 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610824b-7ae2-41ec-b80d-4fbbf76b7d3d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:14.025791 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 152/315] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:19:13 2022] GET /identity/v3/users/8f721cdc9fdf4092a1115a7291a1669e => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:14.031857 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d37029-7588-4e95-8cbc-f44fd7a67e77 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:14.140615 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d37029-7588-4e95-8cbc-f44fd7a67e77 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:14.176844 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212370aa-b558-46e9-8d5c-5c51c3c4173c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:14.177461 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212370aa-b558-46e9-8d5c-5c51c3c4173c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:14.177763 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212370aa-b558-46e9-8d5c-5c51c3c4173c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:14.178093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212370aa-b558-46e9-8d5c-5c51c3c4173c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:14.207089 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:14.252458 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212370aa-b558-46e9-8d5c-5c51c3c4173c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:14.253955 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212370aa-b558-46e9-8d5c-5c51c3c4173c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:14.356751 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 164/316] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:19:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:19:14.363291 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610824b-7ae2-41ec-b80d-4fbbf76b7d3d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:14.440748 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:14.476046 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610824b-7ae2-41ec-b80d-4fbbf76b7d3d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:14.512788 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ac762-3116-499a-8cc3-6bfa4b9b691a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:14.513422 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ac762-3116-499a-8cc3-6bfa4b9b691a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:14.513703 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ac762-3116-499a-8cc3-6bfa4b9b691a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:14.514012 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ac762-3116-499a-8cc3-6bfa4b9b691a None admin] PATH_INFO: `/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:14.515185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ac762-3116-499a-8cc3-6bfa4b9b691a None admin] RBAC: Authorizing `identity:get_project(project_id=fedc7eace6da4d0e82c913b2b5c17e17)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:14.516736 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ac762-3116-499a-8cc3-6bfa4b9b691a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:14.518566 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 153/317] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:19:14 2022] GET /identity/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:14.524483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212370aa-b558-46e9-8d5c-5c51c3c4173c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:14.556700 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311fcb2-538d-4efe-ac47-cd233a907058 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:14.557325 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311fcb2-538d-4efe-ac47-cd233a907058 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:14.557605 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311fcb2-538d-4efe-ac47-cd233a907058 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:14.559758 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 154/318] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:14.564831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88512df-a2cb-4af3-934f-f8d35598430b None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:14.565112 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88512df-a2cb-4af3-934f-f8d35598430b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:14.565384 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88512df-a2cb-4af3-934f-f8d35598430b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:14.585040 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-c88512df-a2cb-4af3-934f-f8d35598430b None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:14.586280 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c88512df-a2cb-4af3-934f-f8d35598430b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:14.593819 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:14.637247 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212370aa-b558-46e9-8d5c-5c51c3c4173c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:14.659460 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 155/319] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:19:14.679992 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3e86c-872a-4ec3-b7bd-95f6630da4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:14.680643 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3e86c-872a-4ec3-b7bd-95f6630da4f6 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:14.680925 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3e86c-872a-4ec3-b7bd-95f6630da4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:14.681199 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3e86c-872a-4ec3-b7bd-95f6630da4f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:14.682034 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3e86c-872a-4ec3-b7bd-95f6630da4f6 None admin] RBAC: Adding query filter params (role.id=97d4738e1d3946aead178d02f1a88861, scope.project.id=fedc7eace6da4d0e82c913b2b5c17e17, user.id=8f721cdc9fdf4092a1115a7291a1669e) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:14.682334 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3e86c-872a-4ec3-b7bd-95f6630da4f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:14.683898 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3e86c-872a-4ec3-b7bd-95f6630da4f6 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:14.698093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 165/320] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:19:14 2022] GET /identity/v3/role_assignments?user.id=8f721cdc9fdf4092a1115a7291a1669e&scope.project.id=fedc7eace6da4d0e82c913b2b5c17e17&role.id=97d4738e1d3946aead178d02f1a88861 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:14.928087 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88512df-a2cb-4af3-934f-f8d35598430b None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:14.994803 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:15.006222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaa91c-e45e-4db0-9c04-8479fe1804ac None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:15.006504 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaa91c-e45e-4db0-9c04-8479fe1804ac None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:15.006774 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaa91c-e45e-4db0-9c04-8479fe1804ac None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:15.008114 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 166/321] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:19:15.012905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c969250-e508-4a3c-ae39-cb75ef5bbc33 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:15.013185 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c969250-e508-4a3c-ae39-cb75ef5bbc33 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:15.013458 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c969250-e508-4a3c-ae39-cb75ef5bbc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:15.033148 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-0c969250-e508-4a3c-ae39-cb75ef5bbc33 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:15.033906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88512df-a2cb-4af3-934f-f8d35598430b None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:15.034535 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0c969250-e508-4a3c-ae39-cb75ef5bbc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:15.070232 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e800a9-574f-4057-ac4b-d3f1582433ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:15.070857 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e800a9-574f-4057-ac4b-d3f1582433ce None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:15.071133 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e800a9-574f-4057-ac4b-d3f1582433ce None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:15.071404 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e800a9-574f-4057-ac4b-d3f1582433ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:15.072503 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e800a9-574f-4057-ac4b-d3f1582433ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:15.073953 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e800a9-574f-4057-ac4b-d3f1582433ce None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:15.075630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 156/322] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:15.081499 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e800a9-574f-4057-ac4b-d3f1582433ce None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:15.110172 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 167/323] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:19:15.187772 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e800a9-574f-4057-ac4b-d3f1582433ce None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:15.222633 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf8375-ab14-43a2-b7eb-80d4246c316d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:15.223576 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf8375-ab14-43a2-b7eb-80d4246c316d None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:15.224027 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf8375-ab14-43a2-b7eb-80d4246c316d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:15.224470 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf8375-ab14-43a2-b7eb-80d4246c316d None admin] PATH_INFO: `/v3/groups` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:15.225277 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf8375-ab14-43a2-b7eb-80d4246c316d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:15.226894 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf8375-ab14-43a2-b7eb-80d4246c316d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:15.231027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c085886-8634-4a1c-ae99-344209eec647 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:15.231483 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:15.231560 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c085886-8634-4a1c-ae99-344209eec647 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:15.231560 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c085886-8634-4a1c-ae99-344209eec647 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:15.232906 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 168/324] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:19:15.238177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c85f0b-faa1-48e8-8191-69368b13778f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:15.238454 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c85f0b-faa1-48e8-8191-69368b13778f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:15.238825 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c85f0b-faa1-48e8-8191-69368b13778f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:15.257558 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-89c85f0b-faa1-48e8-8191-69368b13778f None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:15.258725 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-89c85f0b-faa1-48e8-8191-69368b13778f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:15.310799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:15.311393 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 157/325] 10.222.0.65 () {60 vars in 1134 bytes} [Wed Aug 24 14:19:15 2022] POST /identity/v3/groups => generated 226 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:19:15.333941 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 169/326] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:15.379414 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf8375-ab14-43a2-b7eb-80d4246c316d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:15.497969 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf8375-ab14-43a2-b7eb-80d4246c316d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:15.537485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691fce2-5f7a-44ac-9535-76f45895d8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:15.537670 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691fce2-5f7a-44ac-9535-76f45895d8f5 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:15.537918 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691fce2-5f7a-44ac-9535-76f45895d8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:15.538153 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691fce2-5f7a-44ac-9535-76f45895d8f5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:15.548972 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d691fce2-5f7a-44ac-9535-76f45895d8f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:15.554220 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-d691fce2-5f7a-44ac-9535-76f45895d8f5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:19:15.554220 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:15.554220 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:15.554220 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:15.554220 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:15.554220 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:15.554220 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:15.554220 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:15.554220 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:15.554220 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:15.554220 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:15.554220 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:15.554220 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:15.554220 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:15.554220 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:15.554220 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:15.555219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:15.555219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:15.555219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:15.555219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:15.555219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:15.555219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:15.555219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:15.555219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:15.555219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:15.555219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:15.555219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:15.555219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:15.555219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:15.555219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:15.555219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:15.555219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:15.556035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:15.556035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:15.556035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:15.556035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:15.556035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:15.556035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:15.556035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:15.556035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:15.556035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:15.556035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:15.556035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:19:15.556035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:15.556035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 158/327] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:19:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:15.562643 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c85f0b-faa1-48e8-8191-69368b13778f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:15.606791 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691fce2-5f7a-44ac-9535-76f45895d8f5 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:15.682720 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c85f0b-faa1-48e8-8191-69368b13778f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:15.684829 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:15.724926 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6161c-8f3c-424e-b225-3421312ed56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:15.725608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6161c-8f3c-424e-b225-3421312ed56d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:15.726897 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6161c-8f3c-424e-b225-3421312ed56d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:15.727169 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6161c-8f3c-424e-b225-3421312ed56d None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:15.727853 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6161c-8f3c-424e-b225-3421312ed56d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:15.728153 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6161c-8f3c-424e-b225-3421312ed56d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:15.729568 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6161c-8f3c-424e-b225-3421312ed56d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:15.739003 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 170/328] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 14:19:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:15.739314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691fce2-5f7a-44ac-9535-76f45895d8f5 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:15.744509 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6161c-8f3c-424e-b225-3421312ed56d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:15.790423 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3e374-c551-4fdd-a838-1c7d6f8c0e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:15.790987 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3e374-c551-4fdd-a838-1c7d6f8c0e3b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:15.791259 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3e374-c551-4fdd-a838-1c7d6f8c0e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:15.791523 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3e374-c551-4fdd-a838-1c7d6f8c0e3b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:15.802601 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:15.809982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3e374-c551-4fdd-a838-1c7d6f8c0e3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:15.818016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-c5b3e374-c551-4fdd-a838-1c7d6f8c0e3b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:19:15.818016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:15.818016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:15.818016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:15.818016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:15.818016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:15.818016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:15.818016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:15.818016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:15.818016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:15.818016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:15.818016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:15.818016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:15.818016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:15.818016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:15.818016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:15.820746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:15.820746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:15.820746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:15.820746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:15.820746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:15.820746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:15.820746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:15.820746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:15.820746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:15.820746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:15.820746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:15.820746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:15.820746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:15.820746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:15.820746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:15.820746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:15.821515 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:15.821515 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:15.821515 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:15.821515 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:15.821515 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:15.821515 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:15.821515 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:15.821515 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:15.821515 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:15.821515 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:15.821515 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:19:15.821515 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:15.821515 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 159/329] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:19:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:19:15.826724 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3e374-c551-4fdd-a838-1c7d6f8c0e3b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:15.879829 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6161c-8f3c-424e-b225-3421312ed56d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:15.927247 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9becb2-3aeb-4416-8af4-4d719827fd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:15.928569 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9becb2-3aeb-4416-8af4-4d719827fd9a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:15.929510 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9becb2-3aeb-4416-8af4-4d719827fd9a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:15.930149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9becb2-3aeb-4416-8af4-4d719827fd9a None admin] PATH_INFO: `/v3/users/e5d25271ebe6417d9f9a2e40b08dc3f4` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:15.931906 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9becb2-3aeb-4416-8af4-4d719827fd9a None admin] RBAC: Authorizing `identity:get_user(user_id=e5d25271ebe6417d9f9a2e40b08dc3f4)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:15.933961 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9becb2-3aeb-4416-8af4-4d719827fd9a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:15.937126 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 171/330] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:19:15 2022] GET /identity/v3/users/e5d25271ebe6417d9f9a2e40b08dc3f4 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:15.943701 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9becb2-3aeb-4416-8af4-4d719827fd9a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:15.955566 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3e374-c551-4fdd-a838-1c7d6f8c0e3b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:15.972062 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:15.998220 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c1409-27e0-4a3f-b579-d7d8888fbe9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:15.999744 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c1409-27e0-4a3f-b579-d7d8888fbe9c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:16.000509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c1409-27e0-4a3f-b579-d7d8888fbe9c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:16.000995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c1409-27e0-4a3f-b579-d7d8888fbe9c None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:16.001953 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c1409-27e0-4a3f-b579-d7d8888fbe9c None admin] RBAC: Adding query filter params (name=member) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:16.002330 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c1409-27e0-4a3f-b579-d7d8888fbe9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:16.003803 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c1409-27e0-4a3f-b579-d7d8888fbe9c None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:16.019090 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 160/331] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 14:19:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:16.020836 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c1409-27e0-4a3f-b579-d7d8888fbe9c None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:16.094438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9becb2-3aeb-4416-8af4-4d719827fd9a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:16.113929 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:16.142352 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c1409-27e0-4a3f-b579-d7d8888fbe9c None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:16.142938 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5d98e-7a56-473a-bd06-8980fe166a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:16.144137 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5d98e-7a56-473a-bd06-8980fe166a21 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:16.144650 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5d98e-7a56-473a-bd06-8980fe166a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:16.146120 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5d98e-7a56-473a-bd06-8980fe166a21 None admin] PATH_INFO: `/v3/system/users/e5d25271ebe6417d9f9a2e40b08dc3f4/roles/97d4738e1d3946aead178d02f1a88861` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:16.147847 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c5d98e-7a56-473a-bd06-8980fe166a21 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e5d25271ebe6417d9f9a2e40b08dc3f4, role_id=97d4738e1d3946aead178d02f1a88861)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:16.150941 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c5d98e-7a56-473a-bd06-8980fe166a21 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:16.180927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d64d1-9de6-4c6d-bca9-c6a60ba11f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:16.181539 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d64d1-9de6-4c6d-bca9-c6a60ba11f98 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:16.181845 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d64d1-9de6-4c6d-bca9-c6a60ba11f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:16.182119 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d64d1-9de6-4c6d-bca9-c6a60ba11f98 None admin] PATH_INFO: `/v3/users/3d92625b0f0546f2973d91e8c2119226` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:16.183264 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d64d1-9de6-4c6d-bca9-c6a60ba11f98 None admin] RBAC: Authorizing `identity:get_user(user_id=3d92625b0f0546f2973d91e8c2119226)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:16.184704 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d64d1-9de6-4c6d-bca9-c6a60ba11f98 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:16.189826 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 161/332] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:19:16 2022] GET /identity/v3/users/3d92625b0f0546f2973d91e8c2119226 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:16.192601 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d64d1-9de6-4c6d-bca9-c6a60ba11f98 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:16.213399 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 172/333] 10.222.0.65 () {58 vars in 1334 bytes} [Wed Aug 24 14:19:15 2022] PUT /identity/v3/system/users/e5d25271ebe6417d9f9a2e40b08dc3f4/roles/97d4738e1d3946aead178d02f1a88861 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:19:16.250829 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:16.324506 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d64d1-9de6-4c6d-bca9-c6a60ba11f98 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:16.364561 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20ce1e-e3c8-4553-8e36-fa131289e4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:16.365145 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20ce1e-e3c8-4553-8e36-fa131289e4ca None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:16.365434 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20ce1e-e3c8-4553-8e36-fa131289e4ca None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:16.365711 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20ce1e-e3c8-4553-8e36-fa131289e4ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:16.366540 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20ce1e-e3c8-4553-8e36-fa131289e4ca None admin] RBAC: Adding query filter params (role.id=a5c4bcef93884b89bf10b2f011d880c8, user.id=3d92625b0f0546f2973d91e8c2119226, scope.system=all) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:16.366915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20ce1e-e3c8-4553-8e36-fa131289e4ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:16.368388 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20ce1e-e3c8-4553-8e36-fa131289e4ca None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:16.382248 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 162/334] 10.222.0.65 () {56 vars in 1308 bytes} [Wed Aug 24 14:19:16 2022] GET /identity/v3/role_assignments?user.id=3d92625b0f0546f2973d91e8c2119226&scope.system=all&role.id=a5c4bcef93884b89bf10b2f011d880c8 => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:17.679959 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10840359-ac30-494f-a321-5792fca4b854 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:17.680472 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10840359-ac30-494f-a321-5792fca4b854 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:17.680472 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10840359-ac30-494f-a321-5792fca4b854 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:17.682300 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 173/335] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:17.689717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa596d-6a48-46e1-9552-26937a023079 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:17.690222 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa596d-6a48-46e1-9552-26937a023079 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:17.690294 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa596d-6a48-46e1-9552-26937a023079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:17.719217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-31fa596d-6a48-46e1-9552-26937a023079 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:17.720973 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-31fa596d-6a48-46e1-9552-26937a023079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:17.823644 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 163/336] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:17.923001 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab05ab-6e8a-4546-b89c-bdb2bcce8ea2 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:17.923466 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab05ab-6e8a-4546-b89c-bdb2bcce8ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:17.923834 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab05ab-6e8a-4546-b89c-bdb2bcce8ea2 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:17.926573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 174/337] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:17.932124 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88656621-5766-48c2-84f8-a3096f0e4a73 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:17.932666 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88656621-5766-48c2-84f8-a3096f0e4a73 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:17.933139 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88656621-5766-48c2-84f8-a3096f0e4a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:17.962856 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-88656621-5766-48c2-84f8-a3096f0e4a73 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:17.964401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-88656621-5766-48c2-84f8-a3096f0e4a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:17.999002 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:18.044681 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 164/338] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:19:18.175960 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab05ab-6e8a-4546-b89c-bdb2bcce8ea2 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:18.333691 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab05ab-6e8a-4546-b89c-bdb2bcce8ea2 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:18.381691 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195c21c-3559-4269-911a-f7ec36a5f182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:18.382428 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195c21c-3559-4269-911a-f7ec36a5f182 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:18.382716 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195c21c-3559-4269-911a-f7ec36a5f182 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:18.382990 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195c21c-3559-4269-911a-f7ec36a5f182 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:18.399381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195c21c-3559-4269-911a-f7ec36a5f182 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:18.404881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-4195c21c-3559-4269-911a-f7ec36a5f182 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:19:18.404881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:18.404881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:18.404881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:18.404881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:18.404881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:18.404881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:18.404881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:18.404881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:18.404881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:18.404881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:18.404881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:18.404881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:18.404881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:18.404881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:18.404881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:18.405788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:18.405788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:18.405788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:18.405788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:18.405788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:18.405788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:18.405788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:18.405788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:18.405788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:18.405788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:18.405788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:18.405788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:18.405788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:18.405788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:18.405788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:18.405788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:18.406746 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:18.406746 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:18.406746 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:18.406746 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:18.406746 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:18.406746 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:18.406746 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:18.406746 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:18.406746 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:18.406746 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:18.406746 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:19:18.406746 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:18.406746 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 175/339] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:19:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:18.413538 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88656621-5766-48c2-84f8-a3096f0e4a73 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:18.573066 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88656621-5766-48c2-84f8-a3096f0e4a73 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:18.612767 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bd65a-d0ca-483a-a3a1-76f26fd6821e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:18.613376 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bd65a-d0ca-483a-a3a1-76f26fd6821e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:18.613654 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bd65a-d0ca-483a-a3a1-76f26fd6821e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:18.613952 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bd65a-d0ca-483a-a3a1-76f26fd6821e None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:18.614625 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bd65a-d0ca-483a-a3a1-76f26fd6821e None admin] RBAC: Adding query filter params (name=member) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:18.614937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bd65a-d0ca-483a-a3a1-76f26fd6821e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:18.615768 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195c21c-3559-4269-911a-f7ec36a5f182 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:18.616323 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bd65a-d0ca-483a-a3a1-76f26fd6821e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:18.636255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 165/340] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 14:19:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:18.644965 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bd65a-d0ca-483a-a3a1-76f26fd6821e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:18.679512 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:18.683989 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:18.765150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195c21c-3559-4269-911a-f7ec36a5f182 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:18.806279 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22991991-c4af-443e-83b7-ae00fc656dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:18.807281 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22991991-c4af-443e-83b7-ae00fc656dbe None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:18.807633 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bd65a-d0ca-483a-a3a1-76f26fd6821e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:18.808325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22991991-c4af-443e-83b7-ae00fc656dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:18.808801 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22991991-c4af-443e-83b7-ae00fc656dbe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:18.822649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22991991-c4af-443e-83b7-ae00fc656dbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:18.829806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-22991991-c4af-443e-83b7-ae00fc656dbe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:19:18.829806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:18.829806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:18.829806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:18.829806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:18.829806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:18.829806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:18.829806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:18.829806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:18.829806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:18.829806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:18.829806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:18.829806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:18.829806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:18.829806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:18.829806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:18.830685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:18.830685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:18.830685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:18.830685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:18.830685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:18.830685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:18.830685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:18.830685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:18.830685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:18.830685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:18.830685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:18.830685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:18.830685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:18.830685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:18.830685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:18.830685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:18.831497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:18.831497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:18.831497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:18.831497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:18.831497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:18.831497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:18.831497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:18.831497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:18.831497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:18.831497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:18.831497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:19:18.831497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:18.833247 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 176/341] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 14:19:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:18.835507 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec7cea-ca86-40bd-a098-b81a7fb827cc None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:18.836009 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec7cea-ca86-40bd-a098-b81a7fb827cc None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:18.836483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec7cea-ca86-40bd-a098-b81a7fb827cc None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:18.838412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 177/342] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:18.839364 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec7cea-ca86-40bd-a098-b81a7fb827cc None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:18.858265 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743003ae-ef54-4f5c-afe6-cbea7df7ec22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:18.859263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743003ae-ef54-4f5c-afe6-cbea7df7ec22 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:18.859755 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743003ae-ef54-4f5c-afe6-cbea7df7ec22 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:18.860265 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743003ae-ef54-4f5c-afe6-cbea7df7ec22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:18.951008 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743003ae-ef54-4f5c-afe6-cbea7df7ec22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:18.953222 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743003ae-ef54-4f5c-afe6-cbea7df7ec22 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:18.953455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:18.959235 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec7cea-ca86-40bd-a098-b81a7fb827cc None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:18.981852 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:19.001339 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e505b2d-479b-438c-b54c-81499185922b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:19.002346 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e505b2d-479b-438c-b54c-81499185922b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:19.002797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e505b2d-479b-438c-b54c-81499185922b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:19.003236 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e505b2d-479b-438c-b54c-81499185922b None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:19.004096 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e505b2d-479b-438c-b54c-81499185922b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:19.004597 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e505b2d-479b-438c-b54c-81499185922b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:19.006644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e505b2d-479b-438c-b54c-81499185922b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:19.017155 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 178/343] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:19:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:19.018813 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec1d90-308a-427d-8200-267a97d53833 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:19.019312 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec1d90-308a-427d-8200-267a97d53833 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:19.019823 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec1d90-308a-427d-8200-267a97d53833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:19.041637 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-3cec1d90-308a-427d-8200-267a97d53833 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:19.043457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3cec1d90-308a-427d-8200-267a97d53833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:19.068698 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 166/344] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:19:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 14:19:19.068698 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743003ae-ef54-4f5c-afe6-cbea7df7ec22 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:19.126096 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 179/345] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:19.127337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec1d90-308a-427d-8200-267a97d53833 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:19.173514 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743003ae-ef54-4f5c-afe6-cbea7df7ec22 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:19.199108 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:19.211157 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959f7e9-8c4e-4b71-8bee-af869a075a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:19.211338 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959f7e9-8c4e-4b71-8bee-af869a075a0b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:19.213227 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959f7e9-8c4e-4b71-8bee-af869a075a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:19.213227 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959f7e9-8c4e-4b71-8bee-af869a075a0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:19.235898 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:19.247300 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec1d90-308a-427d-8200-267a97d53833 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:19.286237 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959f7e9-8c4e-4b71-8bee-af869a075a0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:19.287699 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959f7e9-8c4e-4b71-8bee-af869a075a0b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:19.288687 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0516e61-316a-4a3b-839a-7e3f92ebbc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:19.289738 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0516e61-316a-4a3b-839a-7e3f92ebbc80 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:19.290370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0516e61-316a-4a3b-839a-7e3f92ebbc80 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:19.290989 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0516e61-316a-4a3b-839a-7e3f92ebbc80 None admin] PATH_INFO: `/v3/projects/590e1563f57b4a089845f805f9cb48c1` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:19.292392 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0516e61-316a-4a3b-839a-7e3f92ebbc80 None admin] RBAC: Authorizing `identity:get_project(project_id=590e1563f57b4a089845f805f9cb48c1)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:19.294071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0516e61-316a-4a3b-839a-7e3f92ebbc80 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:19.296697 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 180/346] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:19:19 2022] GET /identity/v3/projects/590e1563f57b4a089845f805f9cb48c1 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:19.302504 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0516e61-316a-4a3b-839a-7e3f92ebbc80 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:19.396049 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 167/347] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:19:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:19:19.405277 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959f7e9-8c4e-4b71-8bee-af869a075a0b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:19.428801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:19.458275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0516e61-316a-4a3b-839a-7e3f92ebbc80 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:19.508274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959f7e9-8c4e-4b71-8bee-af869a075a0b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:19.509915 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981338a-3d42-49b2-bcef-e8fe71659ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:19.510930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981338a-3d42-49b2-bcef-e8fe71659ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:19.511419 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981338a-3d42-49b2-bcef-e8fe71659ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:19.511895 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981338a-3d42-49b2-bcef-e8fe71659ff5 None admin] PATH_INFO: `/v3/groups/ca53ecb8803442a984ae582b41bf65e0` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:19.526443 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a981338a-3d42-49b2-bcef-e8fe71659ff5 None admin] RBAC: Authorizing `identity:get_group(group_id=ca53ecb8803442a984ae582b41bf65e0)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:19.528495 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a981338a-3d42-49b2-bcef-e8fe71659ff5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:19.531381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 181/348] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 14:19:19 2022] GET /identity/v3/groups/ca53ecb8803442a984ae582b41bf65e0 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:19.537818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981338a-3d42-49b2-bcef-e8fe71659ff5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:19.545309 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248817c4-611d-4360-8c84-94ea47426559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:19.546837 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248817c4-611d-4360-8c84-94ea47426559 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:19.546837 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248817c4-611d-4360-8c84-94ea47426559 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:19.547033 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248817c4-611d-4360-8c84-94ea47426559 None admin] PATH_INFO: `/v3/projects/590e1563f57b4a089845f805f9cb48c1` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:19.549082 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248817c4-611d-4360-8c84-94ea47426559 None admin] RBAC: Authorizing `identity:get_project(project_id=590e1563f57b4a089845f805f9cb48c1)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:19.550962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248817c4-611d-4360-8c84-94ea47426559 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:19.554283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 168/349] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:19:19 2022] GET /identity/v3/projects/590e1563f57b4a089845f805f9cb48c1 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:19.554856 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248817c4-611d-4360-8c84-94ea47426559 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:19.571231 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:19.661382 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:19.666436 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981338a-3d42-49b2-bcef-e8fe71659ff5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:19.669775 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248817c4-611d-4360-8c84-94ea47426559 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:19.706364 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440efea5-15a0-49e0-bc34-93f0c78c7a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:19.707791 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440efea5-15a0-49e0-bc34-93f0c78c7a97 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:19.708345 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440efea5-15a0-49e0-bc34-93f0c78c7a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:19.708450 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdf5c7-aac0-4cf7-9a90-33b93f13a5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:19.708930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440efea5-15a0-49e0-bc34-93f0c78c7a97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:19.709034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdf5c7-aac0-4cf7-9a90-33b93f13a5e0 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:19.709237 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdf5c7-aac0-4cf7-9a90-33b93f13a5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:19.709514 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdf5c7-aac0-4cf7-9a90-33b93f13a5e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:19.710577 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440efea5-15a0-49e0-bc34-93f0c78c7a97 None admin] RBAC: Adding query filter params (group.id=ca53ecb8803442a984ae582b41bf65e0, role.id=a5c4bcef93884b89bf10b2f011d880c8, scope.project.id=590e1563f57b4a089845f805f9cb48c1) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:19.711089 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440efea5-15a0-49e0-bc34-93f0c78c7a97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:19.712931 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440efea5-15a0-49e0-bc34-93f0c78c7a97 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:19.720730 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 182/350] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Aug 24 14:19:19 2022] GET /identity/v3/role_assignments?group.id=ca53ecb8803442a984ae582b41bf65e0&scope.project.id=590e1563f57b4a089845f805f9cb48c1&role.id=a5c4bcef93884b89bf10b2f011d880c8 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:19.723903 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bdf5c7-aac0-4cf7-9a90-33b93f13a5e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:19.724223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440efea5-15a0-49e0-bc34-93f0c78c7a97 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:19.726783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-05bdf5c7-aac0-4cf7-9a90-33b93f13a5e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:19:19.726783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:19.726783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:19.726783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:19.726783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:19.726783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:19.726783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:19.726783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:19.726783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:19.726783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:19.726783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:19.726783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:19.726783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:19.726783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:19.726783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:19.726783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:19.727736 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:19.727736 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:19.727736 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:19.727736 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:19.727736 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:19.727736 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:19.727736 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:19.727736 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:19.727736 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:19.727736 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:19.727736 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:19.727736 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:19.727736 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:19.727736 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:19.727736 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:19.727736 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:19.728582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:19.728582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:19.728582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:19.728582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:19.728582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:19.728582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:19.728582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:19.728582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:19.728582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:19.728582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:19.728582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:19:19.728582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:19.728582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 169/351] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:19:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:19.734746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdf5c7-aac0-4cf7-9a90-33b93f13a5e0 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:19.846878 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdf5c7-aac0-4cf7-9a90-33b93f13a5e0 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:19.858178 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:19.876931 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440efea5-15a0-49e0-bc34-93f0c78c7a97 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:19.886253 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50896e89-01d4-476c-ad69-7e2d425f4779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:19.886871 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50896e89-01d4-476c-ad69-7e2d425f4779 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:19.887147 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50896e89-01d4-476c-ad69-7e2d425f4779 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:19.887419 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50896e89-01d4-476c-ad69-7e2d425f4779 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:19.888097 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50896e89-01d4-476c-ad69-7e2d425f4779 None admin] RBAC: Adding query filter params (name=member) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:19.888391 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50896e89-01d4-476c-ad69-7e2d425f4779 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:19.890818 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50896e89-01d4-476c-ad69-7e2d425f4779 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:19.904428 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 170/352] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 14:19:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:19.906506 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25071151-8122-4cc1-849d-a138eaedf98a None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:19.906793 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25071151-8122-4cc1-849d-a138eaedf98a None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:19.907068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25071151-8122-4cc1-849d-a138eaedf98a None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:19.908493 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 171/353] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:19.909863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25071151-8122-4cc1-849d-a138eaedf98a None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:19.925981 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a91a5d-1522-4f80-9db7-29bfea15845c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:19.927116 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a91a5d-1522-4f80-9db7-29bfea15845c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:19.927884 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:19.929183 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a91a5d-1522-4f80-9db7-29bfea15845c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:19.929686 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a91a5d-1522-4f80-9db7-29bfea15845c None admin] PATH_INFO: `/v3/groups/ca53ecb8803442a984ae582b41bf65e0` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:19.931379 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a91a5d-1522-4f80-9db7-29bfea15845c None admin] RBAC: Authorizing `identity:get_group(group_id=ca53ecb8803442a984ae582b41bf65e0)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:19.933193 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a91a5d-1522-4f80-9db7-29bfea15845c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:19.935440 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 183/354] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 14:19:19 2022] GET /identity/v3/groups/ca53ecb8803442a984ae582b41bf65e0 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:19.937464 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e74876-560e-4f44-840c-13c84e558dab None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:19.937943 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e74876-560e-4f44-840c-13c84e558dab None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:19.938432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e74876-560e-4f44-840c-13c84e558dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:19.966730 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-62e74876-560e-4f44-840c-13c84e558dab None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:19.968711 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-62e74876-560e-4f44-840c-13c84e558dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:20.062422 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 184/355] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:20.063907 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e74876-560e-4f44-840c-13c84e558dab None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:20.072386 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25071151-8122-4cc1-849d-a138eaedf98a None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:20.117361 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35003a67-f154-4e93-9d9f-fd9583864c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:20.118067 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35003a67-f154-4e93-9d9f-fd9583864c8f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:20.118344 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35003a67-f154-4e93-9d9f-fd9583864c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:20.118616 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35003a67-f154-4e93-9d9f-fd9583864c8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:20.169415 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:20.193961 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e74876-560e-4f44-840c-13c84e558dab None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:20.194134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35003a67-f154-4e93-9d9f-fd9583864c8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:20.194782 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35003a67-f154-4e93-9d9f-fd9583864c8f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:20.212721 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:20.229122 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cac79a-16c6-4fc5-86a8-026cffc00d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:20.230125 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cac79a-16c6-4fc5-86a8-026cffc00d8a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:20.230629 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cac79a-16c6-4fc5-86a8-026cffc00d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:20.231119 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cac79a-16c6-4fc5-86a8-026cffc00d8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:20.232301 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cac79a-16c6-4fc5-86a8-026cffc00d8a None admin] RBAC: Adding query filter params (group.id=ca53ecb8803442a984ae582b41bf65e0, role.id=eb8377ab1ad14341a780bc4acdfa2275, scope.project.id=590e1563f57b4a089845f805f9cb48c1) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:20.232875 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cac79a-16c6-4fc5-86a8-026cffc00d8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:20.234761 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cac79a-16c6-4fc5-86a8-026cffc00d8a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:20.241430 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 185/356] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Aug 24 14:19:20 2022] GET /identity/v3/role_assignments?group.id=ca53ecb8803442a984ae582b41bf65e0&scope.project.id=590e1563f57b4a089845f805f9cb48c1&role.id=eb8377ab1ad14341a780bc4acdfa2275 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:20.317483 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 172/357] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:19:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:19:20.323052 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cac79a-16c6-4fc5-86a8-026cffc00d8a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:20.438829 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cac79a-16c6-4fc5-86a8-026cffc00d8a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:20.481060 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48bd5a-91cd-4861-8704-8db5d6ca930c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:20.481627 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48bd5a-91cd-4861-8704-8db5d6ca930c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:20.481931 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48bd5a-91cd-4861-8704-8db5d6ca930c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:20.482211 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48bd5a-91cd-4861-8704-8db5d6ca930c None admin] PATH_INFO: `/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:20.484160 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48bd5a-91cd-4861-8704-8db5d6ca930c None admin] RBAC: Authorizing `identity:get_project(project_id=fedc7eace6da4d0e82c913b2b5c17e17)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:20.485574 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48bd5a-91cd-4861-8704-8db5d6ca930c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:20.487578 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 186/358] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:19:20 2022] GET /identity/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:20.492767 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35003a67-f154-4e93-9d9f-fd9583864c8f None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:20.601566 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48bd5a-91cd-4861-8704-8db5d6ca930c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:20.618471 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35003a67-f154-4e93-9d9f-fd9583864c8f None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:20.638214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:20.641791 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:20.671796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538dbc4-3c5f-4a24-aad1-6f11e91f29a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:20.672621 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538dbc4-3c5f-4a24-aad1-6f11e91f29a0 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:20.672914 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538dbc4-3c5f-4a24-aad1-6f11e91f29a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:20.673195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538dbc4-3c5f-4a24-aad1-6f11e91f29a0 None admin] PATH_INFO: `/v3/groups/ca53ecb8803442a984ae582b41bf65e0` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:20.679953 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538dbc4-3c5f-4a24-aad1-6f11e91f29a0 None admin] RBAC: Authorizing `identity:get_group(group_id=ca53ecb8803442a984ae582b41bf65e0)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:20.681673 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538dbc4-3c5f-4a24-aad1-6f11e91f29a0 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:20.683880 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 173/359] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 14:19:20 2022] GET /identity/v3/groups/ca53ecb8803442a984ae582b41bf65e0 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:20.689593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538dbc4-3c5f-4a24-aad1-6f11e91f29a0 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:20.840876 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48bd5a-91cd-4861-8704-8db5d6ca930c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:20.873715 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538dbc4-3c5f-4a24-aad1-6f11e91f29a0 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:20.903006 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345e596-b536-4845-ba64-11b0eefcb3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:20.904223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345e596-b536-4845-ba64-11b0eefcb3f1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:20.905177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345e596-b536-4845-ba64-11b0eefcb3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:20.906231 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345e596-b536-4845-ba64-11b0eefcb3f1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:20.917212 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146db81b-5ee9-4de6-9438-bfdb245d8f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:20.917955 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146db81b-5ee9-4de6-9438-bfdb245d8f3d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:20.918305 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146db81b-5ee9-4de6-9438-bfdb245d8f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:20.918650 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146db81b-5ee9-4de6-9438-bfdb245d8f3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:20.919457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146db81b-5ee9-4de6-9438-bfdb245d8f3d None admin] RBAC: Adding query filter params (group.id=ca53ecb8803442a984ae582b41bf65e0, role.id=a5c4bcef93884b89bf10b2f011d880c8, scope.project.id=fedc7eace6da4d0e82c913b2b5c17e17) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:20.919848 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146db81b-5ee9-4de6-9438-bfdb245d8f3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:20.920503 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345e596-b536-4845-ba64-11b0eefcb3f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:20.922016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146db81b-5ee9-4de6-9438-bfdb245d8f3d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:20.927650 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-d345e596-b536-4845-ba64-11b0eefcb3f1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:19:20.927650 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:20.927650 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:20.927650 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:20.927650 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:20.927650 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:20.927650 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:20.927650 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:20.927650 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:20.927650 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:20.927650 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:20.927650 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:20.927650 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:20.927650 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:20.927650 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:20.927650 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:20.928807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:20.928807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:20.928807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:20.928807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:20.928807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:20.928807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:20.928807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:20.928807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:20.928807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:20.928807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:20.928807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:20.928807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:20.928807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:20.928807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:20.928807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:20.928807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:20.929856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:20.929856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:20.929856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:20.929856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:20.929856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:20.929856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:20.929856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:20.929856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:20.929856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:20.929856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:20.929856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:19:20.929856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:20.935782 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 187/360] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:19:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:19:20.935782 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbf21d-c974-4cc2-9ace-f537e8c680ce None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:20.935782 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbf21d-c974-4cc2-9ace-f537e8c680ce None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:20.935782 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbf21d-c974-4cc2-9ace-f537e8c680ce None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:20.935782 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 188/361] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:20.936205 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 174/362] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Aug 24 14:19:20 2022] GET /identity/v3/role_assignments?group.id=ca53ecb8803442a984ae582b41bf65e0&scope.project.id=fedc7eace6da4d0e82c913b2b5c17e17&role.id=a5c4bcef93884b89bf10b2f011d880c8 => generated 260 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:20.936385 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98190a1d-d954-4506-a6c0-57ec200ededf None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:20.936385 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98190a1d-d954-4506-a6c0-57ec200ededf None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:20.937314 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98190a1d-d954-4506-a6c0-57ec200ededf None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:20.939281 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146db81b-5ee9-4de6-9438-bfdb245d8f3d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:20.939782 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 189/363] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:20.946359 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00261fda-fbe4-40af-a6d0-5e22f1b79bf5 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:20.947443 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00261fda-fbe4-40af-a6d0-5e22f1b79bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:20.947825 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00261fda-fbe4-40af-a6d0-5e22f1b79bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:20.989350 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-00261fda-fbe4-40af-a6d0-5e22f1b79bf5 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:20.992313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-00261fda-fbe4-40af-a6d0-5e22f1b79bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:21.037954 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:21.136726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 190/364] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:19:21.142266 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146db81b-5ee9-4de6-9438-bfdb245d8f3d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:21.142909 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efd373-5c8f-4202-8376-887776c78a15 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:21.143359 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efd373-5c8f-4202-8376-887776c78a15 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:21.145342 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efd373-5c8f-4202-8376-887776c78a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:21.174724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:21.185731 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-07efd373-5c8f-4202-8376-887776c78a15 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:21.187957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-07efd373-5c8f-4202-8376-887776c78a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:21.235401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9923c8-df40-4d56-b577-b39dd29b8d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:21.236337 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9923c8-df40-4d56-b577-b39dd29b8d1a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:21.236756 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9923c8-df40-4d56-b577-b39dd29b8d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:21.237212 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9923c8-df40-4d56-b577-b39dd29b8d1a None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:21.238049 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9923c8-df40-4d56-b577-b39dd29b8d1a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:21.238507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9923c8-df40-4d56-b577-b39dd29b8d1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:21.240019 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9923c8-df40-4d56-b577-b39dd29b8d1a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:21.271999 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 175/365] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 14:19:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:21.288884 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9923c8-df40-4d56-b577-b39dd29b8d1a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:21.330020 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 191/366] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:21.465684 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9923c8-df40-4d56-b577-b39dd29b8d1a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:21.475460 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:21.505710 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71e571-01f8-4c6f-bc68-adf54e0647e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:21.506429 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71e571-01f8-4c6f-bc68-adf54e0647e7 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:21.506715 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71e571-01f8-4c6f-bc68-adf54e0647e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:21.507627 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71e571-01f8-4c6f-bc68-adf54e0647e7 None admin] PATH_INFO: `/v3/users/e5d25271ebe6417d9f9a2e40b08dc3f4` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:21.508502 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71e571-01f8-4c6f-bc68-adf54e0647e7 None admin] RBAC: Authorizing `identity:get_user(user_id=e5d25271ebe6417d9f9a2e40b08dc3f4)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:21.510002 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71e571-01f8-4c6f-bc68-adf54e0647e7 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:21.511968 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 176/367] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:19:21 2022] GET /identity/v3/users/e5d25271ebe6417d9f9a2e40b08dc3f4 => generated 293 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:21.518533 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efd373-5c8f-4202-8376-887776c78a15 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:21.638974 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efd373-5c8f-4202-8376-887776c78a15 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:21.676755 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764fe68-eddf-4f62-b493-876d752e0fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:21.677741 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764fe68-eddf-4f62-b493-876d752e0fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:21.678254 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764fe68-eddf-4f62-b493-876d752e0fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:21.678733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764fe68-eddf-4f62-b493-876d752e0fa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:21.679695 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764fe68-eddf-4f62-b493-876d752e0fa3 None admin] RBAC: Adding query filter params (role.id=97d4738e1d3946aead178d02f1a88861, user.id=e5d25271ebe6417d9f9a2e40b08dc3f4, scope.system=all) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:21.680212 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764fe68-eddf-4f62-b493-876d752e0fa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:21.681881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764fe68-eddf-4f62-b493-876d752e0fa3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:21.684705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:21.695105 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 192/368] 10.222.0.65 () {56 vars in 1308 bytes} [Wed Aug 24 14:19:21 2022] GET /identity/v3/role_assignments?user.id=e5d25271ebe6417d9f9a2e40b08dc3f4&scope.system=all&role.id=97d4738e1d3946aead178d02f1a88861 => generated 510 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:21.781265 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71e571-01f8-4c6f-bc68-adf54e0647e7 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:21.809666 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764fe68-eddf-4f62-b493-876d752e0fa3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:21.960621 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71e571-01f8-4c6f-bc68-adf54e0647e7 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:21.979090 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764fe68-eddf-4f62-b493-876d752e0fa3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:22.025912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb1e55-eea4-4f9d-a7c4-e9d29038aea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:22.026914 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb1e55-eea4-4f9d-a7c4-e9d29038aea0 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:22.027393 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb1e55-eea4-4f9d-a7c4-e9d29038aea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:22.028015 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb1e55-eea4-4f9d-a7c4-e9d29038aea0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:22.042996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb1e55-eea4-4f9d-a7c4-e9d29038aea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:22.048601 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c182378-f6c9-4351-9493-74cee30b3ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:22.049249 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c182378-f6c9-4351-9493-74cee30b3ead None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:22.049528 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c182378-f6c9-4351-9493-74cee30b3ead None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:22.049824 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c182378-f6c9-4351-9493-74cee30b3ead None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:22.052101 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-beeb1e55-eea4-4f9d-a7c4-e9d29038aea0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:19:22.052101 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:22.052101 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:22.052101 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:22.052101 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:22.052101 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:22.052101 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:22.052101 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:22.052101 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:22.052101 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:22.052101 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:22.052101 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:22.052101 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:22.052101 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:22.052101 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:22.052101 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:22.052954 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:22.052954 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:22.052954 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:22.052954 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:22.052954 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:22.052954 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:22.052954 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:22.052954 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:22.052954 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:22.052954 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:22.052954 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:22.052954 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:22.052954 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:22.052954 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:22.052954 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:22.052954 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:22.053818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:22.053818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:22.053818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:22.053818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:22.053818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:22.053818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:22.053818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:22.053818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:22.053818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:22.053818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:22.053818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:19:22.053818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:22.056664 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 193/369] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:19:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:22.063475 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb1e55-eea4-4f9d-a7c4-e9d29038aea0 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:22.085927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c182378-f6c9-4351-9493-74cee30b3ead None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:22.091988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-6c182378-f6c9-4351-9493-74cee30b3ead None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:19:22.091988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:22.091988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:22.091988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:22.091988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:22.091988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:22.091988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:22.091988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:22.091988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:22.091988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:22.091988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:22.091988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:22.091988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:22.091988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:22.091988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:22.091988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:22.093442 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:22.093442 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:22.093442 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:22.093442 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:22.093442 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:22.093442 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:22.093442 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:22.093442 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:22.093442 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:22.093442 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:22.093442 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:22.093442 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:22.093442 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:22.093442 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:22.093442 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:22.093442 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:22.094726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:22.094726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:22.094726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:22.094726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:22.094726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:22.094726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:22.094726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:22.094726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:22.094726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:22.094726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:22.094726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:19:22.094726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:22.097354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 177/370] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 14:19:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:22.103328 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c182378-f6c9-4351-9493-74cee30b3ead None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:22.150513 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:22.210106 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:22.227409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c182378-f6c9-4351-9493-74cee30b3ead None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:22.277232 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58b34a-ae1f-419f-863b-3eacbd204bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:22.278052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58b34a-ae1f-419f-863b-3eacbd204bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:22.278431 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58b34a-ae1f-419f-863b-3eacbd204bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:22.278819 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58b34a-ae1f-419f-863b-3eacbd204bf5 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:22.279585 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58b34a-ae1f-419f-863b-3eacbd204bf5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:22.280103 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58b34a-ae1f-419f-863b-3eacbd204bf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:22.281854 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58b34a-ae1f-419f-863b-3eacbd204bf5 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:22.290914 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 178/371] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:19:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:22.291987 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb1e55-eea4-4f9d-a7c4-e9d29038aea0 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:22.323995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58b34a-ae1f-419f-863b-3eacbd204bf5 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:22.333177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368cdb4-91b8-4e05-b7de-32f5f9772749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:22.334100 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368cdb4-91b8-4e05-b7de-32f5f9772749 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:22.334513 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368cdb4-91b8-4e05-b7de-32f5f9772749 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:22.334927 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368cdb4-91b8-4e05-b7de-32f5f9772749 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:22.335767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368cdb4-91b8-4e05-b7de-32f5f9772749 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:22.336223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368cdb4-91b8-4e05-b7de-32f5f9772749 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:22.337733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368cdb4-91b8-4e05-b7de-32f5f9772749 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:22.348005 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 194/372] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:19:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:22.353185 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368cdb4-91b8-4e05-b7de-32f5f9772749 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:22.464197 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:22.470559 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58b34a-ae1f-419f-863b-3eacbd204bf5 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:22.519705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368cdb4-91b8-4e05-b7de-32f5f9772749 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:22.544577 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a5b0b-36d2-41cd-a9ca-387884e04d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:22.545189 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a5b0b-36d2-41cd-a9ca-387884e04d7f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:22.545467 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a5b0b-36d2-41cd-a9ca-387884e04d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:22.545815 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a5b0b-36d2-41cd-a9ca-387884e04d7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:22.559952 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:22.595992 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aed761-c4e5-4cad-8996-ffea4d969ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:22.596522 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aed761-c4e5-4cad-8996-ffea4d969ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:22.596859 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aed761-c4e5-4cad-8996-ffea4d969ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:22.597134 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aed761-c4e5-4cad-8996-ffea4d969ff1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:22.693330 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aed761-c4e5-4cad-8996-ffea4d969ff1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:22.694842 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aed761-c4e5-4cad-8996-ffea4d969ff1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:22.724908 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a5b0b-36d2-41cd-a9ca-387884e04d7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:22.726451 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a5b0b-36d2-41cd-a9ca-387884e04d7f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:22.820370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 195/373] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:19:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:19:22.833776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aed761-c4e5-4cad-8996-ffea4d969ff1 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:22.855238 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:22.901291 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:22.902617 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 179/374] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:19:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:19:22.903992 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5708c-c55a-415c-bf71-919c4ff81496 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:22.904282 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5708c-c55a-415c-bf71-919c4ff81496 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:22.904558 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5708c-c55a-415c-bf71-919c4ff81496 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:22.906514 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 180/375] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:22.913420 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fd5ef-3884-4c66-9c5a-2eaeef1b4b04 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:22.913710 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fd5ef-3884-4c66-9c5a-2eaeef1b4b04 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:22.914081 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fd5ef-3884-4c66-9c5a-2eaeef1b4b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:22.947581 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-516fd5ef-3884-4c66-9c5a-2eaeef1b4b04 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:22.949033 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-516fd5ef-3884-4c66-9c5a-2eaeef1b4b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:22.950518 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aed761-c4e5-4cad-8996-ffea4d969ff1 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:22.996124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db15d2-f4bc-4285-a0cf-661ba4a98d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:22.996762 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db15d2-f4bc-4285-a0cf-661ba4a98d64 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:22.997028 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db15d2-f4bc-4285-a0cf-661ba4a98d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:22.997295 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db15d2-f4bc-4285-a0cf-661ba4a98d64 None admin] PATH_INFO: `/v3/projects/4f4410563d8b45fea6a29fd68277b77c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:23.000332 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db15d2-f4bc-4285-a0cf-661ba4a98d64 None admin] RBAC: Authorizing `identity:get_project(project_id=4f4410563d8b45fea6a29fd68277b77c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:23.001805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db15d2-f4bc-4285-a0cf-661ba4a98d64 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:23.003472 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 196/376] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:19:22 2022] GET /identity/v3/projects/4f4410563d8b45fea6a29fd68277b77c => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:23.004377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db15d2-f4bc-4285-a0cf-661ba4a98d64 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:23.037849 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 181/377] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:19:23.039807 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a9a22-5ab2-489d-bf96-29be3580c341 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:23.040313 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a9a22-5ab2-489d-bf96-29be3580c341 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:23.040592 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a9a22-5ab2-489d-bf96-29be3580c341 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:23.042968 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 182/378] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:23.044153 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a9a22-5ab2-489d-bf96-29be3580c341 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:23.108597 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:23.127759 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db15d2-f4bc-4285-a0cf-661ba4a98d64 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:23.171355 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad2434-2a57-433d-a55f-7cce94fa2ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:23.172081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad2434-2a57-433d-a55f-7cce94fa2ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:23.172413 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad2434-2a57-433d-a55f-7cce94fa2ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:23.172622 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad2434-2a57-433d-a55f-7cce94fa2ab5 None admin] PATH_INFO: `/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:23.173870 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad2434-2a57-433d-a55f-7cce94fa2ab5 None admin] RBAC: Authorizing `identity:get_project(project_id=fedc7eace6da4d0e82c913b2b5c17e17)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:23.175608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad2434-2a57-433d-a55f-7cce94fa2ab5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:23.177615 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 197/379] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:19:23 2022] GET /identity/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:23.178976 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c8d3b-c377-445e-8624-40058c8dbbe4 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:23.179258 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c8d3b-c377-445e-8624-40058c8dbbe4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:23.179529 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c8d3b-c377-445e-8624-40058c8dbbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:23.185977 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a9a22-5ab2-489d-bf96-29be3580c341 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:23.200885 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-da0c8d3b-c377-445e-8624-40058c8dbbe4 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:23.202244 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-da0c8d3b-c377-445e-8624-40058c8dbbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:23.227342 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:23.239243 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc8382-8938-4507-9111-02b7db681fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:23.247790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc8382-8938-4507-9111-02b7db681fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:23.247790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc8382-8938-4507-9111-02b7db681fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:23.247790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc8382-8938-4507-9111-02b7db681fe2 None admin] PATH_INFO: `/v3/groups/4419caed7cfb48388a92af7cd961caad` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:23.249398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc8382-8938-4507-9111-02b7db681fe2 None admin] RBAC: Authorizing `identity:get_group(group_id=4419caed7cfb48388a92af7cd961caad)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:23.251692 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc8382-8938-4507-9111-02b7db681fe2 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:23.253577 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 183/380] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 14:19:23 2022] GET /identity/v3/groups/4419caed7cfb48388a92af7cd961caad => generated 229 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:23.254592 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc8382-8938-4507-9111-02b7db681fe2 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:23.288619 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 198/381] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:23.289580 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c8d3b-c377-445e-8624-40058c8dbbe4 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:23.389929 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:23.393004 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc8382-8938-4507-9111-02b7db681fe2 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:23.407354 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c8d3b-c377-445e-8624-40058c8dbbe4 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:23.442483 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c53c13-c5b5-423b-948a-40220fa52874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:23.443121 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c53c13-c5b5-423b-948a-40220fa52874 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:23.443399 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c53c13-c5b5-423b-948a-40220fa52874 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:23.443669 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c53c13-c5b5-423b-948a-40220fa52874 None admin] PATH_INFO: `/v3/groups/ca53ecb8803442a984ae582b41bf65e0` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:23.445507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c53c13-c5b5-423b-948a-40220fa52874 None admin] RBAC: Authorizing `identity:get_group(group_id=ca53ecb8803442a984ae582b41bf65e0)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:23.446992 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c53c13-c5b5-423b-948a-40220fa52874 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:23.453637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 184/382] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 14:19:23 2022] GET /identity/v3/groups/ca53ecb8803442a984ae582b41bf65e0 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:23.454575 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c53c13-c5b5-423b-948a-40220fa52874 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:23.457966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a349c-7cf4-49ee-ae3e-664ce7d10a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:23.459781 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a349c-7cf4-49ee-ae3e-664ce7d10a52 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:23.460285 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a349c-7cf4-49ee-ae3e-664ce7d10a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:23.460760 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a349c-7cf4-49ee-ae3e-664ce7d10a52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:23.461682 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a349c-7cf4-49ee-ae3e-664ce7d10a52 None admin] RBAC: Adding query filter params (group.id=4419caed7cfb48388a92af7cd961caad, role.id=b779073cee3c470ca4ad7a7b27d72c5e, scope.project.id=4f4410563d8b45fea6a29fd68277b77c) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:23.462227 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a349c-7cf4-49ee-ae3e-664ce7d10a52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:23.464407 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a349c-7cf4-49ee-ae3e-664ce7d10a52 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:23.473972 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 199/383] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Aug 24 14:19:23 2022] GET /identity/v3/role_assignments?group.id=4419caed7cfb48388a92af7cd961caad&scope.project.id=4f4410563d8b45fea6a29fd68277b77c&role.id=b779073cee3c470ca4ad7a7b27d72c5e => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:23.475224 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a349c-7cf4-49ee-ae3e-664ce7d10a52 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:23.544819 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:23.605165 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c53c13-c5b5-423b-948a-40220fa52874 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:23.607710 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a349c-7cf4-49ee-ae3e-664ce7d10a52 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:23.649736 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269296a7-4d71-4720-bd95-a3cbc70c411f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:23.650315 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269296a7-4d71-4720-bd95-a3cbc70c411f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:23.650592 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269296a7-4d71-4720-bd95-a3cbc70c411f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:23.650969 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269296a7-4d71-4720-bd95-a3cbc70c411f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:23.651622 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ebe65-3bb3-46fd-b8b8-9a18d44cd93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:23.651764 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269296a7-4d71-4720-bd95-a3cbc70c411f None admin] RBAC: Adding query filter params (group.id=ca53ecb8803442a984ae582b41bf65e0, role.id=eb8377ab1ad14341a780bc4acdfa2275, scope.project.id=fedc7eace6da4d0e82c913b2b5c17e17) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:23.652012 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269296a7-4d71-4720-bd95-a3cbc70c411f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:23.652271 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ebe65-3bb3-46fd-b8b8-9a18d44cd93c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:23.652557 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ebe65-3bb3-46fd-b8b8-9a18d44cd93c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:23.652834 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ebe65-3bb3-46fd-b8b8-9a18d44cd93c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:23.653658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269296a7-4d71-4720-bd95-a3cbc70c411f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:23.660812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 200/384] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Aug 24 14:19:23 2022] GET /identity/v3/role_assignments?group.id=ca53ecb8803442a984ae582b41bf65e0&scope.project.id=fedc7eace6da4d0e82c913b2b5c17e17&role.id=eb8377ab1ad14341a780bc4acdfa2275 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:23.662199 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378f23e-4821-4ff1-ab67-e78f7d022bc5 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:23.662698 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378f23e-4821-4ff1-ab67-e78f7d022bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:23.662978 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378f23e-4821-4ff1-ab67-e78f7d022bc5 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:23.664681 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 201/385] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:23.667071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378f23e-4821-4ff1-ab67-e78f7d022bc5 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:23.668437 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ebe65-3bb3-46fd-b8b8-9a18d44cd93c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:23.675032 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-271ebe65-3bb3-46fd-b8b8-9a18d44cd93c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:19:23.675032 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:23.675032 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:23.675032 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:23.675032 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:23.675032 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:23.675032 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:23.675032 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:23.675032 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:23.675032 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:23.675032 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:23.675032 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:23.675032 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:23.675032 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:23.675032 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:23.675032 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:23.675988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:23.675988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:23.675988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:23.675988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:23.675988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:23.675988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:23.675988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:23.675988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:23.675988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:23.675988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:23.675988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:23.675988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:23.675988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:23.675988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:23.675988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:23.675988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:23.676762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:23.676762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:23.676762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:23.676762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:23.676762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:23.676762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:23.676762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:23.676762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:23.676762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:23.676762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:23.676762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:19:23.676762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:23.676762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 185/386] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 14:19:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:23.678037 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee761a6-41ce-4881-9e32-212fcb668419 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:23.678321 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee761a6-41ce-4881-9e32-212fcb668419 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:23.678604 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee761a6-41ce-4881-9e32-212fcb668419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:23.689041 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:23.702300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-2ee761a6-41ce-4881-9e32-212fcb668419 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:23.703979 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2ee761a6-41ce-4881-9e32-212fcb668419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:23.800420 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 186/387] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:23.801381 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee761a6-41ce-4881-9e32-212fcb668419 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:23.838043 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378f23e-4821-4ff1-ab67-e78f7d022bc5 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:23.884182 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:23.885228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb1a36-185b-493d-9ca3-752222eda18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:23.885902 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb1a36-185b-493d-9ca3-752222eda18b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:23.886179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb1a36-185b-493d-9ca3-752222eda18b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:23.886449 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb1a36-185b-493d-9ca3-752222eda18b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:23.907506 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb1a36-185b-493d-9ca3-752222eda18b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:23.912325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-f5bb1a36-185b-493d-9ca3-752222eda18b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:19:23.912325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:23.912325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:23.912325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:23.912325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:23.912325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:23.912325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:23.912325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:23.912325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:23.912325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:23.912325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:23.912325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:23.912325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:23.912325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:23.912325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:23.912325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:23.913179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:23.913179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:23.913179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:23.913179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:23.913179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:23.913179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:23.913179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:23.913179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:23.913179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:23.913179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:23.913179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:23.913179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:23.913179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:23.913179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:23.913179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:23.913179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:23.918455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:23.918455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:23.918455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:23.918455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:23.918455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:23.918455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:23.918455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:23.918455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:23.918455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:23.918455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:23.918455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:19:23.918455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:23.918455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 202/388] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:19:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:19:23.921943 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb1a36-185b-493d-9ca3-752222eda18b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:23.951414 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee761a6-41ce-4881-9e32-212fcb668419 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:23.993829 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1451b-a341-4503-8fdf-626445beebcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:23.995366 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1451b-a341-4503-8fdf-626445beebcb None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:23.996106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1451b-a341-4503-8fdf-626445beebcb None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:23.996576 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1451b-a341-4503-8fdf-626445beebcb None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:23.998012 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c1451b-a341-4503-8fdf-626445beebcb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:23.998183 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c1451b-a341-4503-8fdf-626445beebcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:24.000489 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c1451b-a341-4503-8fdf-626445beebcb None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:24.013855 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 187/389] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:19:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:24.022943 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1451b-a341-4503-8fdf-626445beebcb None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:24.026264 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:24.074290 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb1a36-185b-493d-9ca3-752222eda18b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:24.114918 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb7aa5-6f91-43dc-9e7c-ccefcb9d37ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:24.115536 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb7aa5-6f91-43dc-9e7c-ccefcb9d37ee None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:24.115814 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb7aa5-6f91-43dc-9e7c-ccefcb9d37ee None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:24.116086 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb7aa5-6f91-43dc-9e7c-ccefcb9d37ee None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:24.116762 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb7aa5-6f91-43dc-9e7c-ccefcb9d37ee None admin] RBAC: Adding query filter params (name=member) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:24.117061 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb7aa5-6f91-43dc-9e7c-ccefcb9d37ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:24.118493 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb7aa5-6f91-43dc-9e7c-ccefcb9d37ee None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:24.130103 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 203/390] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 14:19:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:24.135484 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb7aa5-6f91-43dc-9e7c-ccefcb9d37ee None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:24.156787 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1451b-a341-4503-8fdf-626445beebcb None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:24.173355 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:24.197319 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2bf3c3-f578-43b1-b0fc-b25199f3b09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:24.198003 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bf3c3-f578-43b1-b0fc-b25199f3b09a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:24.198432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bf3c3-f578-43b1-b0fc-b25199f3b09a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:24.198839 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bf3c3-f578-43b1-b0fc-b25199f3b09a None admin] PATH_INFO: `/v3/groups/ca53ecb8803442a984ae582b41bf65e0` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:24.200035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2bf3c3-f578-43b1-b0fc-b25199f3b09a None admin] RBAC: Authorizing `identity:get_group(group_id=ca53ecb8803442a984ae582b41bf65e0)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:24.201809 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2bf3c3-f578-43b1-b0fc-b25199f3b09a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:24.203866 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 188/391] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 14:19:24 2022] GET /identity/v3/groups/ca53ecb8803442a984ae582b41bf65e0 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:24.209152 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2bf3c3-f578-43b1-b0fc-b25199f3b09a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:24.340516 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb7aa5-6f91-43dc-9e7c-ccefcb9d37ee None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:24.345774 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2bf3c3-f578-43b1-b0fc-b25199f3b09a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:24.380342 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:24.387935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f9dc6-f2a4-4952-a658-f75f817b5316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:24.388597 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f9dc6-f2a4-4952-a658-f75f817b5316 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:24.396078 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f9dc6-f2a4-4952-a658-f75f817b5316 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:24.396078 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f9dc6-f2a4-4952-a658-f75f817b5316 None admin] PATH_INFO: `/v3/groups/ca53ecb8803442a984ae582b41bf65e0` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:24.396078 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f9dc6-f2a4-4952-a658-f75f817b5316 None admin] RBAC: Authorizing `identity:get_group(group_id=ca53ecb8803442a984ae582b41bf65e0)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:24.396078 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f9dc6-f2a4-4952-a658-f75f817b5316 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:24.396078 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 204/392] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 14:19:24 2022] GET /identity/v3/groups/ca53ecb8803442a984ae582b41bf65e0 => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:24.396478 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58cbfe1-0b94-4c21-9759-a0d11df9ed52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:24.396595 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f9dc6-f2a4-4952-a658-f75f817b5316 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:24.396680 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58cbfe1-0b94-4c21-9759-a0d11df9ed52 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:24.396876 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58cbfe1-0b94-4c21-9759-a0d11df9ed52 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:24.397284 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58cbfe1-0b94-4c21-9759-a0d11df9ed52 None admin] PATH_INFO: `/v3/projects/590e1563f57b4a089845f805f9cb48c1` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:24.398894 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58cbfe1-0b94-4c21-9759-a0d11df9ed52 None admin] RBAC: Authorizing `identity:get_project(project_id=590e1563f57b4a089845f805f9cb48c1)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:24.401431 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58cbfe1-0b94-4c21-9759-a0d11df9ed52 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:24.403605 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 189/393] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:19:24 2022] GET /identity/v3/projects/590e1563f57b4a089845f805f9cb48c1 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:24.404566 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58cbfe1-0b94-4c21-9759-a0d11df9ed52 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:24.475954 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:24.515899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f9dc6-f2a4-4952-a658-f75f817b5316 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:24.533162 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58cbfe1-0b94-4c21-9759-a0d11df9ed52 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:24.551327 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda80c6-6f7a-42cf-8ffd-c08f8dfb0cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:24.552014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda80c6-6f7a-42cf-8ffd-c08f8dfb0cef None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:24.552299 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda80c6-6f7a-42cf-8ffd-c08f8dfb0cef None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:24.552574 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda80c6-6f7a-42cf-8ffd-c08f8dfb0cef None admin] PATH_INFO: `/v3/roles/member` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:24.563325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda80c6-6f7a-42cf-8ffd-c08f8dfb0cef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:24.568562 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-2cda80c6-6f7a-42cf-8ffd-c08f8dfb0cef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:19:24.568562 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:24.568562 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:24.568562 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:24.568562 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:24.568562 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:24.568562 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:24.568562 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:24.568562 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:24.568562 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:24.568562 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:24.568562 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:24.568562 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:24.568562 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:24.568562 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:24.568562 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:24.569684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:24.569684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:24.569684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:24.569684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:24.569684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:24.569684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:24.569684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:24.569684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:24.569684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:24.569684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:24.569684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:24.569684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:24.569684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:24.569684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:24.569684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:24.569684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:24.570744 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:24.570744 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:24.570744 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:24.570744 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:24.570744 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:24.570744 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:24.570744 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:24.570744 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:24.570744 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:24.570744 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:24.570744 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:19:24.570744 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:24.570744 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 205/394] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:19:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:24.570744 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda80c6-6f7a-42cf-8ffd-c08f8dfb0cef None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:24.579213 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193902ff-ca45-40c3-bb42-56f18b3942b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:24.580117 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193902ff-ca45-40c3-bb42-56f18b3942b0 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:24.580569 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193902ff-ca45-40c3-bb42-56f18b3942b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:24.581018 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193902ff-ca45-40c3-bb42-56f18b3942b0 None admin] PATH_INFO: `/v3/projects/590e1563f57b4a089845f805f9cb48c1` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:24.582342 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193902ff-ca45-40c3-bb42-56f18b3942b0 None admin] RBAC: Authorizing `identity:get_project(project_id=590e1563f57b4a089845f805f9cb48c1)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:24.584307 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193902ff-ca45-40c3-bb42-56f18b3942b0 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:24.586833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 190/395] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:19:24 2022] GET /identity/v3/projects/590e1563f57b4a089845f805f9cb48c1 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:24.587880 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193902ff-ca45-40c3-bb42-56f18b3942b0 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:24.638280 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:24.682719 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda80c6-6f7a-42cf-8ffd-c08f8dfb0cef None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:24.708289 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193902ff-ca45-40c3-bb42-56f18b3942b0 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:24.724051 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982fe8e-15f4-4c3d-96af-7d2fa5f85747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:24.724719 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982fe8e-15f4-4c3d-96af-7d2fa5f85747 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:24.725151 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982fe8e-15f4-4c3d-96af-7d2fa5f85747 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:24.725351 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982fe8e-15f4-4c3d-96af-7d2fa5f85747 None admin] PATH_INFO: `/v3/projects/590e1563f57b4a089845f805f9cb48c1/groups/ca53ecb8803442a984ae582b41bf65e0/roles/eb8377ab1ad14341a780bc4acdfa2275` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:24.727616 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f982fe8e-15f4-4c3d-96af-7d2fa5f85747 None admin] RBAC: Authorizing `identity:create_grant(project_id=590e1563f57b4a089845f805f9cb48c1, group_id=ca53ecb8803442a984ae582b41bf65e0, role_id=eb8377ab1ad14341a780bc4acdfa2275)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:24.728994 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f982fe8e-15f4-4c3d-96af-7d2fa5f85747 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:24.744964 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:24.752536 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8560474-58e2-420d-830a-e8939b9e07cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:24.753350 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8560474-58e2-420d-830a-e8939b9e07cf None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:24.755318 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8560474-58e2-420d-830a-e8939b9e07cf None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:24.755698 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8560474-58e2-420d-830a-e8939b9e07cf None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:24.756498 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8560474-58e2-420d-830a-e8939b9e07cf None admin] RBAC: Adding query filter params (name=member) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:24.756874 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8560474-58e2-420d-830a-e8939b9e07cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:24.758509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8560474-58e2-420d-830a-e8939b9e07cf None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:24.770271 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 191/396] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 14:19:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:24.771007 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8560474-58e2-420d-830a-e8939b9e07cf None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:24.800501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 206/397] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Aug 24 14:19:24 2022] PUT /identity/v3/projects/590e1563f57b4a089845f805f9cb48c1/groups/ca53ecb8803442a984ae582b41bf65e0/roles/eb8377ab1ad14341a780bc4acdfa2275 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:19:24.801615 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982fe8e-15f4-4c3d-96af-7d2fa5f85747 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:24.976921 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8560474-58e2-420d-830a-e8939b9e07cf None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:24.980556 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982fe8e-15f4-4c3d-96af-7d2fa5f85747 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:25.011748 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:25.035656 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f746db-1a8a-4b3e-a12a-6c458688ce26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:25.036282 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f746db-1a8a-4b3e-a12a-6c458688ce26 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:25.036282 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f746db-1a8a-4b3e-a12a-6c458688ce26 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:25.036282 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f746db-1a8a-4b3e-a12a-6c458688ce26 None admin] PATH_INFO: `/v3/groups/ca53ecb8803442a984ae582b41bf65e0` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:25.037642 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f746db-1a8a-4b3e-a12a-6c458688ce26 None admin] RBAC: Authorizing `identity:get_group(group_id=ca53ecb8803442a984ae582b41bf65e0)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:25.039142 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f746db-1a8a-4b3e-a12a-6c458688ce26 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:25.039249 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025223f1-af1a-4da3-be97-6d35607ae88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:25.039910 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025223f1-af1a-4da3-be97-6d35607ae88d None admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:25.040199 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025223f1-af1a-4da3-be97-6d35607ae88d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:25.040481 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025223f1-af1a-4da3-be97-6d35607ae88d None admin] PATH_INFO: `/v3/projects/590e1563f57b4a089845f805f9cb48c1/groups/ca53ecb8803442a984ae582b41bf65e0/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:25.041049 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 207/398] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 14:19:24 2022] GET /identity/v3/groups/ca53ecb8803442a984ae582b41bf65e0 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:25.043262 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025223f1-af1a-4da3-be97-6d35607ae88d None admin] RBAC: Authorizing `identity:create_grant(project_id=590e1563f57b4a089845f805f9cb48c1, group_id=ca53ecb8803442a984ae582b41bf65e0, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:25.044692 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025223f1-af1a-4da3-be97-6d35607ae88d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:25.049399 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f746db-1a8a-4b3e-a12a-6c458688ce26 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:25.120606 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 192/399] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Aug 24 14:19:24 2022] PUT /identity/v3/projects/590e1563f57b4a089845f805f9cb48c1/groups/ca53ecb8803442a984ae582b41bf65e0/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:19:25.177890 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f746db-1a8a-4b3e-a12a-6c458688ce26 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:25.218343 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641b295-e5e5-49fd-94b0-23269526fbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:25.219472 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641b295-e5e5-49fd-94b0-23269526fbc7 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:25.220013 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641b295-e5e5-49fd-94b0-23269526fbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:25.220463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641b295-e5e5-49fd-94b0-23269526fbc7 None admin] PATH_INFO: `/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:25.222046 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641b295-e5e5-49fd-94b0-23269526fbc7 None admin] RBAC: Authorizing `identity:get_project(project_id=fedc7eace6da4d0e82c913b2b5c17e17)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:25.223764 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641b295-e5e5-49fd-94b0-23269526fbc7 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:25.225735 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 208/400] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:19:25 2022] GET /identity/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:25.231764 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025223f1-af1a-4da3-be97-6d35607ae88d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:25.316181 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:25.390388 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025223f1-af1a-4da3-be97-6d35607ae88d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:25.438066 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426b6b5-d51d-4b3d-abb2-c0e5fab25b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:25.439081 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426b6b5-d51d-4b3d-abb2-c0e5fab25b1d None admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:25.439510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426b6b5-d51d-4b3d-abb2-c0e5fab25b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:25.439930 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426b6b5-d51d-4b3d-abb2-c0e5fab25b1d None admin] PATH_INFO: `/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17/groups/ca53ecb8803442a984ae582b41bf65e0/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:25.442047 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426b6b5-d51d-4b3d-abb2-c0e5fab25b1d None admin] RBAC: Authorizing `identity:create_grant(project_id=fedc7eace6da4d0e82c913b2b5c17e17, group_id=ca53ecb8803442a984ae582b41bf65e0, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:25.443631 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426b6b5-d51d-4b3d-abb2-c0e5fab25b1d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:25.643600 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 193/401] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Aug 24 14:19:25 2022] PUT /identity/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17/groups/ca53ecb8803442a984ae582b41bf65e0/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:19:26.067738 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c52d9-2cb0-40d5-a963-c2ca7a780f48 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:26.068244 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c52d9-2cb0-40d5-a963-c2ca7a780f48 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:26.068319 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c52d9-2cb0-40d5-a963-c2ca7a780f48 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:26.069671 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 209/402] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:26.075168 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e74a99-b0d4-4b07-9f6e-7cacf137c0ca None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:26.075451 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e74a99-b0d4-4b07-9f6e-7cacf137c0ca None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:26.075722 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e74a99-b0d4-4b07-9f6e-7cacf137c0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:26.096485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-35e74a99-b0d4-4b07-9f6e-7cacf137c0ca None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:26.096790 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723e685-57ef-4958-8a6b-9a7ec2baa8a0 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:26.097065 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723e685-57ef-4958-8a6b-9a7ec2baa8a0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:26.097341 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723e685-57ef-4958-8a6b-9a7ec2baa8a0 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:26.097711 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-35e74a99-b0d4-4b07-9f6e-7cacf137c0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:26.098966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 210/403] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:26.104338 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c09dd8-c84e-465f-b287-2002e94558e3 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:26.104748 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c09dd8-c84e-465f-b287-2002e94558e3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:26.105032 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c09dd8-c84e-465f-b287-2002e94558e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:26.143286 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d2c09dd8-c84e-465f-b287-2002e94558e3 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:26.144933 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d2c09dd8-c84e-465f-b287-2002e94558e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:26.188493 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 194/404] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:26.228253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:26.252297 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 211/405] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:19:26.699257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e74a99-b0d4-4b07-9f6e-7cacf137c0ca None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:26.736750 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:26.747777 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c09dd8-c84e-465f-b287-2002e94558e3 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:26.886881 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e74a99-b0d4-4b07-9f6e-7cacf137c0ca None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:26.913933 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c09dd8-c84e-465f-b287-2002e94558e3 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:26.942478 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1653dc-73a5-44e1-8a77-c9bb82261b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:26.943127 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1653dc-73a5-44e1-8a77-c9bb82261b71 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:26.943410 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1653dc-73a5-44e1-8a77-c9bb82261b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:26.943686 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1653dc-73a5-44e1-8a77-c9bb82261b71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:26.957511 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9dce6-f25b-46dc-bef4-527d7972573a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:26.958101 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9dce6-f25b-46dc-bef4-527d7972573a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:26.958377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9dce6-f25b-46dc-bef4-527d7972573a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:26.958645 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9dce6-f25b-46dc-bef4-527d7972573a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:26.959943 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1653dc-73a5-44e1-8a77-c9bb82261b71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:26.964676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-2b1653dc-73a5-44e1-8a77-c9bb82261b71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:19:26.964676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:26.964676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:26.964676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:26.964676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:26.964676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:26.964676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:26.964676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:26.964676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:26.964676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:26.964676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:26.964676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:26.964676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:26.964676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:26.964676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:26.964676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:26.965533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:26.965533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:26.965533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:26.965533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:26.965533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:26.965533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:26.965533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:26.965533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:26.965533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:26.965533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:26.965533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:26.965533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:26.965533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:26.965533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:26.965533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:26.965533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:26.966349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:26.966349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:26.966349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:26.966349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:26.966349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:26.966349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:26.966349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:26.966349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:26.966349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:26.966349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:26.966349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:19:26.966349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:26.966349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 195/406] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:19:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:26.973665 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1653dc-73a5-44e1-8a77-c9bb82261b71 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:26.991471 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9dce6-f25b-46dc-bef4-527d7972573a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:26.996839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-0fe9dce6-f25b-46dc-bef4-527d7972573a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:19:26.996839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:26.996839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:26.996839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:26.996839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:26.996839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:26.996839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:26.996839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:26.996839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:26.996839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:26.996839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:26.996839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:26.996839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:26.996839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:26.996839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:26.996839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:26.997728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:26.997728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:26.997728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:26.997728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:26.997728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:26.997728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:26.997728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:26.997728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:26.997728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:26.997728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:26.997728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:26.997728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:26.997728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:26.997728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:26.997728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:26.997728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:26.999214 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:26.999214 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:26.999214 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:26.999214 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:26.999214 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:26.999214 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:26.999214 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:26.999214 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:26.999214 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:26.999214 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:26.999214 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:19:26.999214 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:27.002135 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 212/407] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 14:19:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:27.008144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9dce6-f25b-46dc-bef4-527d7972573a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:27.078542 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:27.132330 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9dce6-f25b-46dc-bef4-527d7972573a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:27.139834 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:27.155180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1653dc-73a5-44e1-8a77-c9bb82261b71 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:27.183805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e72a0-7448-4b29-8057-280b93db4340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:27.184763 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e72a0-7448-4b29-8057-280b93db4340 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:27.185454 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e72a0-7448-4b29-8057-280b93db4340 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:27.185911 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e72a0-7448-4b29-8057-280b93db4340 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:27.188330 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e72a0-7448-4b29-8057-280b93db4340 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:27.188937 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e72a0-7448-4b29-8057-280b93db4340 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:27.191334 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e72a0-7448-4b29-8057-280b93db4340 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:27.199653 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b8b56-d85d-494d-a0e5-0bc58a9c2d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:27.200444 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b8b56-d85d-494d-a0e5-0bc58a9c2d5c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:27.200818 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b8b56-d85d-494d-a0e5-0bc58a9c2d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:27.201259 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b8b56-d85d-494d-a0e5-0bc58a9c2d5c None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:27.202314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b8b56-d85d-494d-a0e5-0bc58a9c2d5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:27.202724 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b8b56-d85d-494d-a0e5-0bc58a9c2d5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:27.204068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 213/408] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:19:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:27.205619 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c99101-1786-4b14-aee4-d41882680b39 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:27.206047 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c99101-1786-4b14-aee4-d41882680b39 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:27.206442 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c99101-1786-4b14-aee4-d41882680b39 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:27.207811 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 214/409] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:27.212122 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b8b56-d85d-494d-a0e5-0bc58a9c2d5c None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:27.213651 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c99101-1786-4b14-aee4-d41882680b39 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:27.221081 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 196/410] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:19:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:27.226888 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1d809-42b1-40a5-8877-b15f8bbcc52a None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:27.227276 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1d809-42b1-40a5-8877-b15f8bbcc52a None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:27.228091 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1d809-42b1-40a5-8877-b15f8bbcc52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:27.247506 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-66a1d809-42b1-40a5-8877-b15f8bbcc52a None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:27.249082 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-66a1d809-42b1-40a5-8877-b15f8bbcc52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:27.331540 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 197/411] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:27.332782 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1d809-42b1-40a5-8877-b15f8bbcc52a None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:27.367864 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c99101-1786-4b14-aee4-d41882680b39 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:27.385703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:27.439167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82df68-c9e0-44c5-a0a8-743297f63ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:27.440389 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82df68-c9e0-44c5-a0a8-743297f63ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:27.441626 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82df68-c9e0-44c5-a0a8-743297f63ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:27.442980 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82df68-c9e0-44c5-a0a8-743297f63ae6 None admin] PATH_INFO: `/v3/groups/ca53ecb8803442a984ae582b41bf65e0` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:27.446722 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82df68-c9e0-44c5-a0a8-743297f63ae6 None admin] RBAC: Authorizing `identity:get_group(group_id=ca53ecb8803442a984ae582b41bf65e0)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:27.448458 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82df68-c9e0-44c5-a0a8-743297f63ae6 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:27.456984 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 215/412] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 14:19:27 2022] GET /identity/v3/groups/ca53ecb8803442a984ae582b41bf65e0 => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:27.459303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82df68-c9e0-44c5-a0a8-743297f63ae6 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:27.485398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:27.506285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1d809-42b1-40a5-8877-b15f8bbcc52a None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:27.544079 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba7dcb-ec23-41e2-9657-91f9fe72825f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:27.544807 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba7dcb-ec23-41e2-9657-91f9fe72825f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:27.545161 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba7dcb-ec23-41e2-9657-91f9fe72825f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:27.546195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba7dcb-ec23-41e2-9657-91f9fe72825f None admin] PATH_INFO: `/v3/groups/4419caed7cfb48388a92af7cd961caad` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:27.547518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba7dcb-ec23-41e2-9657-91f9fe72825f None admin] RBAC: Authorizing `identity:get_group(group_id=4419caed7cfb48388a92af7cd961caad)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:27.549141 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba7dcb-ec23-41e2-9657-91f9fe72825f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:27.550907 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 198/413] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 14:19:27 2022] GET /identity/v3/groups/4419caed7cfb48388a92af7cd961caad => generated 229 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:27.552224 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95480562-e55f-4f26-859f-133cd0fa7511 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:27.552581 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95480562-e55f-4f26-859f-133cd0fa7511 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:27.552925 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95480562-e55f-4f26-859f-133cd0fa7511 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:27.558540 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 199/414] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:27.559717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95480562-e55f-4f26-859f-133cd0fa7511 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:27.592084 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82df68-c9e0-44c5-a0a8-743297f63ae6 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:27.637733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc5578-2e6d-4cb8-9aa0-3a9008795b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:27.637987 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc5578-2e6d-4cb8-9aa0-3a9008795b9d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:27.638065 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc5578-2e6d-4cb8-9aa0-3a9008795b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:27.638498 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc5578-2e6d-4cb8-9aa0-3a9008795b9d None admin] PATH_INFO: `/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:27.639784 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc5578-2e6d-4cb8-9aa0-3a9008795b9d None admin] RBAC: Authorizing `identity:get_project(project_id=fedc7eace6da4d0e82c913b2b5c17e17)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:27.641403 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc5578-2e6d-4cb8-9aa0-3a9008795b9d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:27.643187 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 216/415] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:19:27 2022] GET /identity/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:27.644433 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa091835-5f6d-4db4-99e9-65fa04309a55 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:27.644784 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa091835-5f6d-4db4-99e9-65fa04309a55 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:27.645450 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa091835-5f6d-4db4-99e9-65fa04309a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:27.664752 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-aa091835-5f6d-4db4-99e9-65fa04309a55 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:27.666109 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-aa091835-5f6d-4db4-99e9-65fa04309a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:27.675239 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95480562-e55f-4f26-859f-133cd0fa7511 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:27.707577 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:27.712858 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200cf5b-07bb-4ca7-8ba5-9f29cfabe595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:27.713490 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200cf5b-07bb-4ca7-8ba5-9f29cfabe595 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:27.713860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200cf5b-07bb-4ca7-8ba5-9f29cfabe595 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:27.714137 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200cf5b-07bb-4ca7-8ba5-9f29cfabe595 None admin] PATH_INFO: `/v3/projects/4f4410563d8b45fea6a29fd68277b77c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:27.715270 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b200cf5b-07bb-4ca7-8ba5-9f29cfabe595 None admin] RBAC: Authorizing `identity:get_project(project_id=4f4410563d8b45fea6a29fd68277b77c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:27.716865 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b200cf5b-07bb-4ca7-8ba5-9f29cfabe595 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:27.724095 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 200/416] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:19:27 2022] GET /identity/v3/projects/4f4410563d8b45fea6a29fd68277b77c => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:27.724095 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200cf5b-07bb-4ca7-8ba5-9f29cfabe595 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:27.753775 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 217/417] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:27.753775 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa091835-5f6d-4db4-99e9-65fa04309a55 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:27.754922 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:27.862506 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa091835-5f6d-4db4-99e9-65fa04309a55 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:27.869145 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200cf5b-07bb-4ca7-8ba5-9f29cfabe595 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:27.905132 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c274ac-e4c7-489a-b435-412b9c6aa859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:27.905910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c274ac-e4c7-489a-b435-412b9c6aa859 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:27.906247 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c274ac-e4c7-489a-b435-412b9c6aa859 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:27.906588 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c274ac-e4c7-489a-b435-412b9c6aa859 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:27.907531 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb857f44-73e7-4e75-9d0f-572b3d77fc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:27.908267 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb857f44-73e7-4e75-9d0f-572b3d77fc4f None admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:27.908795 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb857f44-73e7-4e75-9d0f-572b3d77fc4f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:27.909058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb857f44-73e7-4e75-9d0f-572b3d77fc4f None admin] PATH_INFO: `/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17/groups/ca53ecb8803442a984ae582b41bf65e0/roles/eb8377ab1ad14341a780bc4acdfa2275` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:27.913975 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb857f44-73e7-4e75-9d0f-572b3d77fc4f None admin] RBAC: Authorizing `identity:create_grant(project_id=fedc7eace6da4d0e82c913b2b5c17e17, group_id=ca53ecb8803442a984ae582b41bf65e0, role_id=eb8377ab1ad14341a780bc4acdfa2275)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:27.915522 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb857f44-73e7-4e75-9d0f-572b3d77fc4f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:27.920124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c274ac-e4c7-489a-b435-412b9c6aa859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:27.925019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-b2c274ac-e4c7-489a-b435-412b9c6aa859 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:19:27.925019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:27.925019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:27.925019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:27.925019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:27.925019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:27.925019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:27.925019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:27.925019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:27.925019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:27.925019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:27.925019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:27.925019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:27.925019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:27.925019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:27.925019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:27.926289 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:27.926289 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:27.926289 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:27.926289 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:27.926289 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:27.926289 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:27.926289 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:27.926289 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:27.926289 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:27.926289 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:27.926289 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:27.926289 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:27.926289 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:27.926289 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:27.926289 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:27.926289 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:27.927425 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:27.927425 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:27.927425 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:27.927425 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:27.927425 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:27.927425 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:27.927425 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:27.927425 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:27.927425 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:27.927425 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:27.927425 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:19:27.927425 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:27.930333 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 218/418] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 14:19:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:27.933399 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c274ac-e4c7-489a-b435-412b9c6aa859 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:27.968176 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:27.989781 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 201/419] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Aug 24 14:19:27 2022] PUT /identity/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17/groups/ca53ecb8803442a984ae582b41bf65e0/roles/eb8377ab1ad14341a780bc4acdfa2275 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:19:27.989781 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb857f44-73e7-4e75-9d0f-572b3d77fc4f None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:28.088500 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c274ac-e4c7-489a-b435-412b9c6aa859 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:28.103506 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:28.131174 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb857f44-73e7-4e75-9d0f-572b3d77fc4f None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:28.131553 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d81d55-4702-47c4-92c6-5da747409e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:28.132433 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d81d55-4702-47c4-92c6-5da747409e47 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:28.132890 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d81d55-4702-47c4-92c6-5da747409e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:28.133512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d81d55-4702-47c4-92c6-5da747409e47 None admin] PATH_INFO: `/v3/projects/4f4410563d8b45fea6a29fd68277b77c/groups/4419caed7cfb48388a92af7cd961caad/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:28.135566 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d81d55-4702-47c4-92c6-5da747409e47 None admin] RBAC: Authorizing `identity:create_grant(project_id=4f4410563d8b45fea6a29fd68277b77c, group_id=4419caed7cfb48388a92af7cd961caad, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:28.137040 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d81d55-4702-47c4-92c6-5da747409e47 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:28.167387 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add4840-eb89-4058-89cf-1aaac1034638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:28.167994 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add4840-eb89-4058-89cf-1aaac1034638 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:28.168313 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add4840-eb89-4058-89cf-1aaac1034638 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:28.168583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add4840-eb89-4058-89cf-1aaac1034638 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:28.169249 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add4840-eb89-4058-89cf-1aaac1034638 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:28.169548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add4840-eb89-4058-89cf-1aaac1034638 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:28.171784 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add4840-eb89-4058-89cf-1aaac1034638 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:28.180348 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 202/420] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:19:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:28.180968 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add4840-eb89-4058-89cf-1aaac1034638 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:28.201312 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 219/421] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Aug 24 14:19:27 2022] PUT /identity/v3/projects/4f4410563d8b45fea6a29fd68277b77c/groups/4419caed7cfb48388a92af7cd961caad/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:19:28.202868 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c62a68-09d4-4c48-9085-e66d7156a4bf None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:28.203222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c62a68-09d4-4c48-9085-e66d7156a4bf None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:28.203499 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c62a68-09d4-4c48-9085-e66d7156a4bf None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:28.209071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 220/422] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:28.209071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c62a68-09d4-4c48-9085-e66d7156a4bf None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:28.335109 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add4840-eb89-4058-89cf-1aaac1034638 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:28.339985 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:28.352827 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c62a68-09d4-4c48-9085-e66d7156a4bf None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:28.383006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2a2dc-5e86-4cbd-ab15-e2e8b0e188bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:28.383641 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2a2dc-5e86-4cbd-ab15-e2e8b0e188bc None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:28.384181 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2a2dc-5e86-4cbd-ab15-e2e8b0e188bc None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:28.384181 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2a2dc-5e86-4cbd-ab15-e2e8b0e188bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:28.394875 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:28.398819 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fbbf5-e71f-47fa-879f-0c73da0c73e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:28.399529 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fbbf5-e71f-47fa-879f-0c73da0c73e8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:28.400135 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fbbf5-e71f-47fa-879f-0c73da0c73e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:28.400421 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fbbf5-e71f-47fa-879f-0c73da0c73e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:28.400722 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e2a2dc-5e86-4cbd-ab15-e2e8b0e188bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:28.406942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-08e2a2dc-5e86-4cbd-ab15-e2e8b0e188bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:19:28.406942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:28.406942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:28.406942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:28.406942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:28.406942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:28.406942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:28.406942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:28.406942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:28.406942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:28.406942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:28.406942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:28.406942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:28.406942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:28.406942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:28.406942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:28.407840 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:28.407840 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:28.407840 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:28.407840 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:28.407840 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:28.407840 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:28.407840 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:28.407840 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:28.407840 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:28.407840 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:28.407840 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:28.407840 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:28.407840 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:28.407840 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:28.407840 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:28.407840 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:28.409040 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:28.409040 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:28.409040 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:28.409040 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:28.409040 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:28.409040 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:28.409040 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:28.409040 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:28.409040 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:28.409040 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:28.409040 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:19:28.409040 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:28.409040 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 203/423] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:19:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:28.409695 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96f19d-b351-4983-917b-0c89abbbff8e None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:28.410012 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96f19d-b351-4983-917b-0c89abbbff8e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:28.410183 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96f19d-b351-4983-917b-0c89abbbff8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:28.435124 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ab96f19d-b351-4983-917b-0c89abbbff8e None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:28.436422 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ab96f19d-b351-4983-917b-0c89abbbff8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:28.495839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953fbbf5-e71f-47fa-879f-0c73da0c73e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:28.498138 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953fbbf5-e71f-47fa-879f-0c73da0c73e8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:28.511752 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 204/424] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:28.512748 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96f19d-b351-4983-917b-0c89abbbff8e None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:28.608893 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:28.618391 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 221/425] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:19:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:19:28.624481 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fbbf5-e71f-47fa-879f-0c73da0c73e8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:28.733636 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96f19d-b351-4983-917b-0c89abbbff8e None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:28.782146 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fbbf5-e71f-47fa-879f-0c73da0c73e8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:28.789000 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:28.805223 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3426609-0f1f-49b3-aa99-504286a2d1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:28.808594 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3426609-0f1f-49b3-aa99-504286a2d1db None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:28.808594 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3426609-0f1f-49b3-aa99-504286a2d1db None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:28.808594 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3426609-0f1f-49b3-aa99-504286a2d1db None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:28.808594 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3426609-0f1f-49b3-aa99-504286a2d1db None admin] RBAC: Adding query filter params (name=member) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:28.808594 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3426609-0f1f-49b3-aa99-504286a2d1db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:28.809130 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3426609-0f1f-49b3-aa99-504286a2d1db None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:28.821890 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 205/426] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 14:19:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:28.824218 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3426609-0f1f-49b3-aa99-504286a2d1db None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:28.852890 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571eb294-20f0-499b-996e-fd0ed2adafca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:28.853533 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571eb294-20f0-499b-996e-fd0ed2adafca None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:28.853868 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571eb294-20f0-499b-996e-fd0ed2adafca None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:28.854108 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571eb294-20f0-499b-996e-fd0ed2adafca None admin] PATH_INFO: `/v3/projects/590e1563f57b4a089845f805f9cb48c1` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:28.855387 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571eb294-20f0-499b-996e-fd0ed2adafca None admin] RBAC: Authorizing `identity:get_project(project_id=590e1563f57b4a089845f805f9cb48c1)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:28.856825 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571eb294-20f0-499b-996e-fd0ed2adafca None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:28.859388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 222/427] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:19:28 2022] GET /identity/v3/projects/590e1563f57b4a089845f805f9cb48c1 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:28.859763 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571eb294-20f0-499b-996e-fd0ed2adafca None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:28.945729 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:28.955036 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3426609-0f1f-49b3-aa99-504286a2d1db None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:28.996575 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571eb294-20f0-499b-996e-fd0ed2adafca None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:29.002445 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935ec13-caba-4280-b114-c3efd9a7fc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:29.003099 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935ec13-caba-4280-b114-c3efd9a7fc30 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:29.003375 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935ec13-caba-4280-b114-c3efd9a7fc30 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:29.003686 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935ec13-caba-4280-b114-c3efd9a7fc30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:29.034505 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfa059-8e05-4e8f-aa7f-e60a856ad101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:29.035462 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfa059-8e05-4e8f-aa7f-e60a856ad101 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:29.035939 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfa059-8e05-4e8f-aa7f-e60a856ad101 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:29.036403 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfa059-8e05-4e8f-aa7f-e60a856ad101 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:29.047546 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdfa059-8e05-4e8f-aa7f-e60a856ad101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:29.052621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-5fdfa059-8e05-4e8f-aa7f-e60a856ad101 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:19:29.052621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:29.052621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:29.052621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:29.052621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:29.052621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:29.052621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:29.052621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:29.052621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:29.052621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:29.052621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:29.052621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:29.052621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:29.052621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:29.052621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:29.052621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:29.053470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:29.053470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:29.053470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:29.053470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:29.053470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:29.053470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:29.053470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:29.053470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:29.053470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:29.053470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:29.053470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:29.053470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:29.053470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:29.053470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:29.053470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:29.053470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:29.054472 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:29.054472 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:29.054472 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:29.054472 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:29.054472 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:29.054472 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:29.054472 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:29.054472 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:29.054472 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:29.054472 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:29.054472 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:19:29.054472 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:29.061370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 223/428] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:19:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:29.062406 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfa059-8e05-4e8f-aa7f-e60a856ad101 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:29.067089 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:29.078917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935ec13-caba-4280-b114-c3efd9a7fc30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:29.083155 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935ec13-caba-4280-b114-c3efd9a7fc30 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:29.167972 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfa059-8e05-4e8f-aa7f-e60a856ad101 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:29.193270 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:29.193506 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 206/429] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:19:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 14:19:29.195224 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935ec13-caba-4280-b114-c3efd9a7fc30 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:29.205016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3f567-d13e-4591-804c-ee5b8acacaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:29.206194 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3f567-d13e-4591-804c-ee5b8acacaa4 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:29.206194 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3f567-d13e-4591-804c-ee5b8acacaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:29.206386 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3f567-d13e-4591-804c-ee5b8acacaa4 None admin] PATH_INFO: `/v3/groups/ca53ecb8803442a984ae582b41bf65e0` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:29.207412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3f567-d13e-4591-804c-ee5b8acacaa4 None admin] RBAC: Authorizing `identity:get_group(group_id=ca53ecb8803442a984ae582b41bf65e0)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:29.208857 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3f567-d13e-4591-804c-ee5b8acacaa4 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:29.211268 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 224/430] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 14:19:29 2022] GET /identity/v3/groups/ca53ecb8803442a984ae582b41bf65e0 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:29.212046 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3f567-d13e-4591-804c-ee5b8acacaa4 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:29.292468 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:29.308211 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935ec13-caba-4280-b114-c3efd9a7fc30 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:29.319214 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3f567-d13e-4591-804c-ee5b8acacaa4 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:29.355318 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313c89f-280a-415a-996b-628c313037fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:29.356195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313c89f-280a-415a-996b-628c313037fd None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:29.356629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313c89f-280a-415a-996b-628c313037fd None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:29.357063 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313c89f-280a-415a-996b-628c313037fd None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:29.358110 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313c89f-280a-415a-996b-628c313037fd None admin] RBAC: Adding query filter params (name=member) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:29.358436 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34ac60-a92e-400f-8f82-8ed00c102b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:29.358848 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313c89f-280a-415a-996b-628c313037fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:29.359218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34ac60-a92e-400f-8f82-8ed00c102b3a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:29.359566 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34ac60-a92e-400f-8f82-8ed00c102b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:29.359914 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34ac60-a92e-400f-8f82-8ed00c102b3a None admin] PATH_INFO: `/v3/projects/590e1563f57b4a089845f805f9cb48c1` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:29.360914 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313c89f-280a-415a-996b-628c313037fd None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:29.361255 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34ac60-a92e-400f-8f82-8ed00c102b3a None admin] RBAC: Authorizing `identity:get_project(project_id=590e1563f57b4a089845f805f9cb48c1)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:29.362892 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34ac60-a92e-400f-8f82-8ed00c102b3a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:29.365041 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 225/431] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:19:29 2022] GET /identity/v3/projects/590e1563f57b4a089845f805f9cb48c1 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:29.365938 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34ac60-a92e-400f-8f82-8ed00c102b3a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:29.372274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 207/432] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 14:19:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:29.373311 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313c89f-280a-415a-996b-628c313037fd None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:29.454820 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:29.498113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313c89f-280a-415a-996b-628c313037fd None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:29.516647 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34ac60-a92e-400f-8f82-8ed00c102b3a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:29.535422 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416a259-de90-4cc5-bb2b-990d8bb88e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:29.536267 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416a259-de90-4cc5-bb2b-990d8bb88e0f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:29.536707 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416a259-de90-4cc5-bb2b-990d8bb88e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:29.537176 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416a259-de90-4cc5-bb2b-990d8bb88e0f None admin] PATH_INFO: `/v3/groups/ca53ecb8803442a984ae582b41bf65e0` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:29.538622 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416a259-de90-4cc5-bb2b-990d8bb88e0f None admin] RBAC: Authorizing `identity:get_group(group_id=ca53ecb8803442a984ae582b41bf65e0)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:29.540238 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416a259-de90-4cc5-bb2b-990d8bb88e0f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:29.542369 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 208/433] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 14:19:29 2022] GET /identity/v3/groups/ca53ecb8803442a984ae582b41bf65e0 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:29.543401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416a259-de90-4cc5-bb2b-990d8bb88e0f None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:29.561890 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ffc0a-ab02-4d39-8a3c-a14f879d26a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:29.562638 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ffc0a-ab02-4d39-8a3c-a14f879d26a5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:29.563005 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ffc0a-ab02-4d39-8a3c-a14f879d26a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:29.563366 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ffc0a-ab02-4d39-8a3c-a14f879d26a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:29.564440 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ffc0a-ab02-4d39-8a3c-a14f879d26a5 None admin] RBAC: Adding query filter params (group.id=ca53ecb8803442a984ae582b41bf65e0, role.id=eb8377ab1ad14341a780bc4acdfa2275, scope.project.id=590e1563f57b4a089845f805f9cb48c1) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:29.564842 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ffc0a-ab02-4d39-8a3c-a14f879d26a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:29.566799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ffc0a-ab02-4d39-8a3c-a14f879d26a5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:29.568998 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:29.577139 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 226/434] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Aug 24 14:19:29 2022] GET /identity/v3/role_assignments?group.id=ca53ecb8803442a984ae582b41bf65e0&scope.project.id=590e1563f57b4a089845f805f9cb48c1&role.id=eb8377ab1ad14341a780bc4acdfa2275 => generated 611 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:29.579145 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ffc0a-ab02-4d39-8a3c-a14f879d26a5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:29.707641 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ffc0a-ab02-4d39-8a3c-a14f879d26a5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:29.736938 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:29.746026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416a259-de90-4cc5-bb2b-990d8bb88e0f None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:29.752597 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd59ab9-df9d-4fb7-ad9a-3961cb020755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:29.753452 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd59ab9-df9d-4fb7-ad9a-3961cb020755 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:29.753928 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd59ab9-df9d-4fb7-ad9a-3961cb020755 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:29.754370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd59ab9-df9d-4fb7-ad9a-3961cb020755 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:29.755512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd59ab9-df9d-4fb7-ad9a-3961cb020755 None admin] RBAC: Adding query filter params (group.id=ca53ecb8803442a984ae582b41bf65e0, role.id=a5c4bcef93884b89bf10b2f011d880c8, scope.project.id=590e1563f57b4a089845f805f9cb48c1) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:29.755978 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd59ab9-df9d-4fb7-ad9a-3961cb020755 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:29.758262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd59ab9-df9d-4fb7-ad9a-3961cb020755 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:29.766202 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 227/435] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Aug 24 14:19:29 2022] GET /identity/v3/role_assignments?group.id=ca53ecb8803442a984ae582b41bf65e0&scope.project.id=590e1563f57b4a089845f805f9cb48c1&role.id=a5c4bcef93884b89bf10b2f011d880c8 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:29.799738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cd9f4-b7ee-49f5-9f59-164072be873c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:29.800372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cd9f4-b7ee-49f5-9f59-164072be873c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:29.800771 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cd9f4-b7ee-49f5-9f59-164072be873c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:29.801050 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cd9f4-b7ee-49f5-9f59-164072be873c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:29.885610 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913cd9f4-b7ee-49f5-9f59-164072be873c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:29.887184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913cd9f4-b7ee-49f5-9f59-164072be873c None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:29.911757 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:29.970606 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcfdf0-dcb4-40da-bd4c-07d58dbc9c79 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:29.971208 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcfdf0-dcb4-40da-bd4c-07d58dbc9c79 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:29.971697 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcfdf0-dcb4-40da-bd4c-07d58dbc9c79 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:29.973220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 228/436] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:29.979023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c91c1-cb86-41c6-ad45-f1d2125ae3f7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:29.979302 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c91c1-cb86-41c6-ad45-f1d2125ae3f7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:29.979575 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c91c1-cb86-41c6-ad45-f1d2125ae3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:29.999933 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 209/437] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:19:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:19:30.005708 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cd9f4-b7ee-49f5-9f59-164072be873c None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:30.018125 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b18c91c1-cb86-41c6-ad45-f1d2125ae3f7 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:30.019351 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b18c91c1-cb86-41c6-ad45-f1d2125ae3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:30.099014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 229/438] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:30.127551 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cd9f4-b7ee-49f5-9f59-164072be873c None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:30.150665 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:30.171496 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370d615-789f-4f5a-9159-bc564e4a7034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:30.172136 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370d615-789f-4f5a-9159-bc564e4a7034 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:30.172415 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370d615-789f-4f5a-9159-bc564e4a7034 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:30.172687 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370d615-789f-4f5a-9159-bc564e4a7034 None admin] PATH_INFO: `/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:30.173889 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370d615-789f-4f5a-9159-bc564e4a7034 None admin] RBAC: Authorizing `identity:get_project(project_id=fedc7eace6da4d0e82c913b2b5c17e17)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:30.175312 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370d615-789f-4f5a-9159-bc564e4a7034 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:30.177162 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 210/439] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:19:30 2022] GET /identity/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:30.182604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c91c1-cb86-41c6-ad45-f1d2125ae3f7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:30.293418 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c91c1-cb86-41c6-ad45-f1d2125ae3f7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:30.310949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:30.330028 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35821d-92d1-447e-b272-81eaa46ac1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:30.340337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35821d-92d1-447e-b272-81eaa46ac1aa None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:30.340337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35821d-92d1-447e-b272-81eaa46ac1aa None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:30.340337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35821d-92d1-447e-b272-81eaa46ac1aa None admin] PATH_INFO: `/v3/groups/ca53ecb8803442a984ae582b41bf65e0` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:30.340337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35821d-92d1-447e-b272-81eaa46ac1aa None admin] RBAC: Authorizing `identity:get_group(group_id=ca53ecb8803442a984ae582b41bf65e0)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:30.340337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35821d-92d1-447e-b272-81eaa46ac1aa None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:30.340337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 230/440] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 14:19:30 2022] GET /identity/v3/groups/ca53ecb8803442a984ae582b41bf65e0 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:30.341284 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370d615-789f-4f5a-9159-bc564e4a7034 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:30.366431 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb49a9-83df-4350-83b3-1d92c980e7dc None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:30.366764 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb49a9-83df-4350-83b3-1d92c980e7dc None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:30.366989 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb49a9-83df-4350-83b3-1d92c980e7dc None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:30.368590 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 231/441] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:30.369316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb49a9-83df-4350-83b3-1d92c980e7dc None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:30.467404 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370d615-789f-4f5a-9159-bc564e4a7034 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:30.493075 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb49a9-83df-4350-83b3-1d92c980e7dc None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:30.503830 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623595da-858b-42d9-90f6-ea2cca3a0057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:30.504427 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623595da-858b-42d9-90f6-ea2cca3a0057 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:30.504959 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623595da-858b-42d9-90f6-ea2cca3a0057 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:30.505227 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623595da-858b-42d9-90f6-ea2cca3a0057 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:30.505980 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623595da-858b-42d9-90f6-ea2cca3a0057 None admin] RBAC: Adding query filter params (group.id=ca53ecb8803442a984ae582b41bf65e0, role.id=a5c4bcef93884b89bf10b2f011d880c8, scope.project.id=fedc7eace6da4d0e82c913b2b5c17e17) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:30.506286 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623595da-858b-42d9-90f6-ea2cca3a0057 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:30.507711 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623595da-858b-42d9-90f6-ea2cca3a0057 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:30.513434 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 211/442] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Aug 24 14:19:30 2022] GET /identity/v3/role_assignments?group.id=ca53ecb8803442a984ae582b41bf65e0&scope.project.id=fedc7eace6da4d0e82c913b2b5c17e17&role.id=a5c4bcef93884b89bf10b2f011d880c8 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:30.514968 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f54dea-1938-4ad8-af12-f7ee531d1e51 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:30.515192 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f54dea-1938-4ad8-af12-f7ee531d1e51 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:30.515463 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f54dea-1938-4ad8-af12-f7ee531d1e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:30.535105 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-84f54dea-1938-4ad8-af12-f7ee531d1e51 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:30.535409 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b2774-7b5f-4c72-9338-ab076e8d62ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:30.536036 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b2774-7b5f-4c72-9338-ab076e8d62ab None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:30.536315 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b2774-7b5f-4c72-9338-ab076e8d62ab None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:30.536502 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-84f54dea-1938-4ad8-af12-f7ee531d1e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:30.536598 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b2774-7b5f-4c72-9338-ab076e8d62ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:30.550295 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b2774-7b5f-4c72-9338-ab076e8d62ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:30.555368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-339b2774-7b5f-4c72-9338-ab076e8d62ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:19:30.555368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:30.555368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:30.555368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:30.555368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:30.555368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:30.555368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:30.555368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:30.555368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:30.555368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:30.555368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:30.555368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:30.555368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:30.555368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:30.555368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:30.555368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:30.556275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:30.556275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:30.556275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:30.556275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:30.556275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:30.556275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:30.556275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:30.556275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:30.556275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:30.556275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:30.556275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:30.556275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:30.556275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:30.556275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:30.556275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:30.556275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:30.557093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:30.557093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:30.557093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:30.557093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:30.557093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:30.557093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:30.557093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:30.557093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:30.557093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:30.557093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:30.557093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:19:30.557093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:30.557093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 232/443] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 14:19:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:30.563434 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b2774-7b5f-4c72-9338-ab076e8d62ab None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:30.594081 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:30.616163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 212/444] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:30.616362 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:30.674251 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b2774-7b5f-4c72-9338-ab076e8d62ab None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:30.710000 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959c114-7fd0-4069-97f8-8f0eb060a3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:30.710607 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959c114-7fd0-4069-97f8-8f0eb060a3ca None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:30.710888 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959c114-7fd0-4069-97f8-8f0eb060a3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:30.711160 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959c114-7fd0-4069-97f8-8f0eb060a3ca None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:30.711819 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959c114-7fd0-4069-97f8-8f0eb060a3ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:30.712118 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959c114-7fd0-4069-97f8-8f0eb060a3ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:30.713479 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959c114-7fd0-4069-97f8-8f0eb060a3ca None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:30.722267 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 233/445] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:19:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:30.727677 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f54dea-1938-4ad8-af12-f7ee531d1e51 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:30.833299 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f54dea-1938-4ad8-af12-f7ee531d1e51 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:30.870528 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b720480-a8ef-4726-9b75-dbc0e4a280ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:30.871133 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b720480-a8ef-4726-9b75-dbc0e4a280ff None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:30.871413 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b720480-a8ef-4726-9b75-dbc0e4a280ff None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:30.871682 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b720480-a8ef-4726-9b75-dbc0e4a280ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:30.892218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959c114-7fd0-4069-97f8-8f0eb060a3ca None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:30.926737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:30.945616 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b720480-a8ef-4726-9b75-dbc0e4a280ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:30.947118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b720480-a8ef-4726-9b75-dbc0e4a280ff None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:30.992215 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959c114-7fd0-4069-97f8-8f0eb060a3ca None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:30.999688 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:31.026262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153366d0-de52-49f5-af03-88e3867cd889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:31.026893 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153366d0-de52-49f5-af03-88e3867cd889 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:31.027185 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153366d0-de52-49f5-af03-88e3867cd889 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:31.027443 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153366d0-de52-49f5-af03-88e3867cd889 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:31.038350 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153366d0-de52-49f5-af03-88e3867cd889 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:31.043412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-153366d0-de52-49f5-af03-88e3867cd889 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:19:31.043412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:31.043412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:31.043412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:31.043412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:31.043412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:31.043412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:31.043412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:31.043412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:31.043412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:31.043412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:31.043412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:31.043412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:31.043412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:31.043412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:31.043412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:31.044303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:31.044303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:31.044303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:31.044303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:31.044303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:31.044303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:31.044303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:31.044303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:31.044303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:31.044303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:31.044303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:31.044303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:31.044303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:31.044303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:31.044303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:31.044303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:31.045090 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:31.045090 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:31.045090 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:31.045090 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:31.045090 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:31.045090 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:31.045090 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:31.045090 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:31.045090 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:31.045090 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:31.045090 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:19:31.045090 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:31.045090 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 234/446] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:19:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:31.046920 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 213/447] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:19:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:19:31.051466 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153366d0-de52-49f5-af03-88e3867cd889 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:31.051995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b720480-a8ef-4726-9b75-dbc0e4a280ff None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:31.131531 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:31.149639 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b720480-a8ef-4726-9b75-dbc0e4a280ff None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:31.152378 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153366d0-de52-49f5-af03-88e3867cd889 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:31.183740 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad439d72-339b-49b5-a5e9-ee0bd6b29746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:31.184355 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad439d72-339b-49b5-a5e9-ee0bd6b29746 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:31.184637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad439d72-339b-49b5-a5e9-ee0bd6b29746 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:31.184912 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad439d72-339b-49b5-a5e9-ee0bd6b29746 None admin] PATH_INFO: `/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:31.186120 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad439d72-339b-49b5-a5e9-ee0bd6b29746 None admin] RBAC: Authorizing `identity:get_project(project_id=fedc7eace6da4d0e82c913b2b5c17e17)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:31.186239 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5e101-cd13-4c0a-82a1-d1430b5cd425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:31.186736 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5e101-cd13-4c0a-82a1-d1430b5cd425 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:31.187016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5e101-cd13-4c0a-82a1-d1430b5cd425 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:31.187289 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5e101-cd13-4c0a-82a1-d1430b5cd425 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:31.187545 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad439d72-339b-49b5-a5e9-ee0bd6b29746 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:31.187948 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5e101-cd13-4c0a-82a1-d1430b5cd425 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:31.188250 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5e101-cd13-4c0a-82a1-d1430b5cd425 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:31.189158 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 214/448] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:19:31 2022] GET /identity/v3/projects/fedc7eace6da4d0e82c913b2b5c17e17 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:31.189683 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5e101-cd13-4c0a-82a1-d1430b5cd425 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:31.194576 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad439d72-339b-49b5-a5e9-ee0bd6b29746 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:31.198001 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 235/449] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:19:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:31.203820 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5e101-cd13-4c0a-82a1-d1430b5cd425 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:31.230483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:31.298785 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad439d72-339b-49b5-a5e9-ee0bd6b29746 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:31.305188 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5e101-cd13-4c0a-82a1-d1430b5cd425 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:31.332891 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e7b58-0c62-4a08-9cd7-e81e5eebebec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:31.333505 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e7b58-0c62-4a08-9cd7-e81e5eebebec None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:31.333812 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e7b58-0c62-4a08-9cd7-e81e5eebebec None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:31.334086 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e7b58-0c62-4a08-9cd7-e81e5eebebec None admin] PATH_INFO: `/v3/groups/ca53ecb8803442a984ae582b41bf65e0` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:31.335202 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e7b58-0c62-4a08-9cd7-e81e5eebebec None admin] RBAC: Authorizing `identity:get_group(group_id=ca53ecb8803442a984ae582b41bf65e0)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:31.336615 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e7b58-0c62-4a08-9cd7-e81e5eebebec None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:31.338218 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 215/450] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 14:19:31 2022] GET /identity/v3/groups/ca53ecb8803442a984ae582b41bf65e0 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:31.343458 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844c793-36db-49a6-8087-bcf00eb1e746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:31.343853 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844c793-36db-49a6-8087-bcf00eb1e746 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:31.344135 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844c793-36db-49a6-8087-bcf00eb1e746 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:31.344244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e7b58-0c62-4a08-9cd7-e81e5eebebec None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:31.344408 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844c793-36db-49a6-8087-bcf00eb1e746 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:31.362798 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:31.411963 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844c793-36db-49a6-8087-bcf00eb1e746 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:31.413334 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844c793-36db-49a6-8087-bcf00eb1e746 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:31.439569 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:31.443022 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e7b58-0c62-4a08-9cd7-e81e5eebebec None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:31.476652 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de917d4-9787-419d-9c99-5421023f218d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:31.477240 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de917d4-9787-419d-9c99-5421023f218d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:31.477515 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de917d4-9787-419d-9c99-5421023f218d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:31.477807 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de917d4-9787-419d-9c99-5421023f218d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:31.478521 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de917d4-9787-419d-9c99-5421023f218d None admin] RBAC: Adding query filter params (group.id=ca53ecb8803442a984ae582b41bf65e0, role.id=eb8377ab1ad14341a780bc4acdfa2275, scope.project.id=fedc7eace6da4d0e82c913b2b5c17e17) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:31.478930 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de917d4-9787-419d-9c99-5421023f218d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:31.480379 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de917d4-9787-419d-9c99-5421023f218d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:31.486123 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 216/451] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Aug 24 14:19:31 2022] GET /identity/v3/role_assignments?group.id=ca53ecb8803442a984ae582b41bf65e0&scope.project.id=fedc7eace6da4d0e82c913b2b5c17e17&role.id=eb8377ab1ad14341a780bc4acdfa2275 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:31.511679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 236/452] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:19:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 14:19:31.518383 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de917d4-9787-419d-9c99-5421023f218d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:31.606319 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:31.625574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de917d4-9787-419d-9c99-5421023f218d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:31.662401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ff768-0575-426d-88e5-32b64ad942ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:31.662961 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ff768-0575-426d-88e5-32b64ad942ec None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:31.663244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ff768-0575-426d-88e5-32b64ad942ec None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:31.663523 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ff768-0575-426d-88e5-32b64ad942ec None admin] PATH_INFO: `/v3/projects/4f4410563d8b45fea6a29fd68277b77c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:31.664654 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ff768-0575-426d-88e5-32b64ad942ec None admin] RBAC: Authorizing `identity:get_project(project_id=4f4410563d8b45fea6a29fd68277b77c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:31.666150 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ff768-0575-426d-88e5-32b64ad942ec None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:31.668101 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 217/453] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:19:31 2022] GET /identity/v3/projects/4f4410563d8b45fea6a29fd68277b77c => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:31.675404 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844c793-36db-49a6-8087-bcf00eb1e746 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:31.776588 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844c793-36db-49a6-8087-bcf00eb1e746 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:31.803762 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:31.811880 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f6cb9-c6bf-43a9-90c1-f6f849f7a6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:31.813734 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f6cb9-c6bf-43a9-90c1-f6f849f7a6bb None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:31.813734 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f6cb9-c6bf-43a9-90c1-f6f849f7a6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:31.813734 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f6cb9-c6bf-43a9-90c1-f6f849f7a6bb None admin] PATH_INFO: `/v3/groups/4419caed7cfb48388a92af7cd961caad` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:31.814284 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f6cb9-c6bf-43a9-90c1-f6f849f7a6bb None admin] RBAC: Authorizing `identity:get_group(group_id=4419caed7cfb48388a92af7cd961caad)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:31.815713 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f6cb9-c6bf-43a9-90c1-f6f849f7a6bb None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:31.817578 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 237/454] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 14:19:31 2022] GET /identity/v3/groups/4419caed7cfb48388a92af7cd961caad => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:31.823389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ff768-0575-426d-88e5-32b64ad942ec None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:31.922279 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ff768-0575-426d-88e5-32b64ad942ec None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:31.954579 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431653b0-cd44-4bdc-940a-bad94fe488e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:31.955171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431653b0-cd44-4bdc-940a-bad94fe488e0 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:31.955452 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431653b0-cd44-4bdc-940a-bad94fe488e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:31.955726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431653b0-cd44-4bdc-940a-bad94fe488e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:31.956445 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431653b0-cd44-4bdc-940a-bad94fe488e0 None admin] RBAC: Adding query filter params (group.id=4419caed7cfb48388a92af7cd961caad, role.id=b779073cee3c470ca4ad7a7b27d72c5e, scope.project.id=4f4410563d8b45fea6a29fd68277b77c) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:31.956754 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431653b0-cd44-4bdc-940a-bad94fe488e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:31.958220 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431653b0-cd44-4bdc-940a-bad94fe488e0 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:31.963839 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 218/455] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Aug 24 14:19:31 2022] GET /identity/v3/role_assignments?group.id=4419caed7cfb48388a92af7cd961caad&scope.project.id=4f4410563d8b45fea6a29fd68277b77c&role.id=b779073cee3c470ca4ad7a7b27d72c5e => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:34.386125 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483f0bf-41e1-42ea-a8cc-9181585c2340 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:34.387147 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483f0bf-41e1-42ea-a8cc-9181585c2340 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:34.387645 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483f0bf-41e1-42ea-a8cc-9181585c2340 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:34.390049 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 238/456] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:34.395240 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ab6f7-5b33-4d3f-bb99-181fa70439b0 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:34.396068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ab6f7-5b33-4d3f-bb99-181fa70439b0 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:34.396573 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ab6f7-5b33-4d3f-bb99-181fa70439b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:34.426738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-b46ab6f7-5b33-4d3f-bb99-181fa70439b0 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:34.428282 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b46ab6f7-5b33-4d3f-bb99-181fa70439b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:34.439151 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:34.520555 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 219/457] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:34.577148 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2e89e-badf-416a-acec-dc3179bd9ae6 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:34.577483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2e89e-badf-416a-acec-dc3179bd9ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:34.577707 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2e89e-badf-416a-acec-dc3179bd9ae6 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:34.579211 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 239/458] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:34.584452 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a812759-5fc8-4487-b97e-670680bda487 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:34.584748 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a812759-5fc8-4487-b97e-670680bda487 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:34.585023 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a812759-5fc8-4487-b97e-670680bda487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:34.610512 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-5a812759-5fc8-4487-b97e-670680bda487 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:34.611731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-5a812759-5fc8-4487-b97e-670680bda487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:34.703450 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 220/459] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:34.716564 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c77a60-3edd-4462-ad43-ce13127b0078 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:34.717843 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c77a60-3edd-4462-ad43-ce13127b0078 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:34.718464 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c77a60-3edd-4462-ad43-ce13127b0078 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:34.720260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 240/460] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:34.725096 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec714bc-af2c-46a6-8c83-42e76dcb703f None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:34.725380 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec714bc-af2c-46a6-8c83-42e76dcb703f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:34.725654 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec714bc-af2c-46a6-8c83-42e76dcb703f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:34.750408 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-bec714bc-af2c-46a6-8c83-42e76dcb703f None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:34.751651 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-bec714bc-af2c-46a6-8c83-42e76dcb703f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:34.838289 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 221/461] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:34.919059 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c77a60-3edd-4462-ad43-ce13127b0078 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:35.051432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c77a60-3edd-4462-ad43-ce13127b0078 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:35.075956 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec714bc-af2c-46a6-8c83-42e76dcb703f None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:35.090143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:35.101529 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b725b-9f85-40f4-9824-e14086bc7c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:35.102198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b725b-9f85-40f4-9824-e14086bc7c88 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:35.102478 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b725b-9f85-40f4-9824-e14086bc7c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:35.102753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b725b-9f85-40f4-9824-e14086bc7c88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:35.122316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b725b-9f85-40f4-9824-e14086bc7c88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:35.125098 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b725b-9f85-40f4-9824-e14086bc7c88 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:35.145743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-582b725b-9f85-40f4-9824-e14086bc7c88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:35.145743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:35.145743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:35.145743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:35.145743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:35.145743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:35.145743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:35.145743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:35.145743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:35.145743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:35.145743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:35.145743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:35.145743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:35.145743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:35.145743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:35.145743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:35.146726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:35.146726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:35.146726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:35.146726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:35.146726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:35.146726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:35.146726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:35.146726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:35.146726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:35.146726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:35.146726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:35.146726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:35.146726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:35.146726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:35.146726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:35.146726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:35.146726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:35.147565 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:35.147565 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:35.147565 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:35.147565 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 241/462] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:35.147955 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b725b-9f85-40f4-9824-e14086bc7c88 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:35.203570 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:35.224868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec714bc-af2c-46a6-8c83-42e76dcb703f None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:35.270432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b725b-9f85-40f4-9824-e14086bc7c88 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:35.279179 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148446b-e2e2-4c7e-92ae-d0c143971cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:35.280437 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148446b-e2e2-4c7e-92ae-d0c143971cfd None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:35.280778 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148446b-e2e2-4c7e-92ae-d0c143971cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:35.281110 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148446b-e2e2-4c7e-92ae-d0c143971cfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:35.294134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148446b-e2e2-4c7e-92ae-d0c143971cfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:35.296470 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148446b-e2e2-4c7e-92ae-d0c143971cfd None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:35.307794 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612076f4-bd6d-4f39-a81f-8a67f27b3522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:35.308427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612076f4-bd6d-4f39-a81f-8a67f27b3522 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:35.308705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612076f4-bd6d-4f39-a81f-8a67f27b3522 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:35.308973 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612076f4-bd6d-4f39-a81f-8a67f27b3522 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:35.311886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-8148446b-e2e2-4c7e-92ae-d0c143971cfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:35.311886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:35.311886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:35.311886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:35.311886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:35.311886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:35.311886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:35.311886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:35.311886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:35.311886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:35.311886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:35.311886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:35.311886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:35.311886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:35.311886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:35.311886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:35.312833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:35.312833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:35.312833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:35.312833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:35.312833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:35.312833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:35.312833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:35.312833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:35.312833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:35.312833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:35.312833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:35.312833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:35.312833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:35.312833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:35.312833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:35.312833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:35.312833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:35.318908 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:35.318908 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:35.318908 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:35.318908 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 222/463] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:35.318908 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148446b-e2e2-4c7e-92ae-d0c143971cfd None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:35.321827 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612076f4-bd6d-4f39-a81f-8a67f27b3522 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:35.323283 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612076f4-bd6d-4f39-a81f-8a67f27b3522 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:35.339292 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-612076f4-bd6d-4f39-a81f-8a67f27b3522 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:35.339292 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:35.339292 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:35.339292 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:35.339292 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:35.339292 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:35.339292 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:35.339292 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:35.339292 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:35.339292 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:35.339292 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:35.339292 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:35.339292 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:35.339292 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:35.339292 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:35.339292 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:35.340243 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:35.340243 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:35.340243 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:35.340243 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:35.340243 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:35.340243 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:35.340243 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:35.340243 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:35.340243 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:35.340243 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:35.340243 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:35.340243 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:35.340243 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:35.340243 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:35.340243 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:35.340243 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:35.340243 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:35.341573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:35.341573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:35.341573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:35.341573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 242/464] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:35.343041 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26895ed5-054c-47a4-b7be-c0b550af8fee None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:35.343328 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26895ed5-054c-47a4-b7be-c0b550af8fee None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:35.343604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26895ed5-054c-47a4-b7be-c0b550af8fee None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:35.349206 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 243/465] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:35.349206 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26895ed5-054c-47a4-b7be-c0b550af8fee None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:35.382328 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:35.432753 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148446b-e2e2-4c7e-92ae-d0c143971cfd None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:35.460775 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:35.465110 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26895ed5-054c-47a4-b7be-c0b550af8fee None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:35.470927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71efe5a5-9537-485f-8912-b58cb0eb5b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:35.471527 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71efe5a5-9537-485f-8912-b58cb0eb5b4e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:35.471804 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71efe5a5-9537-485f-8912-b58cb0eb5b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:35.472170 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71efe5a5-9537-485f-8912-b58cb0eb5b4e None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:35.472768 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71efe5a5-9537-485f-8912-b58cb0eb5b4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:35.473066 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71efe5a5-9537-485f-8912-b58cb0eb5b4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:35.474477 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71efe5a5-9537-485f-8912-b58cb0eb5b4e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:35.487038 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 223/466] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:35.487845 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71efe5a5-9537-485f-8912-b58cb0eb5b4e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:35.508338 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b9655-057b-4054-bc92-4eb990f75ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:35.509250 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b9655-057b-4054-bc92-4eb990f75ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:35.509535 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b9655-057b-4054-bc92-4eb990f75ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:35.509837 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b9655-057b-4054-bc92-4eb990f75ba1 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:35.510481 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b9655-057b-4054-bc92-4eb990f75ba1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:35.510784 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b9655-057b-4054-bc92-4eb990f75ba1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:35.512213 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b9655-057b-4054-bc92-4eb990f75ba1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:35.528518 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 244/467] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:35.528518 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a9afa-7c24-421d-a5dd-11bfcba42b8c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:35.528518 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a9afa-7c24-421d-a5dd-11bfcba42b8c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:35.528518 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a9afa-7c24-421d-a5dd-11bfcba42b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:35.544623 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c14a9afa-7c24-421d-a5dd-11bfcba42b8c None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:35.546411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c14a9afa-7c24-421d-a5dd-11bfcba42b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:35.593355 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71efe5a5-9537-485f-8912-b58cb0eb5b4e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:35.610848 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:35.629985 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 245/468] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:35.629985 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a9afa-7c24-421d-a5dd-11bfcba42b8c None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:35.644485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30f6ef-acdc-4ec6-990f-72bdbfe14603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:35.645500 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30f6ef-acdc-4ec6-990f-72bdbfe14603 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:35.645969 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30f6ef-acdc-4ec6-990f-72bdbfe14603 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:35.646568 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30f6ef-acdc-4ec6-990f-72bdbfe14603 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:35.647478 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30f6ef-acdc-4ec6-990f-72bdbfe14603 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:35.647941 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30f6ef-acdc-4ec6-990f-72bdbfe14603 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:35.649785 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30f6ef-acdc-4ec6-990f-72bdbfe14603 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:35.664371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 224/469] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:35.665502 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30f6ef-acdc-4ec6-990f-72bdbfe14603 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:35.720552 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:35.729793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a9afa-7c24-421d-a5dd-11bfcba42b8c None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:35.767464 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5084d2b-2b21-4bfd-8ae3-aced78f70fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:35.768119 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5084d2b-2b21-4bfd-8ae3-aced78f70fed None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:35.768406 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5084d2b-2b21-4bfd-8ae3-aced78f70fed None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:35.768677 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5084d2b-2b21-4bfd-8ae3-aced78f70fed None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:35.769441 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5084d2b-2b21-4bfd-8ae3-aced78f70fed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:35.771055 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5084d2b-2b21-4bfd-8ae3-aced78f70fed None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:35.784548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30f6ef-acdc-4ec6-990f-72bdbfe14603 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:35.818803 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7f91e-6bcf-4815-9b04-8402660510ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:35.819393 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7f91e-6bcf-4815-9b04-8402660510ec None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:35.819668 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7f91e-6bcf-4815-9b04-8402660510ec None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:35.819937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7f91e-6bcf-4815-9b04-8402660510ec None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:35.820561 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7f91e-6bcf-4815-9b04-8402660510ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:35.822055 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7f91e-6bcf-4815-9b04-8402660510ec None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:35.874179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 246/470] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 14:19:35 2022] POST /identity/v3/users => generated 248 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:19:35.874956 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5084d2b-2b21-4bfd-8ae3-aced78f70fed None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:35.916664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 225/471] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 14:19:35 2022] POST /identity/v3/users => generated 246 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:19:35.916664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5415a-2a2c-46d7-b4ce-b6b7aec22547 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:35.916664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5415a-2a2c-46d7-b4ce-b6b7aec22547 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:35.916664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5415a-2a2c-46d7-b4ce-b6b7aec22547 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:35.917171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 226/472] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:35.926248 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5415a-2a2c-46d7-b4ce-b6b7aec22547 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:35.968761 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:36.007430 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5084d2b-2b21-4bfd-8ae3-aced78f70fed None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:36.054867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374512d-4331-45f4-b85e-afdcce0ecc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:36.055492 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374512d-4331-45f4-b85e-afdcce0ecc24 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:36.055771 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374512d-4331-45f4-b85e-afdcce0ecc24 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:36.056040 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374512d-4331-45f4-b85e-afdcce0ecc24 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:36.056690 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374512d-4331-45f4-b85e-afdcce0ecc24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:36.058240 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374512d-4331-45f4-b85e-afdcce0ecc24 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:36.079956 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5415a-2a2c-46d7-b4ce-b6b7aec22547 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:36.119065 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a44b8-81fb-4994-911c-3dc15eb46b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:36.119693 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a44b8-81fb-4994-911c-3dc15eb46b8f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:36.119970 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a44b8-81fb-4994-911c-3dc15eb46b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:36.120271 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a44b8-81fb-4994-911c-3dc15eb46b8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:36.133010 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a44b8-81fb-4994-911c-3dc15eb46b8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:36.134428 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a44b8-81fb-4994-911c-3dc15eb46b8f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:36.150529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-8b2a44b8-81fb-4994-911c-3dc15eb46b8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:36.150529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:36.150529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:36.150529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:36.150529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:36.150529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:36.150529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:36.150529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:36.150529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:36.150529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:36.150529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:36.150529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:36.150529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:36.150529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:36.150529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:36.150529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:36.151472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:36.151472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:36.151472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:36.151472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:36.151472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:36.151472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:36.151472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:36.151472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:36.151472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:36.151472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:36.151472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:36.151472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:36.151472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:36.151472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:36.151472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:36.151472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:36.151472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:36.152304 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:36.152304 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:36.152304 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:36.153818 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 227/473] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:36.154579 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 247/474] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 14:19:35 2022] POST /identity/v3/users => generated 248 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:19:36.155884 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed63a1c-651e-4bf0-bff0-590ee20fbbb1 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:36.156376 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed63a1c-651e-4bf0-bff0-590ee20fbbb1 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:36.156821 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed63a1c-651e-4bf0-bff0-590ee20fbbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:36.159796 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374512d-4331-45f4-b85e-afdcce0ecc24 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:36.176880 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-6ed63a1c-651e-4bf0-bff0-590ee20fbbb1 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:36.178140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:36.178301 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6ed63a1c-651e-4bf0-bff0-590ee20fbbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:36.285082 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 228/475] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:36.298710 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374512d-4331-45f4-b85e-afdcce0ecc24 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:36.337975 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff88b90-4029-4542-8794-f4eff4c754da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:36.338840 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff88b90-4029-4542-8794-f4eff4c754da None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:36.339326 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff88b90-4029-4542-8794-f4eff4c754da None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:36.339736 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff88b90-4029-4542-8794-f4eff4c754da None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:36.340642 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff88b90-4029-4542-8794-f4eff4c754da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:36.341095 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff88b90-4029-4542-8794-f4eff4c754da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:36.343413 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff88b90-4029-4542-8794-f4eff4c754da None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:36.358396 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 248/476] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:36.366108 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed63a1c-651e-4bf0-bff0-590ee20fbbb1 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:36.389252 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:36.478642 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed63a1c-651e-4bf0-bff0-590ee20fbbb1 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:36.515215 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732f412-bfec-4d0e-bc00-75c18b963b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:36.515825 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732f412-bfec-4d0e-bc00-75c18b963b98 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:36.516109 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732f412-bfec-4d0e-bc00-75c18b963b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:36.516385 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732f412-bfec-4d0e-bc00-75c18b963b98 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:36.517037 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732f412-bfec-4d0e-bc00-75c18b963b98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:36.518527 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732f412-bfec-4d0e-bc00-75c18b963b98 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:36.596988 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff88b90-4029-4542-8794-f4eff4c754da None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:36.613371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 229/477] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 14:19:36 2022] POST /identity/v3/users => generated 249 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:19:36.678424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:36.722825 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff88b90-4029-4542-8794-f4eff4c754da None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:36.775079 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f6751-b473-48b5-a63d-97246bf287a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:36.775824 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f6751-b473-48b5-a63d-97246bf287a1 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:36.776086 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f6751-b473-48b5-a63d-97246bf287a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:36.776287 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f6751-b473-48b5-a63d-97246bf287a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:36.776938 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f6751-b473-48b5-a63d-97246bf287a1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:36.778372 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f6751-b473-48b5-a63d-97246bf287a1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:36.823798 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.sql.core [None req-1b3f6751-b473-48b5-a63d-97246bf287a1 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 14:19:36.823798 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 14:19:36.823798 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [parameters: {'id': '74f31e6eea6649f5b969df6c355aeddf', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 14:19:36.823798 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81741) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 14:19:36.839949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-1b3f6751-b473-48b5-a63d-97246bf287a1 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 14:19:36.839949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:36.839949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 14:19:36.839949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 14:19:36.839949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 14:19:36.839949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 14:19:36.839949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 14:19:36.839949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 14:19:36.839949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 14:19:36.839949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application conn.query(q) Aug 24 14:19:36.839949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 14:19:36.839949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 14:19:36.839949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 14:19:36.839949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application result.read() Aug 24 14:19:36.839949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 14:19:36.841027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 14:19:36.841027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 14:19:36.841027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 14:19:36.841027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 14:19:36.841027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 14:19:36.841027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 14:19:36.841027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 14:19:36.841027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 14:19:36.841027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:36.841027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 14:19:36.841027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:36.841027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:36.841027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 14:19:36.841027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 14:19:36.841027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 14:19:36.841027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 14:19:36.841027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 14:19:36.841027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application next(self.gen) Aug 24 14:19:36.842790 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 14:19:36.842790 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application yield resource Aug 24 14:19:36.842790 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 14:19:36.842790 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application next(self.gen) Aug 24 14:19:36.842790 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 14:19:36.842790 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 14:19:36.842790 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 14:19:36.842790 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 14:19:36.842790 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 14:19:36.842790 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise self.value Aug 24 14:19:36.842790 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 14:19:36.842790 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 14:19:36.842790 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 14:19:36.842790 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application session.commit() Aug 24 14:19:36.842790 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 14:19:36.842790 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 14:19:36.842790 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 14:19:36.844605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 14:19:36.844605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 14:19:36.844605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self.session.flush() Aug 24 14:19:36.844605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 14:19:36.844605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 14:19:36.844605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 14:19:36.844605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 14:19:36.844605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 14:19:36.844605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application compat.raise_( Aug 24 14:19:36.844605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 14:19:36.844605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception Aug 24 14:19:36.844605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 14:19:36.844605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 14:19:36.844605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 14:19:36.844605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 14:19:36.844605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 14:19:36.844605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 14:19:36.846373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 14:19:36.846373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 14:19:36.846373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 14:19:36.846373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 14:19:36.846373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 14:19:36.846373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 14:19:36.846373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 14:19:36.846373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 14:19:36.846373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 14:19:36.846373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 14:19:36.846373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 14:19:36.846373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 14:19:36.846373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 14:19:36.846373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 14:19:36.846373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 14:19:36.846373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception Aug 24 14:19:36.847922 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 14:19:36.847922 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 14:19:36.847922 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 14:19:36.847922 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 14:19:36.847922 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 14:19:36.847922 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 14:19:36.847922 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 14:19:36.847922 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application conn.query(q) Aug 24 14:19:36.847922 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 14:19:36.847922 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 14:19:36.847922 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 14:19:36.847922 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application result.read() Aug 24 14:19:36.847922 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 14:19:36.847922 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 14:19:36.847922 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 14:19:36.847922 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 14:19:36.849066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 14:19:36.849066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 14:19:36.849066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 14:19:36.849066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 14:19:36.849066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 14:19:36.849066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 14:19:36.849066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [parameters: {'id': '74f31e6eea6649f5b969df6c355aeddf', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 14:19:36.849066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 14:19:36.849066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:36.849066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:19:36.849066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:36.849066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:36.849066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:36.849066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:36.849066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:36.849066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:36.850402 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:36.850402 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:36.850402 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:36.850402 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:36.850402 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:36.850402 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:36.850402 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 14:19:36.850402 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 14:19:36.850402 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:36.850402 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:36.850402 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 14:19:36.850402 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 14:19:36.850402 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 14:19:36.850402 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 14:19:36.850402 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 14:19:36.850402 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:36.852183 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 249/478] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Aug 24 14:19:36 2022] POST /identity/v3/roles => generated 144 bytes in 245 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:36.852312 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732f412-bfec-4d0e-bc00-75c18b963b98 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:36.936265 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:36.970415 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732f412-bfec-4d0e-bc00-75c18b963b98 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:37.013717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33bff4-8609-48ab-9272-732d8aeb0fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:37.015201 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33bff4-8609-48ab-9272-732d8aeb0fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:37.015677 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33bff4-8609-48ab-9272-732d8aeb0fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:37.016118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33bff4-8609-48ab-9272-732d8aeb0fb6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:37.027511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33bff4-8609-48ab-9272-732d8aeb0fb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:37.034815 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-5f33bff4-8609-48ab-9272-732d8aeb0fb6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:19:37.034815 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:37.034815 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:37.034815 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:37.034815 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:37.034815 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:37.034815 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:37.034815 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:37.034815 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:37.034815 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:37.034815 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:37.034815 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:37.034815 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:37.034815 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:37.034815 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:37.034815 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:37.035691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:37.035691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:37.035691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:37.035691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:37.035691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:37.035691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:37.035691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:37.035691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:37.035691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:37.035691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:37.035691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:37.035691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:37.035691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:37.035691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:37.035691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:37.035691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:37.036457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:37.036457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:37.036457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:37.036457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:37.036457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:37.036457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:37.036457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:37.036457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:37.036457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:37.036457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:37.036457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:19:37.036457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:37.038440 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 230/479] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 14:19:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:37.045357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f6751-b473-48b5-a63d-97246bf287a1 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:37.193035 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f6751-b473-48b5-a63d-97246bf287a1 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:37.234739 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:37.247639 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13988b2f-5445-4cef-abe0-ecde6eeee08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:37.249816 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13988b2f-5445-4cef-abe0-ecde6eeee08b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:37.249816 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13988b2f-5445-4cef-abe0-ecde6eeee08b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:37.249816 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13988b2f-5445-4cef-abe0-ecde6eeee08b None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:37.249816 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13988b2f-5445-4cef-abe0-ecde6eeee08b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:37.249816 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13988b2f-5445-4cef-abe0-ecde6eeee08b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:37.251288 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13988b2f-5445-4cef-abe0-ecde6eeee08b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:37.273928 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 250/480] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:19:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:38.239728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83e9c2-0e9d-4a68-97fc-c7a726ac6da4 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:38.240241 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83e9c2-0e9d-4a68-97fc-c7a726ac6da4 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:38.240342 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83e9c2-0e9d-4a68-97fc-c7a726ac6da4 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:38.241777 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 231/481] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:38.247068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5468300-811e-4314-b0b5-5a6ee6fd76b4 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:38.247455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5468300-811e-4314-b0b5-5a6ee6fd76b4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:38.247633 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5468300-811e-4314-b0b5-5a6ee6fd76b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:38.282802 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b5468300-811e-4314-b0b5-5a6ee6fd76b4 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:38.284334 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b5468300-811e-4314-b0b5-5a6ee6fd76b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:38.383319 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 251/482] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:38.509780 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9cdfd-4212-49b2-ba6a-a969f78cfcfc None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:38.510076 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9cdfd-4212-49b2-ba6a-a969f78cfcfc None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:38.510258 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9cdfd-4212-49b2-ba6a-a969f78cfcfc None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:38.511589 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 232/483] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:38.517297 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5249cfb-990f-4658-a833-b50893b49ea8 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:38.517940 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5249cfb-990f-4658-a833-b50893b49ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:38.518410 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5249cfb-990f-4658-a833-b50893b49ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:38.546854 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b5249cfb-990f-4658-a833-b50893b49ea8 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:38.548420 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b5249cfb-990f-4658-a833-b50893b49ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:38.636343 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 252/484] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:38.709364 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9cdfd-4212-49b2-ba6a-a969f78cfcfc None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:38.739972 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2ef16-e932-4ad3-946e-b3727114dcf0 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:38.740291 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2ef16-e932-4ad3-946e-b3727114dcf0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:38.740525 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2ef16-e932-4ad3-946e-b3727114dcf0 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:38.741900 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 253/485] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:38.749403 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d17ca-6169-4c9f-b26e-b064f48ace1e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:38.749685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d17ca-6169-4c9f-b26e-b064f48ace1e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:38.750001 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d17ca-6169-4c9f-b26e-b064f48ace1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:38.776828 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-0a6d17ca-6169-4c9f-b26e-b064f48ace1e None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:38.780094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0a6d17ca-6169-4c9f-b26e-b064f48ace1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:38.870123 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:38.876681 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 254/486] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:19:38.927287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9cdfd-4212-49b2-ba6a-a969f78cfcfc None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:38.973717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:38.979942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557987ec-c8b3-4ec4-9c4b-c9387a2ff40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:38.980582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557987ec-c8b3-4ec4-9c4b-c9387a2ff40c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:38.980862 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557987ec-c8b3-4ec4-9c4b-c9387a2ff40c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:38.981140 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557987ec-c8b3-4ec4-9c4b-c9387a2ff40c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:38.999254 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557987ec-c8b3-4ec4-9c4b-c9387a2ff40c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:39.003935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-557987ec-c8b3-4ec4-9c4b-c9387a2ff40c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:19:39.003935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:39.003935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:39.003935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:39.003935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:39.003935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:39.003935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:39.003935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:39.003935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:39.003935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:39.003935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:39.003935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:39.003935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:39.003935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:39.003935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:39.003935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:39.005389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:39.005389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:39.005389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:39.005389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:39.005389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:39.005389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:39.005389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:39.005389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:39.005389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:39.005389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:39.005389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:39.005389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:39.005389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:39.005389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:39.005389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:39.005389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:39.006250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:39.006250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:39.006250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:39.006250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:39.006250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:39.006250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:39.006250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:39.006250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:39.006250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:39.006250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:39.006250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:19:39.006250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:39.009856 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 233/487] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 14:19:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:39.011452 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d17ca-6169-4c9f-b26e-b064f48ace1e None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:39.033222 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557987ec-c8b3-4ec4-9c4b-c9387a2ff40c None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:39.140254 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d17ca-6169-4c9f-b26e-b064f48ace1e None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:39.155880 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557987ec-c8b3-4ec4-9c4b-c9387a2ff40c None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:39.185962 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf167f-37e0-4c4f-8d63-9171353ab15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:39.186663 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf167f-37e0-4c4f-8d63-9171353ab15d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:39.187040 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf167f-37e0-4c4f-8d63-9171353ab15d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:39.187635 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf167f-37e0-4c4f-8d63-9171353ab15d None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:39.188784 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf167f-37e0-4c4f-8d63-9171353ab15d None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:39.189166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf167f-37e0-4c4f-8d63-9171353ab15d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:39.191032 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf167f-37e0-4c4f-8d63-9171353ab15d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:39.193721 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af50ecc-02ae-4b45-a3f4-3446c0eb6ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:39.194547 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af50ecc-02ae-4b45-a3f4-3446c0eb6ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:39.195067 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af50ecc-02ae-4b45-a3f4-3446c0eb6ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:39.195493 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af50ecc-02ae-4b45-a3f4-3446c0eb6ab1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:39.204111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 255/488] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 14:19:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:39.204111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a82c3c-ef3d-416a-bdc0-38017c4f9ff8 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:39.204111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a82c3c-ef3d-416a-bdc0-38017c4f9ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:39.204111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a82c3c-ef3d-416a-bdc0-38017c4f9ff8 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:39.204111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 256/489] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:39.206970 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a82c3c-ef3d-416a-bdc0-38017c4f9ff8 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:39.216049 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af50ecc-02ae-4b45-a3f4-3446c0eb6ab1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:39.222354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-5af50ecc-02ae-4b45-a3f4-3446c0eb6ab1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:19:39.222354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:39.222354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:39.222354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:39.222354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:39.222354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:39.222354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:39.222354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:39.222354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:39.222354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:39.222354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:39.222354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:39.222354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:39.222354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:39.222354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:39.222354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:39.223234 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:39.223234 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:39.223234 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:39.223234 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:39.223234 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:39.223234 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:39.223234 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:39.223234 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:39.223234 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:39.223234 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:39.223234 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:39.223234 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:39.223234 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:39.223234 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:39.223234 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:39.223234 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:39.224027 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:39.224027 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:39.224027 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:39.224027 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:39.224027 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:39.224027 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:39.224027 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:39.224027 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:39.224027 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:39.224027 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:39.224027 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:19:39.224027 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:39.228231 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 234/490] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 14:19:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:19:39.229454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfb3fb-bdb1-46ef-87a6-ac582d123821 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:39.229728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfb3fb-bdb1-46ef-87a6-ac582d123821 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:39.230108 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfb3fb-bdb1-46ef-87a6-ac582d123821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:39.249919 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-b0cfb3fb-bdb1-46ef-87a6-ac582d123821 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:39.251122 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b0cfb3fb-bdb1-46ef-87a6-ac582d123821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:39.260049 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:39.303257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:39.323772 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a82c3c-ef3d-416a-bdc0-38017c4f9ff8 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:39.329894 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 235/491] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:39.329894 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfb3fb-bdb1-46ef-87a6-ac582d123821 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:39.379472 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9269b-d8a1-48c0-9d26-0efa7e665fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:39.380266 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9269b-d8a1-48c0-9d26-0efa7e665fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:39.380541 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9269b-d8a1-48c0-9d26-0efa7e665fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:39.380810 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9269b-d8a1-48c0-9d26-0efa7e665fe8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:39.393783 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9269b-d8a1-48c0-9d26-0efa7e665fe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:39.395434 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9269b-d8a1-48c0-9d26-0efa7e665fe8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:39.410483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-36e9269b-d8a1-48c0-9d26-0efa7e665fe8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:39.410483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:39.410483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:39.410483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:39.410483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:39.410483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:39.410483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:39.410483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:39.410483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:39.410483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:39.410483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:39.410483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:39.410483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:39.410483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:39.410483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:39.410483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:39.411427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:39.411427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:39.411427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:39.411427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:39.411427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:39.411427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:39.411427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:39.411427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:39.411427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:39.411427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:39.411427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:39.411427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:39.411427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:39.411427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:39.411427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:39.411427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:39.411427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:39.412262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:39.412262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:39.412262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:39.412262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 257/492] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:19:39.412917 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9269b-d8a1-48c0-9d26-0efa7e665fe8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:39.434163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfb3fb-bdb1-46ef-87a6-ac582d123821 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:39.476108 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34503fd4-f9d3-4386-9e4e-d466953cfa5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:39.476731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34503fd4-f9d3-4386-9e4e-d466953cfa5b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:39.477051 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34503fd4-f9d3-4386-9e4e-d466953cfa5b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:39.477325 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34503fd4-f9d3-4386-9e4e-d466953cfa5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:39.488738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34503fd4-f9d3-4386-9e4e-d466953cfa5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:39.493482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-34503fd4-f9d3-4386-9e4e-d466953cfa5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:19:39.493482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:39.493482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:39.493482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:39.493482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:39.493482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:39.493482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:39.493482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:39.493482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:39.493482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:39.493482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:39.493482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:39.493482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:39.493482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:39.493482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:39.493482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:39.494359 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:39.494359 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:39.494359 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:39.494359 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:39.494359 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:39.494359 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:39.494359 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:39.494359 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:39.494359 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:39.494359 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:39.494359 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:39.494359 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:39.494359 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:39.494359 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:39.494359 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:39.494359 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:39.495171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:39.495171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:39.495171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:39.495171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:39.495171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:39.495171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:39.495171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:39.495171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:39.495171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:39.495171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:39.495171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:19:39.495171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:39.500018 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 236/493] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 14:19:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:39.500890 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34503fd4-f9d3-4386-9e4e-d466953cfa5b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:39.525284 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:39.535821 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9269b-d8a1-48c0-9d26-0efa7e665fe8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:39.555780 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:39.573569 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c9846-0db9-4ff9-b2fe-47ea620939c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:39.574205 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c9846-0db9-4ff9-b2fe-47ea620939c8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:39.574477 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c9846-0db9-4ff9-b2fe-47ea620939c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:39.574743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c9846-0db9-4ff9-b2fe-47ea620939c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:39.575508 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c9846-0db9-4ff9-b2fe-47ea620939c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:39.575849 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c9846-0db9-4ff9-b2fe-47ea620939c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:39.578225 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c9846-0db9-4ff9-b2fe-47ea620939c8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:39.586924 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 258/494] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 14:19:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:39.587718 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c9846-0db9-4ff9-b2fe-47ea620939c8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:39.635814 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34503fd4-f9d3-4386-9e4e-d466953cfa5b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:39.674404 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365ca1c-df92-40aa-bdd0-5b6fec83c933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:39.675089 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365ca1c-df92-40aa-bdd0-5b6fec83c933 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:39.675365 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365ca1c-df92-40aa-bdd0-5b6fec83c933 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:39.675635 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365ca1c-df92-40aa-bdd0-5b6fec83c933 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:39.676275 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365ca1c-df92-40aa-bdd0-5b6fec83c933 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:39.676576 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365ca1c-df92-40aa-bdd0-5b6fec83c933 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:39.677962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365ca1c-df92-40aa-bdd0-5b6fec83c933 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:39.691309 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 237/495] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:39.692117 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365ca1c-df92-40aa-bdd0-5b6fec83c933 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:39.699446 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c9846-0db9-4ff9-b2fe-47ea620939c8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:39.733864 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a12080-67a2-4c94-a443-f1b3d3f740b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:39.734467 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a12080-67a2-4c94-a443-f1b3d3f740b9 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:39.734742 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a12080-67a2-4c94-a443-f1b3d3f740b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:39.735007 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a12080-67a2-4c94-a443-f1b3d3f740b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:39.735669 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a12080-67a2-4c94-a443-f1b3d3f740b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:39.735967 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a12080-67a2-4c94-a443-f1b3d3f740b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:39.737332 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a12080-67a2-4c94-a443-f1b3d3f740b9 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:39.745603 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 259/496] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 14:19:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:39.746417 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a12080-67a2-4c94-a443-f1b3d3f740b9 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:39.766032 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:39.803681 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:39.806799 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365ca1c-df92-40aa-bdd0-5b6fec83c933 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:39.844748 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197a94a-f77a-49f0-b4c7-482e6c9b330e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:39.845388 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197a94a-f77a-49f0-b4c7-482e6c9b330e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:39.845661 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197a94a-f77a-49f0-b4c7-482e6c9b330e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:39.845961 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197a94a-f77a-49f0-b4c7-482e6c9b330e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:39.855929 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a12080-67a2-4c94-a443-f1b3d3f740b9 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:39.857310 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197a94a-f77a-49f0-b4c7-482e6c9b330e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:39.858978 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197a94a-f77a-49f0-b4c7-482e6c9b330e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:39.873731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-5197a94a-f77a-49f0-b4c7-482e6c9b330e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:39.873731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:39.873731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:39.873731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:39.873731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:39.873731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:39.873731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:39.873731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:39.873731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:39.873731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:39.873731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:39.873731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:39.873731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:39.873731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:39.873731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:39.873731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:39.874682 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:39.874682 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:39.874682 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:39.874682 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:39.874682 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:39.874682 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:39.874682 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:39.874682 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:39.874682 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:39.874682 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:39.874682 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:39.874682 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:39.874682 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:39.874682 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:39.874682 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:39.874682 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:39.874682 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:39.875526 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:39.875526 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:39.875526 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:39.875526 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 238/497] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:39.875748 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197a94a-f77a-49f0-b4c7-482e6c9b330e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:39.893699 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88acd6-0a9b-4483-b447-143c599d5197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:39.894277 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88acd6-0a9b-4483-b447-143c599d5197 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:39.894548 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88acd6-0a9b-4483-b447-143c599d5197 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:39.894905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88acd6-0a9b-4483-b447-143c599d5197 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:39.904416 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88acd6-0a9b-4483-b447-143c599d5197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:39.909128 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-ac88acd6-0a9b-4483-b447-143c599d5197 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:19:39.909128 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:39.909128 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:39.909128 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:39.909128 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:39.909128 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:39.909128 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:39.909128 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:39.909128 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:39.909128 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:39.909128 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:39.909128 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:39.909128 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:39.909128 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:39.909128 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:39.909128 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:39.910242 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:39.910242 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:39.910242 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:39.910242 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:39.910242 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:39.910242 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:39.910242 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:39.910242 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:39.910242 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:39.910242 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:39.910242 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:39.910242 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:39.910242 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:39.910242 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:39.910242 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:39.910242 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:39.915030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:39.915030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:39.915030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:39.915030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:39.915030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:39.915030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:39.915030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:39.915030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:39.915030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:39.915030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:39.915030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:19:39.915030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:39.915030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 260/498] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 14:19:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:39.915030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88acd6-0a9b-4483-b447-143c599d5197 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:39.977025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197a94a-f77a-49f0-b4c7-482e6c9b330e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:39.989917 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:40.012989 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88acd6-0a9b-4483-b447-143c599d5197 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:40.014202 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad6561-8c12-43d6-a9df-971f28e730ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:40.014820 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad6561-8c12-43d6-a9df-971f28e730ad None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:40.015095 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad6561-8c12-43d6-a9df-971f28e730ad None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:40.015369 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad6561-8c12-43d6-a9df-971f28e730ad None admin] PATH_INFO: `/v3/users/nova` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:40.023213 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad6561-8c12-43d6-a9df-971f28e730ad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:40.024654 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad6561-8c12-43d6-a9df-971f28e730ad None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:40.037042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-5cad6561-8c12-43d6-a9df-971f28e730ad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:19:40.037042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:40.037042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:40.037042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:40.037042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:40.037042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:40.037042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:40.037042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:40.037042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:40.037042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:40.037042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:40.037042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:40.037042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:19:40.037042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:19:40.037042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:19:40.037042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:19:40.038185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:40.038185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:40.038185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:19:40.038185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:40.038185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:19:40.038185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:40.038185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:40.038185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:40.038185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:40.038185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:40.038185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:40.038185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:40.038185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:40.038185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:40.038185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:40.038185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:40.038185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:40.038185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:40.039301 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:40.039301 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:40.039301 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:19:40.039301 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:19:40.039301 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:19:40.039301 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:19:40.039301 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:19:40.039301 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:19:40.039301 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:19:40.039301 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:40.039301 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 239/499] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Aug 24 14:19:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:40.039301 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d4e58-f003-4c2c-92ae-acc20c3e1162 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:40.040062 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d4e58-f003-4c2c-92ae-acc20c3e1162 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:40.040062 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d4e58-f003-4c2c-92ae-acc20c3e1162 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:40.041109 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 240/500] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:40.041623 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d4e58-f003-4c2c-92ae-acc20c3e1162 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:40.054552 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399aec91-f7f2-44b0-8ddb-e7fff829579f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:40.055178 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399aec91-f7f2-44b0-8ddb-e7fff829579f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:40.055455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399aec91-f7f2-44b0-8ddb-e7fff829579f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:40.055724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399aec91-f7f2-44b0-8ddb-e7fff829579f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:40.061266 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:40.066423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399aec91-f7f2-44b0-8ddb-e7fff829579f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:40.067854 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399aec91-f7f2-44b0-8ddb-e7fff829579f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:40.082162 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-399aec91-f7f2-44b0-8ddb-e7fff829579f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:40.082162 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:40.082162 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:40.082162 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:40.082162 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:40.082162 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:40.082162 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:40.082162 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:40.082162 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:40.082162 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:40.082162 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:40.082162 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:40.082162 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:40.082162 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:40.082162 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:40.082162 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:40.087604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:40.087604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:40.087604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:40.087604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:40.087604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:40.087604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:40.087604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:40.087604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:40.087604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:40.087604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:40.087604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:40.087604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:40.087604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:40.087604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:40.087604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:40.087604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:40.087604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:40.088559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:40.088559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:40.088559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:40.088559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 261/501] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:40.088559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399aec91-f7f2-44b0-8ddb-e7fff829579f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:40.150783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d4e58-f003-4c2c-92ae-acc20c3e1162 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:40.181667 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399aec91-f7f2-44b0-8ddb-e7fff829579f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:40.183550 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698012fd-540f-48e1-8526-0920a878eff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:40.184142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698012fd-540f-48e1-8526-0920a878eff4 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:40.184414 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698012fd-540f-48e1-8526-0920a878eff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:40.184681 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698012fd-540f-48e1-8526-0920a878eff4 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:40.185354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698012fd-540f-48e1-8526-0920a878eff4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:40.185936 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698012fd-540f-48e1-8526-0920a878eff4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:40.187307 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698012fd-540f-48e1-8526-0920a878eff4 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:40.199017 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 241/502] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:40.199806 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698012fd-540f-48e1-8526-0920a878eff4 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:40.213238 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:40.221659 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11174b2d-281f-4838-83f3-eb77e8cc316f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:40.222287 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11174b2d-281f-4838-83f3-eb77e8cc316f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:40.223943 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11174b2d-281f-4838-83f3-eb77e8cc316f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:40.223943 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11174b2d-281f-4838-83f3-eb77e8cc316f None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:40.223943 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11174b2d-281f-4838-83f3-eb77e8cc316f None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:40.223943 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11174b2d-281f-4838-83f3-eb77e8cc316f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:40.225140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11174b2d-281f-4838-83f3-eb77e8cc316f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:40.235528 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 262/503] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 14:19:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:40.236721 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62822484-ef06-464b-a675-0b28af8a8a53 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:40.237034 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62822484-ef06-464b-a675-0b28af8a8a53 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:40.237391 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62822484-ef06-464b-a675-0b28af8a8a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:40.255760 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-62822484-ef06-464b-a675-0b28af8a8a53 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:40.256915 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-62822484-ef06-464b-a675-0b28af8a8a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:40.276446 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:40.307098 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698012fd-540f-48e1-8526-0920a878eff4 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:40.323497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 263/504] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:40.324440 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62822484-ef06-464b-a675-0b28af8a8a53 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:40.356534 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136b226-c90d-4e71-a091-6d7aa40080fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:40.357145 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136b226-c90d-4e71-a091-6d7aa40080fb None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:40.357434 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136b226-c90d-4e71-a091-6d7aa40080fb None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:40.357708 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136b226-c90d-4e71-a091-6d7aa40080fb None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:40.358461 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136b226-c90d-4e71-a091-6d7aa40080fb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:40.358764 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136b226-c90d-4e71-a091-6d7aa40080fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:40.360164 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136b226-c90d-4e71-a091-6d7aa40080fb None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:40.406011 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 242/505] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Aug 24 14:19:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:40.406011 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136b226-c90d-4e71-a091-6d7aa40080fb None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:40.436933 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62822484-ef06-464b-a675-0b28af8a8a53 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:40.460932 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:40.475524 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78dc4f-14d5-46ea-899c-1463a2187da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:40.476208 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78dc4f-14d5-46ea-899c-1463a2187da5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:40.476482 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78dc4f-14d5-46ea-899c-1463a2187da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:40.476750 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78dc4f-14d5-46ea-899c-1463a2187da5 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:40.477391 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78dc4f-14d5-46ea-899c-1463a2187da5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:40.477686 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78dc4f-14d5-46ea-899c-1463a2187da5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:40.479066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78dc4f-14d5-46ea-899c-1463a2187da5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:40.491225 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 264/506] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:40.495926 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78dc4f-14d5-46ea-899c-1463a2187da5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:40.513194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136b226-c90d-4e71-a091-6d7aa40080fb None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:40.543381 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:40.548954 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5293151-ea3f-4e9c-9b41-1d25bc6042b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:40.549579 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5293151-ea3f-4e9c-9b41-1d25bc6042b4 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:40.549902 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5293151-ea3f-4e9c-9b41-1d25bc6042b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:40.550272 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5293151-ea3f-4e9c-9b41-1d25bc6042b4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:40.557206 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5293151-ea3f-4e9c-9b41-1d25bc6042b4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:40.558734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5293151-ea3f-4e9c-9b41-1d25bc6042b4 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:40.571052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-c5293151-ea3f-4e9c-9b41-1d25bc6042b4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 14:19:40.571052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:40.571052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:40.571052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:40.571052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:40.571052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:40.571052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:40.571052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:40.571052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:40.571052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:40.571052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:40.571052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:40.571052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:19:40.571052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:19:40.571052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:19:40.571052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:19:40.571973 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:40.571973 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:40.571973 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:19:40.571973 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:40.571973 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:19:40.571973 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:40.571973 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:40.571973 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:40.571973 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:40.571973 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:40.571973 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:40.571973 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:40.571973 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:40.571973 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:40.571973 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:40.571973 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:40.571973 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:40.571973 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:40.573459 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:40.573459 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:40.573459 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:19:40.573459 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:19:40.573459 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:19:40.573459 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:19:40.573459 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:19:40.573459 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:19:40.573459 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 14:19:40.573459 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:40.573459 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 243/507] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:19:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:40.573459 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5293151-ea3f-4e9c-9b41-1d25bc6042b4 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:40.606630 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78dc4f-14d5-46ea-899c-1463a2187da5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:40.640008 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9d33d-da86-41f3-a680-229cb815f9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:40.640635 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9d33d-da86-41f3-a680-229cb815f9ff None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:40.640914 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9d33d-da86-41f3-a680-229cb815f9ff None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:40.641187 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9d33d-da86-41f3-a680-229cb815f9ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:40.651528 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9d33d-da86-41f3-a680-229cb815f9ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:40.652976 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9d33d-da86-41f3-a680-229cb815f9ff None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:40.667807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-73a9d33d-da86-41f3-a680-229cb815f9ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:40.667807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:40.667807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:40.667807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:40.667807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:40.667807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:40.667807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:40.667807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:40.667807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:40.667807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:40.667807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:40.667807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:40.667807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:40.667807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:40.667807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:40.667807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:40.668705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:40.668705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:40.668705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:40.668705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:40.668705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:40.668705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:40.668705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:40.668705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:40.668705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:40.668705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:40.668705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:40.668705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:40.668705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:40.668705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:40.668705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:40.668705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:40.668705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:40.669574 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:40.669574 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:40.669574 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:40.669574 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 265/508] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:40.669878 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9d33d-da86-41f3-a680-229cb815f9ff None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:40.680893 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5293151-ea3f-4e9c-9b41-1d25bc6042b4 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:40.702186 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:40.714639 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05180e2-dfb7-41bf-a1a5-2b5f80060560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:40.715238 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05180e2-dfb7-41bf-a1a5-2b5f80060560 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:40.715518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05180e2-dfb7-41bf-a1a5-2b5f80060560 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:40.715792 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05180e2-dfb7-41bf-a1a5-2b5f80060560 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:40.769012 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9d33d-da86-41f3-a680-229cb815f9ff None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:40.773202 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:40.783433 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05180e2-dfb7-41bf-a1a5-2b5f80060560 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:40.784896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05180e2-dfb7-41bf-a1a5-2b5f80060560 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:40.803558 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edea11-7ffe-4a81-8f27-30c78015873a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:40.804172 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edea11-7ffe-4a81-8f27-30c78015873a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:40.804444 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edea11-7ffe-4a81-8f27-30c78015873a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:40.804708 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edea11-7ffe-4a81-8f27-30c78015873a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:40.812805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edea11-7ffe-4a81-8f27-30c78015873a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:40.814262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edea11-7ffe-4a81-8f27-30c78015873a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:40.827337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-45edea11-7ffe-4a81-8f27-30c78015873a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 14:19:40.827337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:40.827337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:40.827337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:40.827337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:40.827337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:40.827337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:40.827337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:40.827337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:40.827337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:40.827337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:40.827337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:40.827337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:19:40.827337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:19:40.827337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:19:40.827337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:19:40.828400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:40.828400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:40.828400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:19:40.828400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:40.828400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:19:40.828400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:40.828400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:40.828400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:40.828400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:40.828400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:40.828400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:40.828400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:40.828400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:40.828400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:40.828400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:40.828400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:40.828400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:40.828400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:40.829296 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:40.829296 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:40.829296 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:19:40.829296 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:19:40.829296 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:19:40.829296 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:19:40.829296 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:19:40.829296 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:19:40.829296 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 14:19:40.829296 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:40.833188 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 266/509] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:19:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:40.833966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edea11-7ffe-4a81-8f27-30c78015873a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:40.885831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 244/510] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:19:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:19:40.886740 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05180e2-dfb7-41bf-a1a5-2b5f80060560 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:40.928493 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:40.937953 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edea11-7ffe-4a81-8f27-30c78015873a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:40.972109 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb341769-4ed8-4a1d-854c-5cda882fbc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:40.972713 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb341769-4ed8-4a1d-854c-5cda882fbc9e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:40.972995 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb341769-4ed8-4a1d-854c-5cda882fbc9e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:40.973268 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb341769-4ed8-4a1d-854c-5cda882fbc9e None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:40.974044 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb341769-4ed8-4a1d-854c-5cda882fbc9e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:40.974347 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb341769-4ed8-4a1d-854c-5cda882fbc9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:40.975112 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:40.975802 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb341769-4ed8-4a1d-854c-5cda882fbc9e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:40.984823 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05180e2-dfb7-41bf-a1a5-2b5f80060560 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:41.012919 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 267/511] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Aug 24 14:19:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:41.014006 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb341769-4ed8-4a1d-854c-5cda882fbc9e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:41.023340 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcb9ff-d2aa-4bc2-9701-6d2104614c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:41.023964 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcb9ff-d2aa-4bc2-9701-6d2104614c9b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:41.024236 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcb9ff-d2aa-4bc2-9701-6d2104614c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:41.024504 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcb9ff-d2aa-4bc2-9701-6d2104614c9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:41.034686 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbcb9ff-d2aa-4bc2-9701-6d2104614c9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:41.036109 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbcb9ff-d2aa-4bc2-9701-6d2104614c9b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:41.050831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-5fbcb9ff-d2aa-4bc2-9701-6d2104614c9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:41.050831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:41.050831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:41.050831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:41.050831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:41.050831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:41.050831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:41.050831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:41.050831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:41.050831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:41.050831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:41.050831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:41.050831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:41.050831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:41.050831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:41.050831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:41.051901 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:41.051901 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:41.051901 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:41.051901 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:41.051901 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:41.051901 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:41.051901 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:41.051901 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:41.051901 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:41.051901 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:41.051901 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:41.051901 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:41.051901 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:41.051901 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:41.051901 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:41.051901 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:41.051901 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:41.054942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:41.054942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:41.054942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:41.054942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 245/512] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:41.054942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcb9ff-d2aa-4bc2-9701-6d2104614c9b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:41.115184 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb341769-4ed8-4a1d-854c-5cda882fbc9e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:41.148862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4db5ac-5d2e-4d4a-bf83-4d6d9dd3fc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:41.149389 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4db5ac-5d2e-4d4a-bf83-4d6d9dd3fc40 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:41.149668 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4db5ac-5d2e-4d4a-bf83-4d6d9dd3fc40 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:41.149968 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4db5ac-5d2e-4d4a-bf83-4d6d9dd3fc40 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:41.150613 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4db5ac-5d2e-4d4a-bf83-4d6d9dd3fc40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:41.150917 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4db5ac-5d2e-4d4a-bf83-4d6d9dd3fc40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:41.151543 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcb9ff-d2aa-4bc2-9701-6d2104614c9b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:41.152299 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4db5ac-5d2e-4d4a-bf83-4d6d9dd3fc40 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:41.163402 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 268/513] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:41.164235 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4db5ac-5d2e-4d4a-bf83-4d6d9dd3fc40 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:41.176419 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:41.189924 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b37d72-b1af-4608-9ef4-5b8974181ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:41.190526 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b37d72-b1af-4608-9ef4-5b8974181ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:41.190806 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b37d72-b1af-4608-9ef4-5b8974181ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:41.191079 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b37d72-b1af-4608-9ef4-5b8974181ad6 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:41.191798 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b37d72-b1af-4608-9ef4-5b8974181ad6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:41.192101 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b37d72-b1af-4608-9ef4-5b8974181ad6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:41.193543 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b37d72-b1af-4608-9ef4-5b8974181ad6 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:41.207507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:41.211568 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 246/514] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Aug 24 14:19:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:41.212416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b37d72-b1af-4608-9ef4-5b8974181ad6 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:41.270888 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4db5ac-5d2e-4d4a-bf83-4d6d9dd3fc40 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:41.306261 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d110ebf-15f9-44d9-9f61-5a61cdc0ef5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:41.306881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d110ebf-15f9-44d9-9f61-5a61cdc0ef5d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:41.307154 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d110ebf-15f9-44d9-9f61-5a61cdc0ef5d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:41.307429 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d110ebf-15f9-44d9-9f61-5a61cdc0ef5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:41.310161 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b37d72-b1af-4608-9ef4-5b8974181ad6 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:41.317588 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d110ebf-15f9-44d9-9f61-5a61cdc0ef5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:41.319064 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d110ebf-15f9-44d9-9f61-5a61cdc0ef5d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:41.332593 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-8d110ebf-15f9-44d9-9f61-5a61cdc0ef5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:41.332593 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:41.332593 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:41.332593 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:41.332593 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:41.332593 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:41.332593 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:41.332593 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:41.332593 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:41.332593 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:41.332593 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:41.332593 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:41.332593 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:41.332593 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:41.332593 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:41.332593 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:41.333972 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:41.333972 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:41.333972 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:41.333972 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:41.333972 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:41.333972 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:41.333972 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:41.333972 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:41.333972 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:41.333972 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:41.333972 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:41.333972 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:41.333972 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:41.333972 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:41.333972 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:41.333972 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:41.333972 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:41.334832 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:41.334832 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:41.334832 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:41.334832 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 269/515] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:41.334832 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d110ebf-15f9-44d9-9f61-5a61cdc0ef5d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:41.349078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4ee97-8654-46c0-8b19-ffb74e6e50d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:41.349675 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4ee97-8654-46c0-8b19-ffb74e6e50d7 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:41.349977 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4ee97-8654-46c0-8b19-ffb74e6e50d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:41.350250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4ee97-8654-46c0-8b19-ffb74e6e50d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:41.393915 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:41.416442 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:41.418758 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4ee97-8654-46c0-8b19-ffb74e6e50d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:41.420945 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4ee97-8654-46c0-8b19-ffb74e6e50d7 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:41.431949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d110ebf-15f9-44d9-9f61-5a61cdc0ef5d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:41.465733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d41e5-b167-485a-9c61-ad05a31c32ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:41.466348 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d41e5-b167-485a-9c61-ad05a31c32ff None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:41.467144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d41e5-b167-485a-9c61-ad05a31c32ff None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:41.467412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d41e5-b167-485a-9c61-ad05a31c32ff None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:41.468152 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d41e5-b167-485a-9c61-ad05a31c32ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:41.468448 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d41e5-b167-485a-9c61-ad05a31c32ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:41.469834 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d41e5-b167-485a-9c61-ad05a31c32ff None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:41.482191 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 270/516] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:41.483475 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d41e5-b167-485a-9c61-ad05a31c32ff None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:41.549519 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 247/517] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:19:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:19:41.550609 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4ee97-8654-46c0-8b19-ffb74e6e50d7 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:41.580600 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d41e5-b167-485a-9c61-ad05a31c32ff None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:41.603661 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:41.614674 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51fab6-0c8a-4f71-aa92-3a16fdc78e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:41.615342 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51fab6-0c8a-4f71-aa92-3a16fdc78e6c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:41.615645 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51fab6-0c8a-4f71-aa92-3a16fdc78e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:41.615948 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51fab6-0c8a-4f71-aa92-3a16fdc78e6c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:41.622881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51fab6-0c8a-4f71-aa92-3a16fdc78e6c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:41.624323 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51fab6-0c8a-4f71-aa92-3a16fdc78e6c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:41.635878 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-6b51fab6-0c8a-4f71-aa92-3a16fdc78e6c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 14:19:41.635878 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:41.635878 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:41.635878 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:41.635878 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:41.635878 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:41.635878 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:41.635878 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:41.635878 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:41.635878 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:41.635878 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:41.635878 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:41.635878 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:19:41.635878 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:19:41.635878 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:19:41.635878 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:19:41.636776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:41.636776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:41.636776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:19:41.636776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:41.636776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:19:41.636776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:41.636776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:41.636776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:41.636776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:41.636776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:41.636776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:41.636776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:41.636776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:41.636776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:41.636776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:41.636776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:41.636776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:41.636776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:41.637674 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:41.637674 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:41.637674 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:19:41.637674 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:19:41.637674 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:19:41.637674 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:19:41.637674 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:19:41.637674 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:19:41.637674 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 14:19:41.637674 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:41.637674 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 271/518] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 14:19:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:41.638271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51fab6-0c8a-4f71-aa92-3a16fdc78e6c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:41.651582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:41.655225 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4ee97-8654-46c0-8b19-ffb74e6e50d7 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:41.689445 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f091b8-0dc7-4783-a5a5-adf3da42b565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:41.690031 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f091b8-0dc7-4783-a5a5-adf3da42b565 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:41.690313 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f091b8-0dc7-4783-a5a5-adf3da42b565 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:41.690586 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f091b8-0dc7-4783-a5a5-adf3da42b565 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:41.738800 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51fab6-0c8a-4f71-aa92-3a16fdc78e6c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:41.758411 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f091b8-0dc7-4783-a5a5-adf3da42b565 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:41.759861 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f091b8-0dc7-4783-a5a5-adf3da42b565 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:41.771999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2151fbc-7bb4-4286-99b4-fc83fdf567e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:41.772591 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2151fbc-7bb4-4286-99b4-fc83fdf567e4 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:41.772866 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2151fbc-7bb4-4286-99b4-fc83fdf567e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:41.773135 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2151fbc-7bb4-4286-99b4-fc83fdf567e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:41.773773 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2151fbc-7bb4-4286-99b4-fc83fdf567e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:41.774081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2151fbc-7bb4-4286-99b4-fc83fdf567e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:41.775423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2151fbc-7bb4-4286-99b4-fc83fdf567e4 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:41.787439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 272/519] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:41.788214 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2151fbc-7bb4-4286-99b4-fc83fdf567e4 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:41.835303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:41.859292 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:41.862704 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 248/520] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:19:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:19:41.863500 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f091b8-0dc7-4783-a5a5-adf3da42b565 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:41.892947 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2151fbc-7bb4-4286-99b4-fc83fdf567e4 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:41.926036 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7da319-f8da-4e55-b5fc-31e6f93a5a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:41.926638 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7da319-f8da-4e55-b5fc-31e6f93a5a15 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:41.926914 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7da319-f8da-4e55-b5fc-31e6f93a5a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:41.927186 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7da319-f8da-4e55-b5fc-31e6f93a5a15 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:41.927818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7da319-f8da-4e55-b5fc-31e6f93a5a15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:41.929260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7da319-f8da-4e55-b5fc-31e6f93a5a15 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:41.959109 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f091b8-0dc7-4783-a5a5-adf3da42b565 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:41.992347 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef965e36-7fe4-483b-a8ca-3c0b7bc881e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:41.992960 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef965e36-7fe4-483b-a8ca-3c0b7bc881e8 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:41.993237 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef965e36-7fe4-483b-a8ca-3c0b7bc881e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:41.993582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef965e36-7fe4-483b-a8ca-3c0b7bc881e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:42.003220 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef965e36-7fe4-483b-a8ca-3c0b7bc881e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:42.004915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef965e36-7fe4-483b-a8ca-3c0b7bc881e8 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:42.018883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-ef965e36-7fe4-483b-a8ca-3c0b7bc881e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:42.018883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:42.018883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:42.018883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:42.018883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:42.018883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:42.018883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:42.018883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:42.018883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:42.018883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:42.018883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:42.018883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:42.018883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:42.018883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:42.018883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:42.018883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:42.019923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:42.019923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:42.019923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:42.019923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:42.019923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:42.019923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:42.019923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:42.019923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:42.019923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:42.019923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:42.019923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:42.019923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:42.019923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:42.019923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:42.019923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:42.019923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:42.019923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:42.020900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:42.020900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:42.020900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:42.020900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 249/521] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:42.020900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef965e36-7fe4-483b-a8ca-3c0b7bc881e8 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:42.026923 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 273/522] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 14:19:41 2022] POST /identity/v3/users => generated 247 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:19:42.028126 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7da319-f8da-4e55-b5fc-31e6f93a5a15 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:42.085270 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:42.139211 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:42.143999 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef965e36-7fe4-483b-a8ca-3c0b7bc881e8 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:42.144735 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7da319-f8da-4e55-b5fc-31e6f93a5a15 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:42.183603 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcdd993-2ea5-4de2-a4d8-b32412c0a982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:42.184421 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcdd993-2ea5-4de2-a4d8-b32412c0a982 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:42.184633 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253283c0-f150-406f-9b6c-48e898c2016a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:42.184935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcdd993-2ea5-4de2-a4d8-b32412c0a982 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:42.185910 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253283c0-f150-406f-9b6c-48e898c2016a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:42.186040 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcdd993-2ea5-4de2-a4d8-b32412c0a982 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:42.186207 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253283c0-f150-406f-9b6c-48e898c2016a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:42.186478 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253283c0-f150-406f-9b6c-48e898c2016a None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:42.187232 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253283c0-f150-406f-9b6c-48e898c2016a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:42.188380 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253283c0-f150-406f-9b6c-48e898c2016a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:42.188961 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253283c0-f150-406f-9b6c-48e898c2016a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:42.194424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcdd993-2ea5-4de2-a4d8-b32412c0a982 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:42.196435 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcdd993-2ea5-4de2-a4d8-b32412c0a982 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:42.212174 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 250/523] 10.222.0.65 () {56 vars in 1139 bytes} [Wed Aug 24 14:19:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:42.212688 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-2bcdd993-2ea5-4de2-a4d8-b32412c0a982 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:19:42.212688 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:42.212688 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:42.212688 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:42.212688 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:42.212688 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:42.212688 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:42.212688 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:42.212688 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:42.212688 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:42.212688 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:42.212688 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:42.212688 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:19:42.212688 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:19:42.212688 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:19:42.213515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:19:42.213515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:42.213515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:42.213515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:42.213515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:42.213515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:42.213515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:42.213515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:42.213515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:42.213515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:42.213515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:42.213515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:42.213515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:42.213515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:42.213515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:42.213515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:42.213515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:42.214467 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:19:42.214467 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:19:42.214467 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:19:42.214467 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:19:42.214467 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:19:42.214467 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:19:42.214467 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:19:42.214467 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:42.214922 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253283c0-f150-406f-9b6c-48e898c2016a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:42.214991 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 274/524] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:19:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:42.218629 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcdd993-2ea5-4de2-a4d8-b32412c0a982 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:42.325703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcdd993-2ea5-4de2-a4d8-b32412c0a982 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:42.329344 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253283c0-f150-406f-9b6c-48e898c2016a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:42.340399 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:42.363135 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2969ed-9123-4bc3-82f2-9840993786db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:42.364311 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2969ed-9123-4bc3-82f2-9840993786db None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:42.364591 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2969ed-9123-4bc3-82f2-9840993786db None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:42.364695 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fa2b2-1a84-4f01-9b32-df08212246d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:42.364871 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2969ed-9123-4bc3-82f2-9840993786db None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:42.365279 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fa2b2-1a84-4f01-9b32-df08212246d6 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:42.365508 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2969ed-9123-4bc3-82f2-9840993786db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:42.365616 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fa2b2-1a84-4f01-9b32-df08212246d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:42.365846 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2969ed-9123-4bc3-82f2-9840993786db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:42.365972 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fa2b2-1a84-4f01-9b32-df08212246d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:42.367211 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2969ed-9123-4bc3-82f2-9840993786db None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:42.377389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1fa2b2-1a84-4f01-9b32-df08212246d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:42.378876 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1fa2b2-1a84-4f01-9b32-df08212246d6 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:42.380716 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 275/525] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:42.382229 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2969ed-9123-4bc3-82f2-9840993786db None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:42.394588 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-7e1fa2b2-1a84-4f01-9b32-df08212246d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:42.394588 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:42.394588 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:42.394588 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:42.394588 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:42.394588 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:42.394588 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:42.394588 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:42.394588 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:42.394588 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:42.394588 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:42.394588 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:42.394588 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:42.394588 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:42.394588 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:42.394588 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:42.400168 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:42.400168 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:42.400168 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:42.400168 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:42.400168 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:42.400168 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:42.400168 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:42.400168 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:42.400168 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:42.400168 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:42.400168 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:42.400168 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:42.400168 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:42.400168 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:42.400168 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:42.400168 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:42.400168 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:42.401196 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:42.401196 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:42.401196 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:42.401196 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 251/526] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:42.401196 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fa2b2-1a84-4f01-9b32-df08212246d6 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:42.412706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:42.505893 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fa2b2-1a84-4f01-9b32-df08212246d6 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:42.508000 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2969ed-9123-4bc3-82f2-9840993786db None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:42.541845 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fe64a-edd9-4764-af6c-34a8bffa1012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:42.542446 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fe64a-edd9-4764-af6c-34a8bffa1012 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:42.542720 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fe64a-edd9-4764-af6c-34a8bffa1012 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:42.542995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fe64a-edd9-4764-af6c-34a8bffa1012 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:42.543738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41fe64a-edd9-4764-af6c-34a8bffa1012 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:42.544046 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41fe64a-edd9-4764-af6c-34a8bffa1012 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:42.546535 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41fe64a-edd9-4764-af6c-34a8bffa1012 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:42.548916 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b665d-04ac-4093-83de-adec33cbfe09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:42.549726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b665d-04ac-4093-83de-adec33cbfe09 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:42.550238 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b665d-04ac-4093-83de-adec33cbfe09 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:42.550713 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b665d-04ac-4093-83de-adec33cbfe09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:42.565395 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 252/527] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:19:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:42.566568 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fe64a-edd9-4764-af6c-34a8bffa1012 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:42.592945 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:42.628925 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b665d-04ac-4093-83de-adec33cbfe09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:42.630995 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b665d-04ac-4093-83de-adec33cbfe09 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:42.650365 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:42.669232 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fe64a-edd9-4764-af6c-34a8bffa1012 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:42.706874 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4e1df-1d61-4f34-af59-d6a933af9b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:42.707743 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4e1df-1d61-4f34-af59-d6a933af9b08 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:42.708017 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4e1df-1d61-4f34-af59-d6a933af9b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:42.708281 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4e1df-1d61-4f34-af59-d6a933af9b08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:42.715029 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4e1df-1d61-4f34-af59-d6a933af9b08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:42.717034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4e1df-1d61-4f34-af59-d6a933af9b08 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:42.729317 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-a4e4e1df-1d61-4f34-af59-d6a933af9b08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:19:42.729317 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:42.729317 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:42.729317 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:42.729317 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:42.729317 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:42.729317 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:42.729317 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:42.729317 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:42.729317 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:42.729317 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:42.729317 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:42.729317 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:19:42.729317 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:19:42.729317 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:19:42.730195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:19:42.730195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:42.730195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:42.730195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:42.730195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:42.730195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:42.730195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:42.730195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:42.730195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:42.730195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:42.730195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:42.730195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:42.730195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:42.730195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:42.730195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:42.730195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:42.730195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:42.731037 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:19:42.731037 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:19:42.731037 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:19:42.731037 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:19:42.731037 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:19:42.731037 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:19:42.731037 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:19:42.731037 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:42.731037 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 253/528] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:19:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:42.731507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4e1df-1d61-4f34-af59-d6a933af9b08 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:42.744350 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 276/529] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:19:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:19:42.747015 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b665d-04ac-4093-83de-adec33cbfe09 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:42.822338 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:42.840901 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4e1df-1d61-4f34-af59-d6a933af9b08 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:42.850894 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b665d-04ac-4093-83de-adec33cbfe09 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:42.867996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:42.876839 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776a8d7-12b5-42e0-81af-34c84a94337d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:42.880134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776a8d7-12b5-42e0-81af-34c84a94337d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:42.880134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776a8d7-12b5-42e0-81af-34c84a94337d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:42.880134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776a8d7-12b5-42e0-81af-34c84a94337d None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:42.880134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776a8d7-12b5-42e0-81af-34c84a94337d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:42.880134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776a8d7-12b5-42e0-81af-34c84a94337d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:42.880898 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776a8d7-12b5-42e0-81af-34c84a94337d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:42.885561 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4aabf-3f7f-4b99-983c-8e1b1228358a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:42.886248 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4aabf-3f7f-4b99-983c-8e1b1228358a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:42.886592 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4aabf-3f7f-4b99-983c-8e1b1228358a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:42.886927 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4aabf-3f7f-4b99-983c-8e1b1228358a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:42.887720 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d4aabf-3f7f-4b99-983c-8e1b1228358a None admin] RBAC: Adding query filter params (role.id=0df7ee13692d4eb5a741a8b79fd58d58, scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e, user.id=8d099678d6454f7eb494892a69feaf62) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:42.888095 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d4aabf-3f7f-4b99-983c-8e1b1228358a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:42.889703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d4aabf-3f7f-4b99-983c-8e1b1228358a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:42.905780 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 254/530] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:42.905780 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776a8d7-12b5-42e0-81af-34c84a94337d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:42.906120 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 277/531] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:19:42 2022] GET /identity/v3/role_assignments?user.id=8d099678d6454f7eb494892a69feaf62&scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e&role.id=0df7ee13692d4eb5a741a8b79fd58d58 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:42.906120 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4aabf-3f7f-4b99-983c-8e1b1228358a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:43.021804 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776a8d7-12b5-42e0-81af-34c84a94337d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:43.050286 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4aabf-3f7f-4b99-983c-8e1b1228358a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:43.061809 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e867347-d19b-4351-a463-7a5b26160644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:43.062675 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e867347-d19b-4351-a463-7a5b26160644 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:43.063099 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e867347-d19b-4351-a463-7a5b26160644 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:43.063513 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e867347-d19b-4351-a463-7a5b26160644 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:43.064376 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e867347-d19b-4351-a463-7a5b26160644 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:43.064677 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e867347-d19b-4351-a463-7a5b26160644 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:43.066415 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e867347-d19b-4351-a463-7a5b26160644 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:43.079347 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 255/532] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:19:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:43.080350 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e867347-d19b-4351-a463-7a5b26160644 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:43.083204 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:43.098329 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87601f6-1f7a-46d5-b8e1-01a92ef0d04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:43.100776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87601f6-1f7a-46d5-b8e1-01a92ef0d04c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:43.100776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87601f6-1f7a-46d5-b8e1-01a92ef0d04c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:43.100776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87601f6-1f7a-46d5-b8e1-01a92ef0d04c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:43.111001 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87601f6-1f7a-46d5-b8e1-01a92ef0d04c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:43.112635 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87601f6-1f7a-46d5-b8e1-01a92ef0d04c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:43.128053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-b87601f6-1f7a-46d5-b8e1-01a92ef0d04c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:43.128053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:43.128053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:43.128053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:43.128053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:43.128053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:43.128053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:43.128053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:43.128053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:43.128053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:43.128053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:43.128053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:43.128053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:43.128053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:43.128053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:43.128053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:43.129438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:43.129438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:43.129438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:43.129438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:43.129438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:43.129438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:43.129438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:43.129438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:43.129438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:43.129438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:43.129438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:43.129438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:43.129438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:43.129438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:43.129438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:43.129438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:43.129438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:43.130538 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:43.130538 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:43.130538 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:43.130538 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 278/533] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:43.130804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87601f6-1f7a-46d5-b8e1-01a92ef0d04c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:43.182365 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:43.194102 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e867347-d19b-4351-a463-7a5b26160644 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:43.233254 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99635ef7-e235-48fd-81c4-63ed54d38409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:43.238246 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99635ef7-e235-48fd-81c4-63ed54d38409 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:43.238648 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99635ef7-e235-48fd-81c4-63ed54d38409 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:43.239048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99635ef7-e235-48fd-81c4-63ed54d38409 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:43.246948 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99635ef7-e235-48fd-81c4-63ed54d38409 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:43.248627 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99635ef7-e235-48fd-81c4-63ed54d38409 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:43.261034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-99635ef7-e235-48fd-81c4-63ed54d38409 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:19:43.261034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:43.261034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:43.261034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:43.261034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:43.261034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:43.261034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:43.261034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:43.261034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:43.261034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:43.261034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:43.261034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:43.261034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:19:43.261034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:19:43.261034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:19:43.262162 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:19:43.262162 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:43.262162 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:43.262162 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:43.262162 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:43.262162 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:43.262162 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:43.262162 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:43.262162 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:43.262162 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:43.262162 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:43.262162 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:43.262162 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:43.262162 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:43.262162 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:43.262162 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:43.262162 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:43.263762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:19:43.263762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:19:43.263762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:19:43.263762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:19:43.263762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:19:43.263762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:19:43.263762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:19:43.263762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:43.270440 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 256/534] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:19:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:43.271456 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99635ef7-e235-48fd-81c4-63ed54d38409 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:43.275128 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87601f6-1f7a-46d5-b8e1-01a92ef0d04c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:43.320484 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be3fa3-4ea3-404c-86aa-2c2a8a128674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:43.321269 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be3fa3-4ea3-404c-86aa-2c2a8a128674 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:43.321650 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be3fa3-4ea3-404c-86aa-2c2a8a128674 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:43.322054 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be3fa3-4ea3-404c-86aa-2c2a8a128674 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:43.322897 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be3fa3-4ea3-404c-86aa-2c2a8a128674 None admin] RBAC: Adding query filter params (role.id=0df7ee13692d4eb5a741a8b79fd58d58, scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e, user.id=78745f9dbf544ab291acfa7a063c1493) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:43.323312 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be3fa3-4ea3-404c-86aa-2c2a8a128674 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:43.324839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be3fa3-4ea3-404c-86aa-2c2a8a128674 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:43.331916 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 279/535] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:19:43 2022] GET /identity/v3/role_assignments?user.id=78745f9dbf544ab291acfa7a063c1493&scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e&role.id=0df7ee13692d4eb5a741a8b79fd58d58 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:43.332890 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be3fa3-4ea3-404c-86aa-2c2a8a128674 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:43.347377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:43.396543 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99635ef7-e235-48fd-81c4-63ed54d38409 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:43.440272 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b1e2f-6161-4809-a2aa-454545ed5996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:43.441073 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b1e2f-6161-4809-a2aa-454545ed5996 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:43.441498 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b1e2f-6161-4809-a2aa-454545ed5996 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:43.441905 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b1e2f-6161-4809-a2aa-454545ed5996 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:43.442855 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b1e2f-6161-4809-a2aa-454545ed5996 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:43.443259 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b1e2f-6161-4809-a2aa-454545ed5996 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:43.449773 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b1e2f-6161-4809-a2aa-454545ed5996 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:43.460971 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 257/536] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:43.467490 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b1e2f-6161-4809-a2aa-454545ed5996 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:43.492980 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:43.501370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be3fa3-4ea3-404c-86aa-2c2a8a128674 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:43.565908 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8bad5-3229-40dc-b199-4ff0cd5fe698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:43.566257 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8bad5-3229-40dc-b199-4ff0cd5fe698 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:43.566463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8bad5-3229-40dc-b199-4ff0cd5fe698 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:43.566729 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8bad5-3229-40dc-b199-4ff0cd5fe698 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:43.567437 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8bad5-3229-40dc-b199-4ff0cd5fe698 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:43.568614 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8bad5-3229-40dc-b199-4ff0cd5fe698 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:43.569185 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8bad5-3229-40dc-b199-4ff0cd5fe698 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:43.593457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 280/537] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:19:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:43.599867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8bad5-3229-40dc-b199-4ff0cd5fe698 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:43.625957 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b1e2f-6161-4809-a2aa-454545ed5996 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:43.684532 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:43.715522 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a435e0-11fe-4d01-b38f-4cbf639382cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:43.717835 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a435e0-11fe-4d01-b38f-4cbf639382cf None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:43.718428 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a435e0-11fe-4d01-b38f-4cbf639382cf None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:43.720719 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a435e0-11fe-4d01-b38f-4cbf639382cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:43.725025 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8bad5-3229-40dc-b199-4ff0cd5fe698 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:43.738133 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a435e0-11fe-4d01-b38f-4cbf639382cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:43.740044 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a435e0-11fe-4d01-b38f-4cbf639382cf None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:43.758779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-f1a435e0-11fe-4d01-b38f-4cbf639382cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:19:43.758779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:43.758779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:43.758779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:43.758779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:43.758779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:43.758779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:43.758779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:43.758779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:43.758779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:43.758779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:43.758779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:43.758779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:19:43.758779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:19:43.758779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:19:43.759689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:19:43.759689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:43.759689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:43.759689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:43.759689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:43.759689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:43.759689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:43.759689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:43.759689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:43.759689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:43.759689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:43.759689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:43.759689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:43.759689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:43.759689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:43.759689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:43.759689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:43.760557 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:19:43.760557 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:19:43.760557 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:19:43.760557 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:19:43.760557 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:19:43.760557 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:19:43.760557 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:19:43.760557 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:43.763714 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 258/538] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:19:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:43.768179 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a435e0-11fe-4d01-b38f-4cbf639382cf None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:43.805214 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c34d02-64da-4773-ab0d-22a3cfd727ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:43.806325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c34d02-64da-4773-ab0d-22a3cfd727ba None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:43.807461 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c34d02-64da-4773-ab0d-22a3cfd727ba None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:43.808162 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c34d02-64da-4773-ab0d-22a3cfd727ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:43.811531 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c34d02-64da-4773-ab0d-22a3cfd727ba None admin] RBAC: Adding query filter params (role.id=0df7ee13692d4eb5a741a8b79fd58d58, scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e, user.id=d03ddcf4bcc24f86be508345ad63ab5f) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:43.812145 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c34d02-64da-4773-ab0d-22a3cfd727ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:43.813848 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c34d02-64da-4773-ab0d-22a3cfd727ba None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:43.825056 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 281/539] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:19:43 2022] GET /identity/v3/role_assignments?user.id=d03ddcf4bcc24f86be508345ad63ab5f&scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e&role.id=0df7ee13692d4eb5a741a8b79fd58d58 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:43.939778 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a435e0-11fe-4d01-b38f-4cbf639382cf None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:43.985377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2091b-255a-4f46-9d01-8867da26b914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:43.990081 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2091b-255a-4f46-9d01-8867da26b914 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:43.990372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2091b-255a-4f46-9d01-8867da26b914 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:43.990644 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2091b-255a-4f46-9d01-8867da26b914 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:43.991364 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2091b-255a-4f46-9d01-8867da26b914 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:43.991669 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2091b-255a-4f46-9d01-8867da26b914 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:43.993130 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2091b-255a-4f46-9d01-8867da26b914 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:44.010963 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 259/540] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:19:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:44.016640 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c34d02-64da-4773-ab0d-22a3cfd727ba None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:44.057526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:44.128734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354d51b-5cf4-4add-ab7b-1f57cf11d8e2 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:44.129278 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354d51b-5cf4-4add-ab7b-1f57cf11d8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:44.129554 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354d51b-5cf4-4add-ab7b-1f57cf11d8e2 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:44.133844 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 260/541] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:44.151754 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9a36b-75d0-46fe-bfff-48d20b31fb4b None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:44.152040 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9a36b-75d0-46fe-bfff-48d20b31fb4b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:44.152317 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9a36b-75d0-46fe-bfff-48d20b31fb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:44.166244 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c34d02-64da-4773-ab0d-22a3cfd727ba None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:44.191140 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-acc9a36b-75d0-46fe-bfff-48d20b31fb4b None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:44.192408 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-acc9a36b-75d0-46fe-bfff-48d20b31fb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:44.204840 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8608804-653f-4ef4-a5fc-62819b9431b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:44.205717 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8608804-653f-4ef4-a5fc-62819b9431b1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:44.206159 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8608804-653f-4ef4-a5fc-62819b9431b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:44.206569 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8608804-653f-4ef4-a5fc-62819b9431b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:44.207456 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8608804-653f-4ef4-a5fc-62819b9431b1 None admin] RBAC: Adding query filter params (role.id=0df7ee13692d4eb5a741a8b79fd58d58, scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e, user.id=cb5021b569db41a08218cbec928442af) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:44.207905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8608804-653f-4ef4-a5fc-62819b9431b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:44.209482 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8608804-653f-4ef4-a5fc-62819b9431b1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:44.215668 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 282/542] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:19:44 2022] GET /identity/v3/role_assignments?user.id=cb5021b569db41a08218cbec928442af&scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e&role.id=0df7ee13692d4eb5a741a8b79fd58d58 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:44.285103 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:44.333058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 261/543] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:44.659416 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8608804-653f-4ef4-a5fc-62819b9431b1 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:44.761481 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:44.776413 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8608804-653f-4ef4-a5fc-62819b9431b1 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:44.827041 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987cfcb-6fce-4c63-8065-4ae55dc19d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:44.827854 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987cfcb-6fce-4c63-8065-4ae55dc19d8c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:44.828137 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987cfcb-6fce-4c63-8065-4ae55dc19d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:44.828410 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987cfcb-6fce-4c63-8065-4ae55dc19d8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:44.843180 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987cfcb-6fce-4c63-8065-4ae55dc19d8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:44.847867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-3987cfcb-6fce-4c63-8065-4ae55dc19d8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:19:44.847867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:44.847867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:44.847867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:44.847867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:44.847867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:44.847867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:44.847867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:44.847867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:44.847867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:44.847867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:44.847867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:44.847867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:44.847867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:44.847867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:44.847867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:44.848724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:44.848724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:44.848724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:44.848724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:44.848724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:44.848724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:44.848724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:44.848724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:44.848724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:44.848724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:44.848724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:44.848724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:44.848724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:44.848724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:44.848724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:44.848724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:44.849514 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:44.849514 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:44.849514 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:44.849514 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:44.849514 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:44.849514 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:44.849514 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:44.849514 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:44.849514 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:44.849514 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:44.849514 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:19:44.849514 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:44.849514 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 283/544] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 14:19:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:44.856345 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9a36b-75d0-46fe-bfff-48d20b31fb4b None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:44.989206 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9a36b-75d0-46fe-bfff-48d20b31fb4b None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:45.024521 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d8c81-a912-4303-9703-b38ac9d98721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:45.025124 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d8c81-a912-4303-9703-b38ac9d98721 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:45.025401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d8c81-a912-4303-9703-b38ac9d98721 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:45.025667 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d8c81-a912-4303-9703-b38ac9d98721 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:45.026350 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d8c81-a912-4303-9703-b38ac9d98721 None admin] RBAC: Adding query filter params (name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:45.026647 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d8c81-a912-4303-9703-b38ac9d98721 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:45.028011 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d8c81-a912-4303-9703-b38ac9d98721 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:45.036630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 262/545] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 14:19:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:45.042301 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987cfcb-6fce-4c63-8065-4ae55dc19d8c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:45.117574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60624672-118c-4509-b9b2-e8de283b699f None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:45.117942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60624672-118c-4509-b9b2-e8de283b699f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:45.118155 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60624672-118c-4509-b9b2-e8de283b699f None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:45.119730 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 263/546] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:45.132353 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287c31b-dbf6-4543-b25f-70542c4a8ee8 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:45.132768 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287c31b-dbf6-4543-b25f-70542c4a8ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:45.133142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287c31b-dbf6-4543-b25f-70542c4a8ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:45.154445 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-9287c31b-dbf6-4543-b25f-70542c4a8ee8 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:45.161775 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9287c31b-dbf6-4543-b25f-70542c4a8ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:45.190192 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:45.224610 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987cfcb-6fce-4c63-8065-4ae55dc19d8c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:45.257118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 264/547] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:19:45.270104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29a5c4-b260-4b54-9a27-dd88619620b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:45.270863 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29a5c4-b260-4b54-9a27-dd88619620b2 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:45.271239 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29a5c4-b260-4b54-9a27-dd88619620b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:45.271608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29a5c4-b260-4b54-9a27-dd88619620b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:45.283204 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a29a5c4-b260-4b54-9a27-dd88619620b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:45.284890 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a29a5c4-b260-4b54-9a27-dd88619620b2 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:45.299898 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-6a29a5c4-b260-4b54-9a27-dd88619620b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:45.299898 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:45.299898 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:45.299898 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:45.299898 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:45.299898 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:45.299898 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:45.299898 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:45.299898 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:45.299898 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:45.299898 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:45.299898 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:45.299898 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:45.299898 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:45.299898 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:45.299898 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:45.300930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:45.300930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:45.300930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:45.300930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:45.300930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:45.300930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:45.300930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:45.300930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:45.300930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:45.300930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:45.300930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:45.300930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:45.300930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:45.300930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:45.300930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:45.300930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:45.300930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:45.302030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:45.302030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:45.302030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:45.302030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 284/548] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:45.306108 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:45.312110 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287c31b-dbf6-4543-b25f-70542c4a8ee8 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:45.433546 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287c31b-dbf6-4543-b25f-70542c4a8ee8 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:45.470361 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48548be7-26d4-42c0-a102-b260b605938e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:45.471252 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48548be7-26d4-42c0-a102-b260b605938e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:45.471734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48548be7-26d4-42c0-a102-b260b605938e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:45.472197 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48548be7-26d4-42c0-a102-b260b605938e None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:45.473425 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48548be7-26d4-42c0-a102-b260b605938e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:45.474026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48548be7-26d4-42c0-a102-b260b605938e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:45.475595 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48548be7-26d4-42c0-a102-b260b605938e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:45.488327 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 265/549] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:45.496202 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29a5c4-b260-4b54-9a27-dd88619620b2 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:45.644990 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29a5c4-b260-4b54-9a27-dd88619620b2 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:45.670915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48548be7-26d4-42c0-a102-b260b605938e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:45.687771 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad231c9-e348-4188-aa18-bf3cce30de47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:45.688437 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad231c9-e348-4188-aa18-bf3cce30de47 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:45.688674 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad231c9-e348-4188-aa18-bf3cce30de47 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:45.688938 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad231c9-e348-4188-aa18-bf3cce30de47 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:45.703485 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad231c9-e348-4188-aa18-bf3cce30de47 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:45.704948 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad231c9-e348-4188-aa18-bf3cce30de47 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:45.727901 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:45.728313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-dad231c9-e348-4188-aa18-bf3cce30de47 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 14:19:45.728313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:45.728313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:45.728313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:45.728313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:45.728313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:45.728313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:45.728313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:45.728313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:45.728313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:45.728313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:45.728313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:45.728313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:19:45.728313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:19:45.728313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:19:45.728313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:19:45.729273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:45.729273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:45.729273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:19:45.729273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:45.729273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:19:45.729273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:45.729273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:45.729273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:45.729273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:45.729273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:45.729273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:45.729273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:45.729273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:45.729273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:45.729273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:45.729273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:45.729273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:45.729273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:45.730195 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:45.730195 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:45.730195 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:19:45.730195 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:19:45.730195 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:19:45.730195 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:19:45.730195 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:19:45.730195 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:19:45.730195 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 14:19:45.730195 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:45.731194 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 285/550] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:19:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:45.735774 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad231c9-e348-4188-aa18-bf3cce30de47 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:45.832962 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:45.833573 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48548be7-26d4-42c0-a102-b260b605938e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:45.869343 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77095ee3-78c3-4303-8cc7-f01fb9db6e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:45.870778 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77095ee3-78c3-4303-8cc7-f01fb9db6e11 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:45.871260 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77095ee3-78c3-4303-8cc7-f01fb9db6e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:45.871760 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77095ee3-78c3-4303-8cc7-f01fb9db6e11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:45.881983 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad231c9-e348-4188-aa18-bf3cce30de47 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:45.884038 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77095ee3-78c3-4303-8cc7-f01fb9db6e11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:45.890398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-77095ee3-78c3-4303-8cc7-f01fb9db6e11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:19:45.890398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:45.890398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:45.890398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:45.890398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:45.890398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:45.890398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:45.890398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:45.890398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:45.890398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:45.890398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:45.890398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:45.890398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:45.890398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:45.890398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:45.890398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:45.891509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:45.891509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:45.891509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:45.891509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:45.891509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:45.891509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:45.891509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:45.891509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:45.891509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:45.891509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:45.891509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:45.891509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:45.891509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:45.891509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:45.891509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:45.891509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:45.892379 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:45.892379 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:45.892379 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:45.892379 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:45.892379 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:45.892379 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:45.892379 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:45.892379 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:45.892379 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:45.892379 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:45.892379 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:19:45.892379 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:45.899641 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 266/551] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 14:19:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:45.901260 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9b01a-e612-4f39-a24a-a9937773a47a None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:45.901788 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9b01a-e612-4f39-a24a-a9937773a47a None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:45.902267 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9b01a-e612-4f39-a24a-a9937773a47a None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:45.908322 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 267/552] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:45.909363 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9b01a-e612-4f39-a24a-a9937773a47a None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:45.917532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746799f-17f8-4500-9db7-81c411b80b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:45.918182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746799f-17f8-4500-9db7-81c411b80b21 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:45.918460 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746799f-17f8-4500-9db7-81c411b80b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:45.918729 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746799f-17f8-4500-9db7-81c411b80b21 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:45.919512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746799f-17f8-4500-9db7-81c411b80b21 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:45.919926 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746799f-17f8-4500-9db7-81c411b80b21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:45.921465 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746799f-17f8-4500-9db7-81c411b80b21 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:45.948642 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 286/553] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Aug 24 14:19:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:45.948642 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8e2d6-5b31-4ede-9b99-cbc4ac323137 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:45.948642 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8e2d6-5b31-4ede-9b99-cbc4ac323137 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:45.948642 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8e2d6-5b31-4ede-9b99-cbc4ac323137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:45.969325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e2d8e2d6-5b31-4ede-9b99-cbc4ac323137 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:45.971003 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e2d8e2d6-5b31-4ede-9b99-cbc4ac323137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:46.014579 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:46.033633 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9b01a-e612-4f39-a24a-a9937773a47a None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:46.063345 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 287/554] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:46.065852 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8e2d6-5b31-4ede-9b99-cbc4ac323137 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:46.086484 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2396e07-d5e2-46e4-be63-ed8e59f47db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:46.087424 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2396e07-d5e2-46e4-be63-ed8e59f47db4 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:46.087929 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2396e07-d5e2-46e4-be63-ed8e59f47db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:46.088408 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2396e07-d5e2-46e4-be63-ed8e59f47db4 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:46.089413 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2396e07-d5e2-46e4-be63-ed8e59f47db4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:46.092094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2396e07-d5e2-46e4-be63-ed8e59f47db4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:46.094117 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2396e07-d5e2-46e4-be63-ed8e59f47db4 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:46.116928 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 268/555] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 14:19:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:46.118798 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2396e07-d5e2-46e4-be63-ed8e59f47db4 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:46.180466 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:46.265851 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8e2d6-5b31-4ede-9b99-cbc4ac323137 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:46.273589 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2396e07-d5e2-46e4-be63-ed8e59f47db4 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:46.306700 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bee55d-76ee-4429-becd-ed6a91bd6124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:46.307309 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bee55d-76ee-4429-becd-ed6a91bd6124 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:46.307644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bee55d-76ee-4429-becd-ed6a91bd6124 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:46.307918 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bee55d-76ee-4429-becd-ed6a91bd6124 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:46.319701 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd9ce0-4f51-436d-ac8d-d6cca378a890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:46.321086 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd9ce0-4f51-436d-ac8d-d6cca378a890 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:46.321579 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd9ce0-4f51-436d-ac8d-d6cca378a890 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:46.322457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd9ce0-4f51-436d-ac8d-d6cca378a890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:46.334318 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd9ce0-4f51-436d-ac8d-d6cca378a890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:46.336018 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd9ce0-4f51-436d-ac8d-d6cca378a890 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:46.342980 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:46.352058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-1ffd9ce0-4f51-436d-ac8d-d6cca378a890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:46.352058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:46.352058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:46.352058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:46.352058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:46.352058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:46.352058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:46.352058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:46.352058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:46.352058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:46.352058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:46.352058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:46.352058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:46.352058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:46.352058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:46.352058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:46.359717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:46.359717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:46.359717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:46.359717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:46.359717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:46.359717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:46.359717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:46.359717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:46.359717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:46.359717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:46.359717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:46.359717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:46.359717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:46.359717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:46.359717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:46.359717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:46.359717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:46.360944 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:46.360944 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:46.360944 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:46.361459 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 269/556] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:19:46.362989 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f470d6-e6b3-40a8-8b4f-57c503fe792c None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:46.363457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f470d6-e6b3-40a8-8b4f-57c503fe792c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:46.363909 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f470d6-e6b3-40a8-8b4f-57c503fe792c None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:46.365935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 270/557] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:46.370506 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f470d6-e6b3-40a8-8b4f-57c503fe792c None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:46.394463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bee55d-76ee-4429-becd-ed6a91bd6124 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:46.396193 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bee55d-76ee-4429-becd-ed6a91bd6124 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:46.444935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:46.479882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f470d6-e6b3-40a8-8b4f-57c503fe792c None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:46.517398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c08dd-cb1a-47c7-8c0b-1626eb26a1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:46.518028 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c08dd-cb1a-47c7-8c0b-1626eb26a1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:46.518311 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c08dd-cb1a-47c7-8c0b-1626eb26a1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:46.518580 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c08dd-cb1a-47c7-8c0b-1626eb26a1a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:46.519406 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c08dd-cb1a-47c7-8c0b-1626eb26a1a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:46.519522 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c08dd-cb1a-47c7-8c0b-1626eb26a1a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:46.520873 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c08dd-cb1a-47c7-8c0b-1626eb26a1a8 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:46.527515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 288/558] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:19:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:19:46.527515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748e1f6-6758-4047-8676-c02a17e604a8 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:46.527515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748e1f6-6758-4047-8676-c02a17e604a8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:46.527515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748e1f6-6758-4047-8676-c02a17e604a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:46.543348 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 271/559] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:46.543348 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c08dd-cb1a-47c7-8c0b-1626eb26a1a8 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:46.548985 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a748e1f6-6758-4047-8676-c02a17e604a8 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:46.550211 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a748e1f6-6758-4047-8676-c02a17e604a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:46.601599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:46.629895 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 289/560] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:46.630797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748e1f6-6758-4047-8676-c02a17e604a8 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:46.648661 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c08dd-cb1a-47c7-8c0b-1626eb26a1a8 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:46.687051 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fea3c-bb28-4184-96b4-437da8e2f4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:46.687708 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fea3c-bb28-4184-96b4-437da8e2f4f9 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:46.688041 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fea3c-bb28-4184-96b4-437da8e2f4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:46.688273 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fea3c-bb28-4184-96b4-437da8e2f4f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:46.699484 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94fea3c-bb28-4184-96b4-437da8e2f4f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:46.704620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-a94fea3c-bb28-4184-96b4-437da8e2f4f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:19:46.704620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:46.704620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:46.704620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:46.704620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:46.704620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:46.704620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:46.704620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:46.704620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:46.704620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:46.704620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:46.704620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:46.704620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:46.704620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:46.704620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:46.704620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:46.705559 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:46.705559 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:46.705559 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:46.705559 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:46.705559 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:46.705559 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:46.705559 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:46.705559 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:46.705559 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:46.705559 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:46.705559 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:46.705559 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:46.705559 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:46.705559 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:46.705559 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:46.705559 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:46.711315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:46.711315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:46.711315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:46.711315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:46.711315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:46.711315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:46.711315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:46.711315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:46.711315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:46.711315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:46.711315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:19:46.711315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:46.711315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 272/561] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 14:19:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:46.711315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fea3c-bb28-4184-96b4-437da8e2f4f9 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:46.714785 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:46.741862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748e1f6-6758-4047-8676-c02a17e604a8 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:46.777883 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f6419-68c5-4990-b071-829f1bc43b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:46.778501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f6419-68c5-4990-b071-829f1bc43b98 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:46.779524 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f6419-68c5-4990-b071-829f1bc43b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:46.779988 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f6419-68c5-4990-b071-829f1bc43b98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:46.793689 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f6419-68c5-4990-b071-829f1bc43b98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:46.796527 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f6419-68c5-4990-b071-829f1bc43b98 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:46.814139 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-f66f6419-68c5-4990-b071-829f1bc43b98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:46.814139 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:46.814139 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:46.814139 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:46.814139 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:46.814139 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:46.814139 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:46.814139 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:46.814139 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:46.814139 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:46.814139 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:46.814139 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:46.814139 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:46.814139 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:46.814139 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:46.814139 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:46.815210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:46.815210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:46.815210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:46.815210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:46.815210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:46.815210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:46.815210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:46.815210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:46.815210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:46.815210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:46.815210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:46.815210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:46.815210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:46.815210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:46.815210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:46.815210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:46.815210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:46.816228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:46.816228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:46.816228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:46.816423 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fea3c-bb28-4184-96b4-437da8e2f4f9 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:46.820122 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 290/562] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:46.821350 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50716720-d3b6-440b-8da6-26e126abdbb0 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:46.821642 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50716720-d3b6-440b-8da6-26e126abdbb0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:46.821966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50716720-d3b6-440b-8da6-26e126abdbb0 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:46.823379 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 291/563] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:46.823932 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50716720-d3b6-440b-8da6-26e126abdbb0 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:46.838825 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:46.857658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bb197-dd04-46f9-bbfd-5603e38fa336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:46.858564 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bb197-dd04-46f9-bbfd-5603e38fa336 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:46.858564 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bb197-dd04-46f9-bbfd-5603e38fa336 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:46.858844 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bb197-dd04-46f9-bbfd-5603e38fa336 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:46.866384 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924bb197-dd04-46f9-bbfd-5603e38fa336 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:46.867883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924bb197-dd04-46f9-bbfd-5603e38fa336 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:46.879583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-924bb197-dd04-46f9-bbfd-5603e38fa336 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:19:46.879583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:46.879583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:46.879583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:46.879583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:46.879583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:46.879583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:46.879583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:46.879583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:46.879583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:46.879583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:46.879583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:46.879583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:19:46.879583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:19:46.879583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:19:46.879583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:19:46.881024 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:46.881024 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:46.881024 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:19:46.881024 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:46.881024 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:19:46.881024 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:46.881024 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:46.881024 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:46.881024 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:46.881024 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:46.881024 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:46.881024 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:46.881024 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:46.881024 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:46.881024 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:46.881024 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:46.881024 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:46.881024 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:46.882025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:46.882025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:46.882025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:19:46.882025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:19:46.882025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:19:46.882025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:19:46.882025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:19:46.882025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:19:46.882025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:19:46.882025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:46.882025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 273/564] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Aug 24 14:19:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:46.882025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bb197-dd04-46f9-bbfd-5603e38fa336 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:46.938681 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50716720-d3b6-440b-8da6-26e126abdbb0 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:46.964870 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:46.973072 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d9c37-f730-49f2-b1d0-d12b45d0c091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:46.973669 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d9c37-f730-49f2-b1d0-d12b45d0c091 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:46.977340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d9c37-f730-49f2-b1d0-d12b45d0c091 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:46.977340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d9c37-f730-49f2-b1d0-d12b45d0c091 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:46.977340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d9c37-f730-49f2-b1d0-d12b45d0c091 None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:46.977340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d9c37-f730-49f2-b1d0-d12b45d0c091 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:46.977340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d9c37-f730-49f2-b1d0-d12b45d0c091 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:46.984706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 292/565] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 14:19:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:46.985559 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bb197-dd04-46f9-bbfd-5603e38fa336 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:46.985881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5086ce-abaf-4151-88af-80e8c3835de2 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:46.986160 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5086ce-abaf-4151-88af-80e8c3835de2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:46.986429 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5086ce-abaf-4151-88af-80e8c3835de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:47.004483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-be5086ce-abaf-4151-88af-80e8c3835de2 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:47.005710 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-be5086ce-abaf-4151-88af-80e8c3835de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:47.021569 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58934f22-f50d-4ce2-aabb-c59550d3bf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:47.022193 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58934f22-f50d-4ce2-aabb-c59550d3bf7e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:47.022472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58934f22-f50d-4ce2-aabb-c59550d3bf7e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:47.022747 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58934f22-f50d-4ce2-aabb-c59550d3bf7e None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:47.023380 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58934f22-f50d-4ce2-aabb-c59550d3bf7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:47.023680 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58934f22-f50d-4ce2-aabb-c59550d3bf7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:47.025020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58934f22-f50d-4ce2-aabb-c59550d3bf7e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:47.037272 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 274/566] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:47.038014 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58934f22-f50d-4ce2-aabb-c59550d3bf7e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:47.076094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:47.078567 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 293/567] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:47.079402 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5086ce-abaf-4151-88af-80e8c3835de2 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:47.138541 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58934f22-f50d-4ce2-aabb-c59550d3bf7e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:47.174871 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d9c33-1b99-444b-b3a4-02bb15b5b57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:47.175470 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d9c33-1b99-444b-b3a4-02bb15b5b57f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:47.175745 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d9c33-1b99-444b-b3a4-02bb15b5b57f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:47.176018 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d9c33-1b99-444b-b3a4-02bb15b5b57f None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:47.176745 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d9c33-1b99-444b-b3a4-02bb15b5b57f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:47.177051 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d9c33-1b99-444b-b3a4-02bb15b5b57f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:47.178502 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d9c33-1b99-444b-b3a4-02bb15b5b57f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:47.193392 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5086ce-abaf-4151-88af-80e8c3835de2 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:47.200609 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 275/568] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Aug 24 14:19:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:47.200609 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d9c33-1b99-444b-b3a4-02bb15b5b57f None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:47.215503 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:47.232614 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e79ce-325e-4750-8d60-6236a883aeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:47.233277 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e79ce-325e-4750-8d60-6236a883aeca None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:47.233556 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e79ce-325e-4750-8d60-6236a883aeca None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:47.233865 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e79ce-325e-4750-8d60-6236a883aeca None admin] PATH_INFO: `/v3/roles/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:47.243918 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e79ce-325e-4750-8d60-6236a883aeca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:47.249679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-f99e79ce-325e-4750-8d60-6236a883aeca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:19:47.249679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:47.249679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:47.249679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:47.249679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:47.249679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:47.249679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:47.249679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:47.249679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:47.249679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:47.249679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:47.249679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:47.249679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:47.249679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:47.249679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:47.249679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:47.250678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:47.250678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:47.250678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:47.250678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:47.250678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:47.250678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:47.250678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:47.250678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:47.250678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:47.250678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:47.250678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:47.250678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:47.250678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:47.250678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:47.250678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:47.250678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:47.251525 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:47.251525 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:47.251525 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:47.251525 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:47.251525 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:47.251525 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:47.251525 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:47.251525 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:47.251525 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:47.251525 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:47.251525 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:19:47.251525 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:47.258597 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 294/569] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 14:19:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:47.258597 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e79ce-325e-4750-8d60-6236a883aeca None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:47.306565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:47.313667 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d9c33-1b99-444b-b3a4-02bb15b5b57f None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:47.350985 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78757e7e-5a3a-4308-a4e3-7be3790ecd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:47.351605 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78757e7e-5a3a-4308-a4e3-7be3790ecd33 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:47.351882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78757e7e-5a3a-4308-a4e3-7be3790ecd33 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:47.352152 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78757e7e-5a3a-4308-a4e3-7be3790ecd33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:47.362501 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78757e7e-5a3a-4308-a4e3-7be3790ecd33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:47.363964 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78757e7e-5a3a-4308-a4e3-7be3790ecd33 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:47.364268 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e79ce-325e-4750-8d60-6236a883aeca None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:47.379664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-78757e7e-5a3a-4308-a4e3-7be3790ecd33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:47.379664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:47.379664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:47.379664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:47.379664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:47.379664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:47.379664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:47.379664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:47.379664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:47.379664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:47.379664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:47.379664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:47.379664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:47.379664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:47.379664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:47.379664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:47.380618 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:47.380618 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:47.380618 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:47.380618 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:47.380618 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:47.380618 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:47.380618 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:47.380618 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:47.380618 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:47.380618 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:47.380618 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:47.380618 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:47.380618 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:47.380618 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:47.380618 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:47.380618 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:47.380618 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:47.381489 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:47.381489 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:47.381489 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:47.381489 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 276/570] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:47.381489 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78757e7e-5a3a-4308-a4e3-7be3790ecd33 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:47.404547 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbeba4-2ff4-4be9-b9dd-38c34f7d9799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:47.405290 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbeba4-2ff4-4be9-b9dd-38c34f7d9799 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:47.405630 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbeba4-2ff4-4be9-b9dd-38c34f7d9799 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:47.405935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbeba4-2ff4-4be9-b9dd-38c34f7d9799 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:47.412452 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dbeba4-2ff4-4be9-b9dd-38c34f7d9799 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:47.413919 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dbeba4-2ff4-4be9-b9dd-38c34f7d9799 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:47.427971 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-d1dbeba4-2ff4-4be9-b9dd-38c34f7d9799 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:19:47.427971 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:47.427971 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:47.427971 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:47.427971 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:47.427971 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:47.427971 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:47.427971 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:47.427971 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:47.427971 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:47.427971 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:47.427971 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:47.427971 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:19:47.427971 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:19:47.427971 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:19:47.436501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:19:47.436501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:47.436501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:47.436501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:47.436501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:47.436501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:47.436501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:47.436501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:47.436501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:47.436501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:47.436501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:47.436501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:47.436501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:47.436501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:47.436501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:47.436501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:47.436501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:47.437400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:19:47.437400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:19:47.437400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:19:47.437400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:19:47.437400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:19:47.437400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:19:47.437400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:19:47.437400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:47.437400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 295/571] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:19:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:47.437400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbeba4-2ff4-4be9-b9dd-38c34f7d9799 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:47.475969 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:47.493844 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78757e7e-5a3a-4308-a4e3-7be3790ecd33 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:47.528154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d1d82-8bd9-4642-b638-b5b78eff4754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:47.528863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d1d82-8bd9-4642-b638-b5b78eff4754 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:47.529392 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d1d82-8bd9-4642-b638-b5b78eff4754 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:47.529670 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d1d82-8bd9-4642-b638-b5b78eff4754 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:47.535025 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbeba4-2ff4-4be9-b9dd-38c34f7d9799 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:47.540041 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d1d82-8bd9-4642-b638-b5b78eff4754 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:47.541476 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d1d82-8bd9-4642-b638-b5b78eff4754 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:47.549861 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:47.556079 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-093d1d82-8bd9-4642-b638-b5b78eff4754 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:47.556079 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:47.556079 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:47.556079 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:47.556079 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:47.556079 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:47.556079 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:47.556079 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:47.556079 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:47.556079 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:47.556079 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:47.556079 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:47.556079 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:47.556079 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:47.556079 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:47.556079 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:47.562038 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:47.562038 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:47.562038 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:47.562038 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:47.562038 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:47.562038 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:47.562038 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:47.562038 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:47.562038 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:47.562038 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:47.562038 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:47.562038 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:47.562038 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:47.562038 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:47.562038 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:47.562038 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:47.562038 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:47.562936 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:47.562936 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:47.562936 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:47.562936 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 277/572] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:47.562936 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d1d82-8bd9-4642-b638-b5b78eff4754 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:47.574623 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba505651-be0a-4429-8771-4347db6833e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:47.575230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba505651-be0a-4429-8771-4347db6833e3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:47.575563 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba505651-be0a-4429-8771-4347db6833e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:47.575844 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba505651-be0a-4429-8771-4347db6833e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:47.576506 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba505651-be0a-4429-8771-4347db6833e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:47.576829 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba505651-be0a-4429-8771-4347db6833e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:47.578206 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba505651-be0a-4429-8771-4347db6833e3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:47.586146 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 296/573] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 14:19:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:47.586916 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba505651-be0a-4429-8771-4347db6833e3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:47.662452 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d1d82-8bd9-4642-b638-b5b78eff4754 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:47.683593 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba505651-be0a-4429-8771-4347db6833e3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:47.685310 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:47.694958 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6ccdf-bf76-469a-91d4-0077955fcdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:47.695578 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6ccdf-bf76-469a-91d4-0077955fcdd3 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:47.695856 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6ccdf-bf76-469a-91d4-0077955fcdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:47.696131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6ccdf-bf76-469a-91d4-0077955fcdd3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:47.706844 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6ccdf-bf76-469a-91d4-0077955fcdd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:47.712078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-35b6ccdf-bf76-469a-91d4-0077955fcdd3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:19:47.712078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:47.712078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:47.712078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:47.712078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:47.712078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:47.712078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:47.712078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:47.712078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:47.712078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:47.712078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:47.712078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:47.712078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:47.712078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:47.712078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:47.712078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:47.713129 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:47.713129 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:47.713129 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:47.713129 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:47.713129 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:47.713129 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:47.713129 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:47.713129 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:47.713129 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:47.713129 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:47.713129 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:47.713129 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:47.713129 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:47.713129 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:47.713129 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:47.713129 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:47.714446 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:47.714446 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:47.714446 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:47.714446 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:47.714446 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:47.714446 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:47.714446 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:47.714446 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:47.714446 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:47.714446 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:47.714446 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:19:47.714446 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:47.714446 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 278/574] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 14:19:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:47.714446 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6ccdf-bf76-469a-91d4-0077955fcdd3 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:47.726932 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb8a4d-797c-4717-88a5-cbbfb97a7274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:47.727662 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb8a4d-797c-4717-88a5-cbbfb97a7274 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:47.728106 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb8a4d-797c-4717-88a5-cbbfb97a7274 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:47.728540 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb8a4d-797c-4717-88a5-cbbfb97a7274 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:47.729768 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb8a4d-797c-4717-88a5-cbbfb97a7274 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:47.730256 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb8a4d-797c-4717-88a5-cbbfb97a7274 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:47.732068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb8a4d-797c-4717-88a5-cbbfb97a7274 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:47.744196 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 297/575] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:47.744979 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb8a4d-797c-4717-88a5-cbbfb97a7274 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:47.777614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:47.819325 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6ccdf-bf76-469a-91d4-0077955fcdd3 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:47.846136 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb8a4d-797c-4717-88a5-cbbfb97a7274 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:47.854007 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0188569-fdee-46b1-b3b7-d919fb3b92b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:47.854614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0188569-fdee-46b1-b3b7-d919fb3b92b0 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:47.854894 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0188569-fdee-46b1-b3b7-d919fb3b92b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:47.855169 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0188569-fdee-46b1-b3b7-d919fb3b92b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:47.855859 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0188569-fdee-46b1-b3b7-d919fb3b92b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:47.856169 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0188569-fdee-46b1-b3b7-d919fb3b92b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:47.857620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0188569-fdee-46b1-b3b7-d919fb3b92b0 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:47.869278 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 279/576] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:19:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:47.870124 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0188569-fdee-46b1-b3b7-d919fb3b92b0 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:47.881182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be60aa6-679e-4a5f-88ad-b8b932029451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:47.881810 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be60aa6-679e-4a5f-88ad-b8b932029451 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:47.882086 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be60aa6-679e-4a5f-88ad-b8b932029451 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:47.882359 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be60aa6-679e-4a5f-88ad-b8b932029451 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:47.882996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be60aa6-679e-4a5f-88ad-b8b932029451 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:47.883294 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be60aa6-679e-4a5f-88ad-b8b932029451 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:47.884642 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be60aa6-679e-4a5f-88ad-b8b932029451 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:47.897035 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 298/577] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:47.897848 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be60aa6-679e-4a5f-88ad-b8b932029451 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:47.923422 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:47.978677 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0188569-fdee-46b1-b3b7-d919fb3b92b0 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:48.002291 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:48.003358 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be60aa6-679e-4a5f-88ad-b8b932029451 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:48.017442 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286027a-5776-4a15-ab88-58a7f2c8f0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:48.018100 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286027a-5776-4a15-ab88-58a7f2c8f0d0 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:48.018400 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286027a-5776-4a15-ab88-58a7f2c8f0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:48.018675 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286027a-5776-4a15-ab88-58a7f2c8f0d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:48.029193 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286027a-5776-4a15-ab88-58a7f2c8f0d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:48.030676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286027a-5776-4a15-ab88-58a7f2c8f0d0 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:48.039272 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abc4e8-b0ec-4fdc-b468-254764fe5674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:48.039881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abc4e8-b0ec-4fdc-b468-254764fe5674 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:48.040162 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abc4e8-b0ec-4fdc-b468-254764fe5674 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:48.040434 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abc4e8-b0ec-4fdc-b468-254764fe5674 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:48.041099 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1abc4e8-b0ec-4fdc-b468-254764fe5674 None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:48.041399 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1abc4e8-b0ec-4fdc-b468-254764fe5674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:48.042808 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1abc4e8-b0ec-4fdc-b468-254764fe5674 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:48.046354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-b286027a-5776-4a15-ab88-58a7f2c8f0d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:48.046354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:48.046354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:48.046354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:48.046354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:48.046354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:48.046354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:48.046354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:48.046354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:48.046354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:48.046354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:48.046354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:48.046354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:48.046354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:48.046354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:48.046354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:48.047274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:48.047274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:48.047274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:48.047274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:48.047274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:48.047274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:48.047274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:48.047274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:48.047274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:48.047274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:48.047274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:48.047274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:48.047274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:48.047274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:48.047274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:48.047274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:48.047274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:48.048188 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:48.048188 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:48.048188 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:48.049889 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 280/578] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:48.050872 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286027a-5776-4a15-ab88-58a7f2c8f0d0 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:48.056024 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 299/579] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 14:19:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:48.056024 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abc4e8-b0ec-4fdc-b468-254764fe5674 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:48.145093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:48.155429 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286027a-5776-4a15-ab88-58a7f2c8f0d0 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:48.164399 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abc4e8-b0ec-4fdc-b468-254764fe5674 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:48.192054 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bb346-c4a4-4dae-8238-54d123f5c733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:48.192678 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bb346-c4a4-4dae-8238-54d123f5c733 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:48.192964 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bb346-c4a4-4dae-8238-54d123f5c733 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:48.193232 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bb346-c4a4-4dae-8238-54d123f5c733 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:48.201808 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22bb346-c4a4-4dae-8238-54d123f5c733 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:48.203221 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ec12e-be38-4f6f-b89a-4db81d663535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:48.203363 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22bb346-c4a4-4dae-8238-54d123f5c733 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:48.203915 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ec12e-be38-4f6f-b89a-4db81d663535 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:48.204269 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ec12e-be38-4f6f-b89a-4db81d663535 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:48.204594 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ec12e-be38-4f6f-b89a-4db81d663535 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:48.205419 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ec12e-be38-4f6f-b89a-4db81d663535 None admin] RBAC: Adding query filter params (role.id=0df7ee13692d4eb5a741a8b79fd58d58, scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e, user.id=6b3c32ecfdcf40629f09a7f52b2b5fa8) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:48.205872 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ec12e-be38-4f6f-b89a-4db81d663535 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:48.207422 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ec12e-be38-4f6f-b89a-4db81d663535 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:48.213167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 300/580] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:19:48 2022] GET /identity/v3/role_assignments?user.id=6b3c32ecfdcf40629f09a7f52b2b5fa8&scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e&role.id=0df7ee13692d4eb5a741a8b79fd58d58 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:48.213968 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ec12e-be38-4f6f-b89a-4db81d663535 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:48.214329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-d22bb346-c4a4-4dae-8238-54d123f5c733 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 14:19:48.214329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:48.214329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:48.214329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:48.214329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:48.214329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:48.214329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:48.214329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:48.214329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:48.214329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:48.214329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:48.214329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:48.214329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:19:48.214329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:19:48.214329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:19:48.214329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:19:48.215239 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:48.215239 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:48.215239 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:19:48.215239 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:48.215239 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:19:48.215239 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:48.215239 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:48.215239 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:48.215239 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:48.215239 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:48.215239 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:48.215239 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:48.215239 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:48.215239 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:48.215239 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:48.215239 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:48.215239 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:48.215239 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:48.221338 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:48.221338 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:48.221338 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:19:48.221338 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:19:48.221338 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:19:48.221338 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:19:48.221338 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:19:48.221338 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:19:48.221338 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 14:19:48.221338 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:48.221338 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 281/581] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:19:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:48.221338 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bb346-c4a4-4dae-8238-54d123f5c733 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:48.259127 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:48.339272 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ec12e-be38-4f6f-b89a-4db81d663535 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:48.350372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bb346-c4a4-4dae-8238-54d123f5c733 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:48.386543 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45fb6f-42ce-4eac-8b0c-463217641ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:48.387178 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45fb6f-42ce-4eac-8b0c-463217641ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:48.387515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45fb6f-42ce-4eac-8b0c-463217641ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:48.387721 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45fb6f-42ce-4eac-8b0c-463217641ab3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:48.391437 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e225c5b-4d34-459d-bd88-f74e1548882f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:48.392228 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e225c5b-4d34-459d-bd88-f74e1548882f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:48.392506 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e225c5b-4d34-459d-bd88-f74e1548882f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:48.392780 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e225c5b-4d34-459d-bd88-f74e1548882f None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:48.393427 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e225c5b-4d34-459d-bd88-f74e1548882f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:48.393728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e225c5b-4d34-459d-bd88-f74e1548882f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:48.395125 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e225c5b-4d34-459d-bd88-f74e1548882f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:48.398867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d45fb6f-42ce-4eac-8b0c-463217641ab3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:48.400299 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d45fb6f-42ce-4eac-8b0c-463217641ab3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:48.409351 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 282/582] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:48.409351 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e225c5b-4d34-459d-bd88-f74e1548882f None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:48.419008 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-0d45fb6f-42ce-4eac-8b0c-463217641ab3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:19:48.419008 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:48.419008 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:48.419008 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:48.419008 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:48.419008 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:48.419008 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:48.419008 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:48.419008 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:48.419008 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:48.419008 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:48.419008 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:48.419008 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:19:48.419008 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:19:48.419008 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:19:48.420369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:19:48.420369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:48.420369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:48.420369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:48.420369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:48.420369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:48.420369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:48.420369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:48.420369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:48.420369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:48.420369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:48.420369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:48.420369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:48.420369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:48.420369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:48.420369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:48.420369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:48.421517 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:19:48.421517 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:19:48.421517 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:19:48.421517 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:19:48.421517 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:19:48.421517 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:19:48.421517 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:19:48.421517 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:48.421517 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 301/583] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:19:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:48.423432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45fb6f-42ce-4eac-8b0c-463217641ab3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:48.437863 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:48.508817 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:48.518255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e225c5b-4d34-459d-bd88-f74e1548882f None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:48.537885 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45fb6f-42ce-4eac-8b0c-463217641ab3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:48.555894 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18782fd1-da04-4d32-a45c-441005229007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:48.556528 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18782fd1-da04-4d32-a45c-441005229007 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:48.556805 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18782fd1-da04-4d32-a45c-441005229007 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:48.557076 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18782fd1-da04-4d32-a45c-441005229007 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:48.567455 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18782fd1-da04-4d32-a45c-441005229007 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:48.569035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18782fd1-da04-4d32-a45c-441005229007 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:48.571871 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454314de-69d3-4671-ae15-2b0f43eb5cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:48.572470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454314de-69d3-4671-ae15-2b0f43eb5cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:48.572748 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454314de-69d3-4671-ae15-2b0f43eb5cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:48.573017 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454314de-69d3-4671-ae15-2b0f43eb5cf8 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:48.573764 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454314de-69d3-4671-ae15-2b0f43eb5cf8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:48.574069 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454314de-69d3-4671-ae15-2b0f43eb5cf8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:48.575994 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454314de-69d3-4671-ae15-2b0f43eb5cf8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:48.585726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-18782fd1-da04-4d32-a45c-441005229007 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:48.585726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:48.585726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:48.585726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:48.585726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:48.585726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:48.585726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:48.585726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:48.585726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:48.585726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:48.585726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:48.585726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:48.585726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:48.585726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:48.585726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:48.585726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:48.586691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:48.586691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:48.586691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:48.586691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:48.586691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:48.586691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:48.586691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:48.586691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:48.586691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:48.586691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:48.586691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:48.586691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:48.586691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:48.586691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:48.586691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:48.586691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:48.586691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:48.587567 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:48.587567 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:48.587567 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:48.592091 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 283/584] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:48.592924 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18782fd1-da04-4d32-a45c-441005229007 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:48.596292 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 302/585] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Aug 24 14:19:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:48.597103 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454314de-69d3-4671-ae15-2b0f43eb5cf8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:48.671894 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:48.699255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18782fd1-da04-4d32-a45c-441005229007 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:48.707680 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454314de-69d3-4671-ae15-2b0f43eb5cf8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:48.735482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7ad99-63aa-4dac-ae5b-071ff2c2de91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:48.736110 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7ad99-63aa-4dac-ae5b-071ff2c2de91 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:48.736392 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7ad99-63aa-4dac-ae5b-071ff2c2de91 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:48.736666 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7ad99-63aa-4dac-ae5b-071ff2c2de91 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:48.745022 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7ad99-63aa-4dac-ae5b-071ff2c2de91 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:48.746322 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2a0d1-2298-4d57-accf-16f9d5fe47a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:48.746802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7ad99-63aa-4dac-ae5b-071ff2c2de91 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:48.748237 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2a0d1-2298-4d57-accf-16f9d5fe47a1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:48.748668 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2a0d1-2298-4d57-accf-16f9d5fe47a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:48.749250 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2a0d1-2298-4d57-accf-16f9d5fe47a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:48.750599 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2a0d1-2298-4d57-accf-16f9d5fe47a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:48.751053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2a0d1-2298-4d57-accf-16f9d5fe47a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:48.752698 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2a0d1-2298-4d57-accf-16f9d5fe47a1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:48.758637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-67d7ad99-63aa-4dac-ae5b-071ff2c2de91 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 14:19:48.758637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:48.758637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:48.758637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:48.758637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:48.758637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:48.758637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:48.758637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:48.758637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:48.758637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:48.758637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:48.758637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:48.758637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:19:48.758637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:19:48.758637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:19:48.758637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:19:48.759747 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:48.759747 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:48.759747 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:19:48.759747 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:48.759747 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:19:48.759747 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:48.759747 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:48.759747 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:48.759747 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:48.759747 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:48.759747 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:48.759747 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:48.759747 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:48.759747 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:48.759747 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:48.759747 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:48.759747 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:48.759747 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:48.760667 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:48.760667 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:48.760667 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:19:48.760667 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:19:48.760667 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:19:48.760667 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:19:48.760667 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:19:48.760667 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:19:48.760667 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 14:19:48.760667 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:48.760667 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 284/586] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:19:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:48.760667 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7ad99-63aa-4dac-ae5b-071ff2c2de91 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:48.769077 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:48.771393 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 303/587] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:19:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:48.772225 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2a0d1-2298-4d57-accf-16f9d5fe47a1 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:48.881178 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7ad99-63aa-4dac-ae5b-071ff2c2de91 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:48.881949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2a0d1-2298-4d57-accf-16f9d5fe47a1 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:48.910037 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:48.917669 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd5ab0-a51f-4a11-bbcf-2f5b19ba1369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:48.918353 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd5ab0-a51f-4a11-bbcf-2f5b19ba1369 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:48.918707 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd5ab0-a51f-4a11-bbcf-2f5b19ba1369 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:48.918977 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63088596-e37b-4ae7-bdff-4304cf54e1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:48.919108 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd5ab0-a51f-4a11-bbcf-2f5b19ba1369 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:48.919758 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63088596-e37b-4ae7-bdff-4304cf54e1b4 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:48.920219 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63088596-e37b-4ae7-bdff-4304cf54e1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:48.920489 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd5ab0-a51f-4a11-bbcf-2f5b19ba1369 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:48.920582 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63088596-e37b-4ae7-bdff-4304cf54e1b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:48.921266 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd5ab0-a51f-4a11-bbcf-2f5b19ba1369 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:48.922706 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd5ab0-a51f-4a11-bbcf-2f5b19ba1369 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:48.931369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63088596-e37b-4ae7-bdff-4304cf54e1b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:48.933086 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63088596-e37b-4ae7-bdff-4304cf54e1b4 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:48.940037 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 285/588] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:48.940037 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd5ab0-a51f-4a11-bbcf-2f5b19ba1369 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:48.954174 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-63088596-e37b-4ae7-bdff-4304cf54e1b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:48.954174 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:48.954174 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:48.954174 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:48.954174 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:48.954174 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:48.954174 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:48.954174 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:48.954174 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:48.954174 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:48.954174 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:48.954174 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:48.954174 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:48.954174 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:48.954174 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:48.954174 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:48.955304 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:48.955304 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:48.955304 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:48.955304 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:48.955304 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:48.955304 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:48.955304 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:48.955304 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:48.955304 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:48.955304 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:48.955304 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:48.955304 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:48.955304 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:48.955304 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:48.955304 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:48.955304 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:48.955304 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:48.956499 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:48.956499 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:48.956499 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:48.956909 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 304/589] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:48.957652 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63088596-e37b-4ae7-bdff-4304cf54e1b4 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:49.015102 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:49.058214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd5ab0-a51f-4a11-bbcf-2f5b19ba1369 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:49.068690 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63088596-e37b-4ae7-bdff-4304cf54e1b4 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:49.094532 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe75cb-4727-4d83-ae84-078551fd4caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:49.095142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe75cb-4727-4d83-ae84-078551fd4caf None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:49.095421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe75cb-4727-4d83-ae84-078551fd4caf None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:49.095696 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe75cb-4727-4d83-ae84-078551fd4caf None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:49.096427 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe75cb-4727-4d83-ae84-078551fd4caf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:49.096735 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe75cb-4727-4d83-ae84-078551fd4caf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:49.098189 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe75cb-4727-4d83-ae84-078551fd4caf None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:49.105507 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c03056-6497-486d-b7f4-516169675ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:49.106381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c03056-6497-486d-b7f4-516169675ad7 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:49.107477 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c03056-6497-486d-b7f4-516169675ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:49.108024 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c03056-6497-486d-b7f4-516169675ad7 None admin] PATH_INFO: `/v3/projects/34cce205e8ee4ae9b09bb89bc4bb081e/users/8d099678d6454f7eb494892a69feaf62/roles/0df7ee13692d4eb5a741a8b79fd58d58` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:49.116398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 286/590] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Aug 24 14:19:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:49.117413 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe75cb-4727-4d83-ae84-078551fd4caf None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:49.127996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c03056-6497-486d-b7f4-516169675ad7 None admin] RBAC: Authorizing `identity:create_grant(project_id=34cce205e8ee4ae9b09bb89bc4bb081e, user_id=8d099678d6454f7eb494892a69feaf62, role_id=0df7ee13692d4eb5a741a8b79fd58d58)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:49.130001 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c03056-6497-486d-b7f4-516169675ad7 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:49.217897 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe75cb-4727-4d83-ae84-078551fd4caf None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:49.238101 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 305/591] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 14:19:48 2022] PUT /identity/v3/projects/34cce205e8ee4ae9b09bb89bc4bb081e/users/8d099678d6454f7eb494892a69feaf62/roles/0df7ee13692d4eb5a741a8b79fd58d58 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:19:49.239179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c03056-6497-486d-b7f4-516169675ad7 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:49.246877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:49.268626 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012863a-15d5-4919-8a08-d14455064622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:49.269432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012863a-15d5-4919-8a08-d14455064622 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:49.269915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012863a-15d5-4919-8a08-d14455064622 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:49.270296 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012863a-15d5-4919-8a08-d14455064622 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:49.279784 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012863a-15d5-4919-8a08-d14455064622 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:49.281932 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012863a-15d5-4919-8a08-d14455064622 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:49.294432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:49.297244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-2012863a-15d5-4919-8a08-d14455064622 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 14:19:49.297244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:49.297244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:49.297244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:49.297244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:49.297244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:49.297244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:49.297244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:49.297244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:49.297244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:49.297244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:49.297244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:49.297244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:19:49.297244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:19:49.297244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:19:49.297244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:19:49.298552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:49.298552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:49.298552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:19:49.298552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:49.298552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:19:49.298552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:49.298552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:49.298552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:49.298552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:49.298552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:49.298552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:49.298552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:49.298552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:49.298552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:49.298552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:49.298552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:49.298552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:49.298552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:49.299726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:49.299726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:49.299726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:19:49.299726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:19:49.299726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:19:49.299726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:19:49.299726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:19:49.299726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:19:49.299726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 14:19:49.299726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:49.306078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 287/592] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 14:19:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:49.306078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012863a-15d5-4919-8a08-d14455064622 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:49.410898 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c03056-6497-486d-b7f4-516169675ad7 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:49.426625 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012863a-15d5-4919-8a08-d14455064622 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:49.453909 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043e018-b5c1-4cec-b57b-baf6f5027cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:49.455012 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043e018-b5c1-4cec-b57b-baf6f5027cde None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:49.455680 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043e018-b5c1-4cec-b57b-baf6f5027cde None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:49.456103 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043e018-b5c1-4cec-b57b-baf6f5027cde None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:49.457492 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043e018-b5c1-4cec-b57b-baf6f5027cde None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:49.458110 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043e018-b5c1-4cec-b57b-baf6f5027cde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:49.460252 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043e018-b5c1-4cec-b57b-baf6f5027cde None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:49.464920 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c31e9-2b9d-4412-ad0b-8f77979f186c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:49.465662 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c31e9-2b9d-4412-ad0b-8f77979f186c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:49.466067 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c31e9-2b9d-4412-ad0b-8f77979f186c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:49.466981 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c31e9-2b9d-4412-ad0b-8f77979f186c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:49.474412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 306/593] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:49.475521 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043e018-b5c1-4cec-b57b-baf6f5027cde None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:49.480463 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c31e9-2b9d-4412-ad0b-8f77979f186c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:49.482511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c31e9-2b9d-4412-ad0b-8f77979f186c None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:49.500172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-3f4c31e9-2b9d-4412-ad0b-8f77979f186c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:49.500172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:49.500172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:49.500172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:49.500172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:49.500172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:49.500172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:49.500172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:49.500172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:49.500172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:49.500172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:49.500172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:49.500172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:49.500172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:49.500172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:49.500172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:49.501151 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:49.501151 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:49.501151 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:49.501151 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:49.501151 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:49.501151 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:49.501151 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:49.501151 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:49.501151 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:49.501151 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:49.501151 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:49.501151 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:49.501151 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:49.501151 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:49.501151 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:49.501151 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:49.501151 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:49.502052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:49.502052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:49.502052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:49.504663 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 288/594] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:49.505709 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c31e9-2b9d-4412-ad0b-8f77979f186c None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:49.543898 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:49.594225 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:49.617664 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043e018-b5c1-4cec-b57b-baf6f5027cde None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:49.622433 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c31e9-2b9d-4412-ad0b-8f77979f186c None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:49.654716 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2218df5-f74e-4ff8-8a20-58a96b3e81fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:49.655868 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2218df5-f74e-4ff8-8a20-58a96b3e81fd None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:49.656455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2218df5-f74e-4ff8-8a20-58a96b3e81fd None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:49.657000 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2218df5-f74e-4ff8-8a20-58a96b3e81fd None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:49.658147 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2218df5-f74e-4ff8-8a20-58a96b3e81fd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:49.658695 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2218df5-f74e-4ff8-8a20-58a96b3e81fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:49.658954 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1c47e-da93-46a2-b19c-ce2d9993d2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:49.659580 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1c47e-da93-46a2-b19c-ce2d9993d2f3 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:49.659860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1c47e-da93-46a2-b19c-ce2d9993d2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:49.660139 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1c47e-da93-46a2-b19c-ce2d9993d2f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:49.661280 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2218df5-f74e-4ff8-8a20-58a96b3e81fd None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:49.667482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1c47e-da93-46a2-b19c-ce2d9993d2f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:49.668955 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1c47e-da93-46a2-b19c-ce2d9993d2f3 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:49.681239 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 307/595] 10.222.0.65 () {56 vars in 1139 bytes} [Wed Aug 24 14:19:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:49.681416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-c2b1c47e-da93-46a2-b19c-ce2d9993d2f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:19:49.681416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:49.681416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:49.681416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:49.681416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:49.681416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:49.681416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:49.681416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:49.681416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:49.681416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:49.681416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:49.681416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:49.681416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:19:49.681416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:19:49.681416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:19:49.682417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:19:49.682417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:49.682417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:49.682417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:49.682417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:49.682417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:49.682417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:49.682417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:49.682417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:49.682417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:49.682417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:49.682417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:49.682417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:49.682417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:49.682417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:49.682417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:49.682417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:49.683283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:19:49.683283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:19:49.683283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:19:49.683283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:19:49.683283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:19:49.683283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:19:49.683283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:19:49.683283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:49.685498 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2218df5-f74e-4ff8-8a20-58a96b3e81fd None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:49.685833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 289/596] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:19:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:49.687381 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1c47e-da93-46a2-b19c-ce2d9993d2f3 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:49.792393 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:49.801188 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1c47e-da93-46a2-b19c-ce2d9993d2f3 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:49.810346 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2218df5-f74e-4ff8-8a20-58a96b3e81fd None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:49.843983 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117d4cf-34ef-4380-b657-2313c2d0746e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:49.844611 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117d4cf-34ef-4380-b657-2313c2d0746e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:49.844891 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117d4cf-34ef-4380-b657-2313c2d0746e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:49.845164 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117d4cf-34ef-4380-b657-2313c2d0746e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:49.858506 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711cafec-ed67-4091-a438-bb11443f9d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:49.858711 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117d4cf-34ef-4380-b657-2313c2d0746e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:49.859567 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cafec-ed67-4091-a438-bb11443f9d32 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:49.860041 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117d4cf-34ef-4380-b657-2313c2d0746e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:49.860320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cafec-ed67-4091-a438-bb11443f9d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:49.860922 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cafec-ed67-4091-a438-bb11443f9d32 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:49.861790 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711cafec-ed67-4091-a438-bb11443f9d32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:49.862512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711cafec-ed67-4091-a438-bb11443f9d32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:49.864549 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711cafec-ed67-4091-a438-bb11443f9d32 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:49.875106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-b117d4cf-34ef-4380-b657-2313c2d0746e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:49.875106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:49.875106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:49.875106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:49.875106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:49.875106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:49.875106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:49.875106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:49.875106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:49.875106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:49.875106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:49.875106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:49.875106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:49.875106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:49.875106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:49.875106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:49.876075 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:49.876075 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:49.876075 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:49.876075 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:49.876075 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:49.876075 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:49.876075 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:49.876075 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:49.876075 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:49.876075 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:49.876075 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:49.876075 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:49.876075 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:49.876075 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:49.876075 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:49.876075 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:49.876075 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:49.877061 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:49.877061 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:49.877061 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:49.877061 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 290/597] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:49.877061 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117d4cf-34ef-4380-b657-2313c2d0746e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:49.885191 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 308/598] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:49.886258 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711cafec-ed67-4091-a438-bb11443f9d32 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:49.899309 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:49.991375 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117d4cf-34ef-4380-b657-2313c2d0746e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:50.015910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711cafec-ed67-4091-a438-bb11443f9d32 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:50.026902 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bced2-e563-4520-8c4a-665dd6778bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:50.027771 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bced2-e563-4520-8c4a-665dd6778bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:50.028155 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bced2-e563-4520-8c4a-665dd6778bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:50.028724 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bced2-e563-4520-8c4a-665dd6778bb6 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:50.030188 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68bced2-e563-4520-8c4a-665dd6778bb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:50.030603 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68bced2-e563-4520-8c4a-665dd6778bb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:50.032193 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68bced2-e563-4520-8c4a-665dd6778bb6 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:50.045022 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 291/599] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:19:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:50.047078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bced2-e563-4520-8c4a-665dd6778bb6 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:50.054839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec0118-3137-4ac8-893a-33850f4429d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:50.055668 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec0118-3137-4ac8-893a-33850f4429d8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:50.056094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec0118-3137-4ac8-893a-33850f4429d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:50.056510 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec0118-3137-4ac8-893a-33850f4429d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:50.057295 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec0118-3137-4ac8-893a-33850f4429d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:50.057798 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec0118-3137-4ac8-893a-33850f4429d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:50.059307 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec0118-3137-4ac8-893a-33850f4429d8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:50.060984 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:50.073200 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 309/600] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:50.074359 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec0118-3137-4ac8-893a-33850f4429d8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:50.146954 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:50.159603 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bced2-e563-4520-8c4a-665dd6778bb6 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:50.185470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec0118-3137-4ac8-893a-33850f4429d8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:50.195694 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb6600-647b-420c-952b-9087484402d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:50.196324 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb6600-647b-420c-952b-9087484402d7 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:50.196604 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb6600-647b-420c-952b-9087484402d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:50.196877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb6600-647b-420c-952b-9087484402d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:50.205353 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb6600-647b-420c-952b-9087484402d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:50.206829 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb6600-647b-420c-952b-9087484402d7 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:50.219372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-9cbb6600-647b-420c-952b-9087484402d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:19:50.219372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:50.219372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:50.219372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:50.219372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:50.219372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:50.219372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:50.219372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:50.219372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:50.219372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:50.219372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:50.219372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:50.219372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:19:50.219372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:19:50.219372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:19:50.220283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:19:50.220283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:50.220283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:50.220283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:50.220283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:50.220283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:50.220283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:50.220283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:50.220283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:50.220283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:50.220283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:50.220283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:50.220283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:50.220283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:50.220283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:50.220283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:50.220283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:50.221165 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:19:50.221165 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:19:50.221165 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:19:50.221165 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:19:50.221165 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:19:50.221165 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:19:50.221165 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:19:50.221165 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:50.221165 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 292/601] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:19:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:50.221647 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb6600-647b-420c-952b-9087484402d7 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:50.229782 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa785fb-d9e3-4cd0-8a1d-c3f4c28525bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:50.230441 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa785fb-d9e3-4cd0-8a1d-c3f4c28525bf None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:50.230751 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa785fb-d9e3-4cd0-8a1d-c3f4c28525bf None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:50.230991 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa785fb-d9e3-4cd0-8a1d-c3f4c28525bf None admin] PATH_INFO: `/v3/projects/34cce205e8ee4ae9b09bb89bc4bb081e/users/78745f9dbf544ab291acfa7a063c1493/roles/0df7ee13692d4eb5a741a8b79fd58d58` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:50.246349 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa785fb-d9e3-4cd0-8a1d-c3f4c28525bf None admin] RBAC: Authorizing `identity:create_grant(project_id=34cce205e8ee4ae9b09bb89bc4bb081e, user_id=78745f9dbf544ab291acfa7a063c1493, role_id=0df7ee13692d4eb5a741a8b79fd58d58)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:50.247804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa785fb-d9e3-4cd0-8a1d-c3f4c28525bf None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:50.290376 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:50.324127 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb6600-647b-420c-952b-9087484402d7 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:50.338872 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 310/602] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 14:19:50 2022] PUT /identity/v3/projects/34cce205e8ee4ae9b09bb89bc4bb081e/users/78745f9dbf544ab291acfa7a063c1493/roles/0df7ee13692d4eb5a741a8b79fd58d58 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:19:50.338872 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3eb2e9-1e64-4d3c-8154-f8cd960bd938 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:50.338872 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3eb2e9-1e64-4d3c-8154-f8cd960bd938 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:50.338872 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3eb2e9-1e64-4d3c-8154-f8cd960bd938 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:50.338872 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 311/603] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:50.338872 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3eb2e9-1e64-4d3c-8154-f8cd960bd938 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:50.375015 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0284a59-8479-4737-9974-0f7660683ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:50.375854 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0284a59-8479-4737-9974-0f7660683ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:50.376133 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0284a59-8479-4737-9974-0f7660683ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:50.376462 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0284a59-8479-4737-9974-0f7660683ad6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:50.384443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0284a59-8479-4737-9974-0f7660683ad6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:50.386186 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0284a59-8479-4737-9974-0f7660683ad6 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:50.399518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-a0284a59-8479-4737-9974-0f7660683ad6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:19:50.399518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:50.399518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:50.399518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:50.399518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:50.399518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:50.399518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:50.399518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:50.399518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:50.399518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:50.399518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:50.399518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:50.399518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:19:50.399518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:19:50.399518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:19:50.400497 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:19:50.400497 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:50.400497 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:50.400497 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:50.400497 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:50.400497 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:50.400497 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:50.400497 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:50.400497 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:50.400497 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:50.400497 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:50.400497 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:50.400497 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:50.400497 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:50.400497 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:50.400497 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:50.400497 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:50.402135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:19:50.402135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:19:50.402135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:19:50.402135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:19:50.402135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:19:50.402135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:19:50.402135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:19:50.402135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:50.402135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 293/604] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:19:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:50.402782 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bd704-3316-4563-946a-9090ef115033 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:50.403088 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bd704-3316-4563-946a-9090ef115033 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:50.403365 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bd704-3316-4563-946a-9090ef115033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:50.431708 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ab3bd704-3316-4563-946a-9090ef115033 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:50.433057 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ab3bd704-3316-4563-946a-9090ef115033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:50.490457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3eb2e9-1e64-4d3c-8154-f8cd960bd938 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:50.512668 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:50.513192 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 294/605] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:50.514381 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3bd704-3316-4563-946a-9090ef115033 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:50.539839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314bf68-7e3d-49f4-aad5-6985292b1616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:50.540719 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314bf68-7e3d-49f4-aad5-6985292b1616 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:50.541186 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314bf68-7e3d-49f4-aad5-6985292b1616 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:50.541637 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314bf68-7e3d-49f4-aad5-6985292b1616 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:50.542542 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314bf68-7e3d-49f4-aad5-6985292b1616 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:50.543054 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314bf68-7e3d-49f4-aad5-6985292b1616 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:50.545244 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314bf68-7e3d-49f4-aad5-6985292b1616 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:50.558545 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 312/606] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:19:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:50.567377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314bf68-7e3d-49f4-aad5-6985292b1616 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:50.586676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:50.630481 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3bd704-3316-4563-946a-9090ef115033 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:50.667321 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656ed9e-08c6-4a6f-87e4-ae5f83cb1ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:50.668323 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656ed9e-08c6-4a6f-87e4-ae5f83cb1ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:50.668884 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656ed9e-08c6-4a6f-87e4-ae5f83cb1ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:50.669629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656ed9e-08c6-4a6f-87e4-ae5f83cb1ef0 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:50.670562 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656ed9e-08c6-4a6f-87e4-ae5f83cb1ef0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:50.671161 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656ed9e-08c6-4a6f-87e4-ae5f83cb1ef0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:50.672790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656ed9e-08c6-4a6f-87e4-ae5f83cb1ef0 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:50.685454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 295/607] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:19:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:50.695885 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656ed9e-08c6-4a6f-87e4-ae5f83cb1ef0 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:50.756822 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314bf68-7e3d-49f4-aad5-6985292b1616 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:50.837285 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43976716-c479-404d-96ed-bd3b05320a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:50.838093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43976716-c479-404d-96ed-bd3b05320a3b None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:50.838282 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43976716-c479-404d-96ed-bd3b05320a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:50.838546 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43976716-c479-404d-96ed-bd3b05320a3b None admin] PATH_INFO: `/v3/projects/34cce205e8ee4ae9b09bb89bc4bb081e/users/d03ddcf4bcc24f86be508345ad63ab5f/roles/0df7ee13692d4eb5a741a8b79fd58d58` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:50.854293 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656ed9e-08c6-4a6f-87e4-ae5f83cb1ef0 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:50.858983 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43976716-c479-404d-96ed-bd3b05320a3b None admin] RBAC: Authorizing `identity:create_grant(project_id=34cce205e8ee4ae9b09bb89bc4bb081e, user_id=d03ddcf4bcc24f86be508345ad63ab5f, role_id=0df7ee13692d4eb5a741a8b79fd58d58)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:50.860689 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43976716-c479-404d-96ed-bd3b05320a3b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:50.874150 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:50.892484 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cd62d-21e6-410f-8940-2c3fb2484825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:50.893133 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cd62d-21e6-410f-8940-2c3fb2484825 None admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:50.893457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cd62d-21e6-410f-8940-2c3fb2484825 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:50.893731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cd62d-21e6-410f-8940-2c3fb2484825 None admin] PATH_INFO: `/v3/projects/34cce205e8ee4ae9b09bb89bc4bb081e/users/cb5021b569db41a08218cbec928442af/roles/0df7ee13692d4eb5a741a8b79fd58d58` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:50.910765 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28cd62d-21e6-410f-8940-2c3fb2484825 None admin] RBAC: Authorizing `identity:create_grant(project_id=34cce205e8ee4ae9b09bb89bc4bb081e, user_id=cb5021b569db41a08218cbec928442af, role_id=0df7ee13692d4eb5a741a8b79fd58d58)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:50.912326 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28cd62d-21e6-410f-8940-2c3fb2484825 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:50.959528 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 313/608] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 14:19:50 2022] PUT /identity/v3/projects/34cce205e8ee4ae9b09bb89bc4bb081e/users/d03ddcf4bcc24f86be508345ad63ab5f/roles/0df7ee13692d4eb5a741a8b79fd58d58 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:19:50.960686 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43976716-c479-404d-96ed-bd3b05320a3b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:50.992909 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 296/609] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 14:19:50 2022] PUT /identity/v3/projects/34cce205e8ee4ae9b09bb89bc4bb081e/users/cb5021b569db41a08218cbec928442af/roles/0df7ee13692d4eb5a741a8b79fd58d58 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:19:51.002298 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:51.103519 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43976716-c479-404d-96ed-bd3b05320a3b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:51.150036 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741b03c-aef3-4907-938f-612a53bd9324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:51.150686 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741b03c-aef3-4907-938f-612a53bd9324 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:51.150967 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741b03c-aef3-4907-938f-612a53bd9324 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:51.151241 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741b03c-aef3-4907-938f-612a53bd9324 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:51.168949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741b03c-aef3-4907-938f-612a53bd9324 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:51.174531 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-6741b03c-aef3-4907-938f-612a53bd9324 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:19:51.174531 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:51.174531 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:51.174531 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:51.174531 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:51.174531 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:51.174531 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:51.174531 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:51.174531 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:51.174531 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:51.174531 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:51.174531 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:51.174531 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:51.174531 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:51.174531 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:51.174531 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:51.175584 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:51.175584 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:51.175584 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:51.175584 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:51.175584 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:51.175584 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:51.175584 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:51.175584 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:51.175584 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:51.175584 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:51.175584 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:51.175584 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:51.175584 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:51.175584 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:51.175584 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:51.175584 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:51.176424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:51.176424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:51.176424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:51.176424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:51.176424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:51.176424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:51.176424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:51.176424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:51.176424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:51.176424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:51.176424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:19:51.176424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:51.176424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 314/610] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 14:19:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:51.182351 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cd62d-21e6-410f-8940-2c3fb2484825 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:51.297641 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cd62d-21e6-410f-8940-2c3fb2484825 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:51.335232 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5279970-2305-4eae-82d8-f5693637fef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:51.335841 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5279970-2305-4eae-82d8-f5693637fef4 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:51.336118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5279970-2305-4eae-82d8-f5693637fef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:51.336391 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5279970-2305-4eae-82d8-f5693637fef4 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:51.337064 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5279970-2305-4eae-82d8-f5693637fef4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:51.337366 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5279970-2305-4eae-82d8-f5693637fef4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:51.338775 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5279970-2305-4eae-82d8-f5693637fef4 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:51.348004 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 297/611] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 14:19:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:51.353777 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741b03c-aef3-4907-938f-612a53bd9324 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:51.406685 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea114b-b744-45f2-8940-2fe595a72f79 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:51.407032 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea114b-b744-45f2-8940-2fe595a72f79 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:51.407244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea114b-b744-45f2-8940-2fe595a72f79 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:51.408862 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 298/612] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:51.421427 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ba115-b651-4a8c-b000-d7d2cecf48e7 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:51.421719 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ba115-b651-4a8c-b000-d7d2cecf48e7 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:51.422016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ba115-b651-4a8c-b000-d7d2cecf48e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:51.453836 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-3f7ba115-b651-4a8c-b000-d7d2cecf48e7 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:51.454037 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:51.455137 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3f7ba115-b651-4a8c-b000-d7d2cecf48e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:51.483976 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741b03c-aef3-4907-938f-612a53bd9324 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:51.510122 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:51.547474 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a113f-9523-4936-9cd9-af3ed167cfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:51.548120 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a113f-9523-4936-9cd9-af3ed167cfbc None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:51.548385 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a113f-9523-4936-9cd9-af3ed167cfbc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:51.548686 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a113f-9523-4936-9cd9-af3ed167cfbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:51.572920 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a113f-9523-4936-9cd9-af3ed167cfbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:51.574460 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a113f-9523-4936-9cd9-af3ed167cfbc None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:51.592370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-da0a113f-9523-4936-9cd9-af3ed167cfbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:51.592370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:51.592370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:51.592370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:51.592370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:51.592370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:51.592370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:51.592370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:51.592370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:51.592370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:51.592370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:51.592370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:51.592370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:51.592370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:51.592370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:51.592370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:51.593357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:51.593357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:51.593357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:51.593357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:51.593357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:51.593357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:51.593357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:51.593357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:51.593357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:51.593357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:51.593357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:51.593357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:51.593357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:51.593357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:51.593357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:51.593357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:51.593357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:51.594279 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:51.594279 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:51.594279 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:51.594279 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 315/613] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:51.599006 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a113f-9523-4936-9cd9-af3ed167cfbc None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:51.601822 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 299/614] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:51.720829 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a113f-9523-4936-9cd9-af3ed167cfbc None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:51.764532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ce6b3-7ad8-4782-b4bb-a5fca5c0a211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:51.765150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ce6b3-7ad8-4782-b4bb-a5fca5c0a211 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:51.765429 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ce6b3-7ad8-4782-b4bb-a5fca5c0a211 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:51.765703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ce6b3-7ad8-4782-b4bb-a5fca5c0a211 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:51.766380 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ce6b3-7ad8-4782-b4bb-a5fca5c0a211 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:51.766679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ce6b3-7ad8-4782-b4bb-a5fca5c0a211 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:51.768142 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ce6b3-7ad8-4782-b4bb-a5fca5c0a211 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:51.780377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:51.790801 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 316/615] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:51.796918 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ba115-b651-4a8c-b000-d7d2cecf48e7 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:51.912090 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ba115-b651-4a8c-b000-d7d2cecf48e7 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:51.948599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392b705-c950-4c1b-a372-a893870d685d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:51.949726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ce6b3-7ad8-4782-b4bb-a5fca5c0a211 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:51.950991 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392b705-c950-4c1b-a372-a893870d685d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:51.951620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392b705-c950-4c1b-a372-a893870d685d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:51.952117 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392b705-c950-4c1b-a372-a893870d685d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:51.968825 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392b705-c950-4c1b-a372-a893870d685d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:51.970891 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392b705-c950-4c1b-a372-a893870d685d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:51.992488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-8392b705-c950-4c1b-a372-a893870d685d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 14:19:51.992488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:51.992488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:51.992488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:51.992488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:51.992488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:51.992488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:51.992488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:51.992488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:51.992488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:51.992488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:51.992488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:51.992488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:19:51.992488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:19:51.992488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:19:51.992488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:19:51.993449 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:51.993449 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:51.993449 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:19:51.993449 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:51.993449 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:19:51.993449 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:51.993449 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:51.993449 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:51.993449 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:51.993449 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:51.993449 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:51.993449 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:51.993449 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:51.993449 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:51.993449 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:51.993449 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:51.993449 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:51.993449 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:51.994404 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:51.994404 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:51.994404 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:19:51.994404 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:19:51.994404 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:19:51.994404 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:19:51.994404 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:19:51.994404 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:19:51.994404 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 14:19:51.994404 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:52.001502 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 300/616] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:19:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:52.010667 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392b705-c950-4c1b-a372-a893870d685d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:52.045253 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:52.082224 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ce6b3-7ad8-4782-b4bb-a5fca5c0a211 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:52.126891 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20897d53-c05a-47bc-b7e7-f19b87448753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:52.127585 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20897d53-c05a-47bc-b7e7-f19b87448753 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:52.127870 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20897d53-c05a-47bc-b7e7-f19b87448753 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:52.128144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20897d53-c05a-47bc-b7e7-f19b87448753 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:52.150771 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20897d53-c05a-47bc-b7e7-f19b87448753 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:52.156867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-20897d53-c05a-47bc-b7e7-f19b87448753 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:19:52.156867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:52.156867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:52.156867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:52.156867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:52.156867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:52.156867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:52.156867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:52.156867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:52.156867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:52.156867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:52.156867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:52.156867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:52.156867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:52.156867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:52.156867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:52.157812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:52.157812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:52.157812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:52.157812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:52.157812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:52.157812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:52.157812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:52.157812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:52.157812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:52.157812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:52.157812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:52.157812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:52.157812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:52.157812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:52.157812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:52.157812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:52.158657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:52.158657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:52.158657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:52.158657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:52.158657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:52.158657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:52.158657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:52.158657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:52.158657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:52.158657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:52.158657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:19:52.158657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:52.162472 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 317/617] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 14:19:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:19:52.165563 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392b705-c950-4c1b-a372-a893870d685d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:52.168380 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20897d53-c05a-47bc-b7e7-f19b87448753 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:52.203477 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbb988-89de-4aa9-bbed-bff4dea7b2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:52.204823 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbb988-89de-4aa9-bbed-bff4dea7b2b7 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:52.205366 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbb988-89de-4aa9-bbed-bff4dea7b2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:52.205901 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbb988-89de-4aa9-bbed-bff4dea7b2b7 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:52.207434 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcbb988-89de-4aa9-bbed-bff4dea7b2b7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:52.207961 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcbb988-89de-4aa9-bbed-bff4dea7b2b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:52.210142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcbb988-89de-4aa9-bbed-bff4dea7b2b7 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:52.248766 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 301/618] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Aug 24 14:19:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:52.253078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbb988-89de-4aa9-bbed-bff4dea7b2b7 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:52.291331 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:52.357996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20897d53-c05a-47bc-b7e7-f19b87448753 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:52.399626 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0002411-34d6-428f-9a02-bafb153d8085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:52.400604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0002411-34d6-428f-9a02-bafb153d8085 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:52.401175 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0002411-34d6-428f-9a02-bafb153d8085 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:52.401640 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0002411-34d6-428f-9a02-bafb153d8085 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:52.402520 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0002411-34d6-428f-9a02-bafb153d8085 None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:52.403016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0002411-34d6-428f-9a02-bafb153d8085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:52.405413 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0002411-34d6-428f-9a02-bafb153d8085 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:52.408755 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:52.415958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 318/619] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 14:19:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:52.421699 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0002411-34d6-428f-9a02-bafb153d8085 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:52.458573 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbb988-89de-4aa9-bbed-bff4dea7b2b7 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:52.498729 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1e1b1-adae-4430-94b7-48093b89429a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:52.500409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1e1b1-adae-4430-94b7-48093b89429a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:52.500914 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1e1b1-adae-4430-94b7-48093b89429a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:52.501383 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1e1b1-adae-4430-94b7-48093b89429a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:52.515144 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1e1b1-adae-4430-94b7-48093b89429a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:52.516884 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1e1b1-adae-4430-94b7-48093b89429a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:52.534217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-42e1e1b1-adae-4430-94b7-48093b89429a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:52.534217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:52.534217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:52.534217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:52.534217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:52.534217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:52.534217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:52.534217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:52.534217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:52.534217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:52.534217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:52.534217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:52.534217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:52.534217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:52.534217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:52.534217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:52.535257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:52.535257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:52.535257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:52.535257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:52.535257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:52.535257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:52.535257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:52.535257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:52.535257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:52.535257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:52.535257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:52.535257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:52.535257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:52.535257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:52.535257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:52.535257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:52.535257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:52.536184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:52.536184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:52.536184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:52.539177 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 302/620] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:52.548692 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1e1b1-adae-4430-94b7-48093b89429a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:52.628671 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0002411-34d6-428f-9a02-bafb153d8085 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:52.657303 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1e1b1-adae-4430-94b7-48093b89429a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:52.658456 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:52.674642 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda181c2-4891-45ea-8325-304a08665ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:52.675462 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda181c2-4891-45ea-8325-304a08665ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:52.675749 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda181c2-4891-45ea-8325-304a08665ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:52.676026 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda181c2-4891-45ea-8325-304a08665ef4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:52.687120 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:52.689177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda181c2-4891-45ea-8325-304a08665ef4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:52.690922 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda181c2-4891-45ea-8325-304a08665ef4 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:52.695388 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebfffd-4eb9-46dc-9d79-193038d6d57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:52.696124 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebfffd-4eb9-46dc-9d79-193038d6d57e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:52.696626 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebfffd-4eb9-46dc-9d79-193038d6d57e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:52.696899 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebfffd-4eb9-46dc-9d79-193038d6d57e None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:52.697635 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebfffd-4eb9-46dc-9d79-193038d6d57e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:52.698058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebfffd-4eb9-46dc-9d79-193038d6d57e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:52.701026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebfffd-4eb9-46dc-9d79-193038d6d57e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:52.708889 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-cda181c2-4891-45ea-8325-304a08665ef4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:52.708889 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:52.708889 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:52.708889 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:52.708889 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:52.708889 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:52.708889 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:52.708889 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:52.708889 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:52.708889 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:52.708889 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:52.708889 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:52.708889 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:52.708889 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:52.708889 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:52.708889 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:52.710104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:52.710104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:52.710104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:52.710104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:52.710104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:52.710104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:52.710104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:52.710104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:52.710104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:52.710104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:52.710104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:52.710104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:52.710104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:52.710104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:52.710104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:52.710104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:52.710104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:52.711288 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:52.711288 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:52.711288 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:52.713062 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 319/621] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:52.714573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215dfa5-f0de-4497-b256-7edf379ae995 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:52.715024 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215dfa5-f0de-4497-b256-7edf379ae995 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:52.715456 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215dfa5-f0de-4497-b256-7edf379ae995 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:52.716223 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 303/622] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:52.717818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 320/623] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:52.722159 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebfffd-4eb9-46dc-9d79-193038d6d57e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:52.722717 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8189dc-a033-4d92-9313-81f5bc3003d7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:52.723001 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8189dc-a033-4d92-9313-81f5bc3003d7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:52.723274 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8189dc-a033-4d92-9313-81f5bc3003d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:52.743324 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-be8189dc-a033-4d92-9313-81f5bc3003d7 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:52.744521 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-be8189dc-a033-4d92-9313-81f5bc3003d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:52.819526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 321/624] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:52.820382 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8189dc-a033-4d92-9313-81f5bc3003d7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:52.844562 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebfffd-4eb9-46dc-9d79-193038d6d57e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:52.910537 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76dea1-6c2a-4e26-9ad3-32d8f212c8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:52.911244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76dea1-6c2a-4e26-9ad3-32d8f212c8ec None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:52.911625 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76dea1-6c2a-4e26-9ad3-32d8f212c8ec None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:52.911997 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76dea1-6c2a-4e26-9ad3-32d8f212c8ec None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:52.912749 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76dea1-6c2a-4e26-9ad3-32d8f212c8ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:52.913151 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76dea1-6c2a-4e26-9ad3-32d8f212c8ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:52.914640 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76dea1-6c2a-4e26-9ad3-32d8f212c8ec None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:52.928524 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8189dc-a033-4d92-9313-81f5bc3003d7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:52.931085 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:52.936843 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 304/625] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:52.946951 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76dea1-6c2a-4e26-9ad3-32d8f212c8ec None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:52.966457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3aba2-644d-4a2e-b380-4ea5ebfcbfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:52.967288 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3aba2-644d-4a2e-b380-4ea5ebfcbfb7 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:52.967528 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3aba2-644d-4a2e-b380-4ea5ebfcbfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:52.967801 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3aba2-644d-4a2e-b380-4ea5ebfcbfb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:52.975461 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3aba2-644d-4a2e-b380-4ea5ebfcbfb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:52.976912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3aba2-644d-4a2e-b380-4ea5ebfcbfb7 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:52.989698 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-93b3aba2-644d-4a2e-b380-4ea5ebfcbfb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:19:52.989698 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:52.989698 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:52.989698 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:52.989698 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:52.989698 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:52.989698 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:52.989698 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:52.989698 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:52.989698 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:52.989698 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:52.989698 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:52.989698 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:19:52.989698 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:19:52.989698 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:19:52.992140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:19:52.992140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:52.992140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:52.992140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:52.992140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:52.992140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:52.992140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:52.992140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:52.992140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:52.992140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:52.992140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:52.992140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:52.992140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:52.992140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:52.992140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:52.992140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:52.992140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:52.994418 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:19:52.994418 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:19:52.994418 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:19:52.994418 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:19:52.994418 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:19:52.994418 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:19:52.994418 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:19:52.994418 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:52.994418 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 322/626] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:19:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:53.001774 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3aba2-644d-4a2e-b380-4ea5ebfcbfb7 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:53.040365 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:53.123917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76dea1-6c2a-4e26-9ad3-32d8f212c8ec None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:53.160668 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3aba2-644d-4a2e-b380-4ea5ebfcbfb7 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:53.166637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa704ab3-c18d-4439-ba89-7308216c59f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:53.167276 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa704ab3-c18d-4439-ba89-7308216c59f9 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:53.167560 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa704ab3-c18d-4439-ba89-7308216c59f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:53.167837 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa704ab3-c18d-4439-ba89-7308216c59f9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:53.187767 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa704ab3-c18d-4439-ba89-7308216c59f9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:53.189214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa704ab3-c18d-4439-ba89-7308216c59f9 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:53.209283 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76b4c7-12a7-4e77-a653-301065032107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:53.209492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-aa704ab3-c18d-4439-ba89-7308216c59f9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:19:53.209492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:53.209492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:53.209492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:53.209492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:53.209492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:53.209492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:53.209492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:53.209492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:53.209492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:53.209492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:53.209492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:53.209492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:19:53.209492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:19:53.209492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:19:53.209492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:19:53.210743 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:53.210743 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:53.210743 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:19:53.210743 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:53.210743 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:19:53.210743 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:53.210743 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:53.210743 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:53.210743 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:53.210743 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:53.210743 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:53.210743 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:53.210743 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:53.210743 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:53.210743 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:53.210743 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:53.210743 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:53.210743 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:53.211666 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:53.211666 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:53.211666 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:19:53.211666 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:19:53.211666 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:19:53.211666 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:19:53.211666 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:19:53.211666 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:19:53.211666 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:19:53.211666 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:53.212189 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76b4c7-12a7-4e77-a653-301065032107 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:53.212189 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76b4c7-12a7-4e77-a653-301065032107 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:53.212189 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76b4c7-12a7-4e77-a653-301065032107 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:53.212383 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 305/627] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Aug 24 14:19:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:53.212451 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76b4c7-12a7-4e77-a653-301065032107 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:53.212451 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76b4c7-12a7-4e77-a653-301065032107 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:53.213142 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76b4c7-12a7-4e77-a653-301065032107 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:53.222740 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa704ab3-c18d-4439-ba89-7308216c59f9 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:53.227292 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 323/628] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:19:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:53.233859 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76b4c7-12a7-4e77-a653-301065032107 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:53.261498 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:53.333799 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa704ab3-c18d-4439-ba89-7308216c59f9 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:53.344261 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:53.345431 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76b4c7-12a7-4e77-a653-301065032107 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:53.372366 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2136949-4a2b-4caa-b7fe-a50915980a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:53.373005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2136949-4a2b-4caa-b7fe-a50915980a6f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:53.373323 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2136949-4a2b-4caa-b7fe-a50915980a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:53.373606 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2136949-4a2b-4caa-b7fe-a50915980a6f None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:53.374423 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2136949-4a2b-4caa-b7fe-a50915980a6f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:53.374672 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2136949-4a2b-4caa-b7fe-a50915980a6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:53.376327 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2136949-4a2b-4caa-b7fe-a50915980a6f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:53.384519 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967cdfd-67c3-4937-ad93-49f42ec1d01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:53.385518 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967cdfd-67c3-4937-ad93-49f42ec1d01b None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:53.386035 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967cdfd-67c3-4937-ad93-49f42ec1d01b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:53.386530 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967cdfd-67c3-4937-ad93-49f42ec1d01b None admin] PATH_INFO: `/v3/projects/34cce205e8ee4ae9b09bb89bc4bb081e/users/6b3c32ecfdcf40629f09a7f52b2b5fa8/roles/0df7ee13692d4eb5a741a8b79fd58d58` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:53.400328 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 306/629] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Aug 24 14:19:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:53.401223 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2136949-4a2b-4caa-b7fe-a50915980a6f None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:53.402910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967cdfd-67c3-4937-ad93-49f42ec1d01b None admin] RBAC: Authorizing `identity:create_grant(project_id=34cce205e8ee4ae9b09bb89bc4bb081e, user_id=6b3c32ecfdcf40629f09a7f52b2b5fa8, role_id=0df7ee13692d4eb5a741a8b79fd58d58)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:53.405679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967cdfd-67c3-4937-ad93-49f42ec1d01b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:53.474031 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 324/630] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 14:19:53 2022] PUT /identity/v3/projects/34cce205e8ee4ae9b09bb89bc4bb081e/users/6b3c32ecfdcf40629f09a7f52b2b5fa8/roles/0df7ee13692d4eb5a741a8b79fd58d58 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:19:53.475021 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967cdfd-67c3-4937-ad93-49f42ec1d01b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:53.508465 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2136949-4a2b-4caa-b7fe-a50915980a6f None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:53.549119 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1fb21-fd01-49e1-a5ce-1db17c12bd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:53.549798 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1fb21-fd01-49e1-a5ce-1db17c12bd36 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:53.550071 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1fb21-fd01-49e1-a5ce-1db17c12bd36 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:53.550345 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1fb21-fd01-49e1-a5ce-1db17c12bd36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:53.562049 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c1fb21-fd01-49e1-a5ce-1db17c12bd36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:53.566882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-d4c1fb21-fd01-49e1-a5ce-1db17c12bd36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:19:53.566882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:53.566882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:53.566882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:53.566882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:53.566882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:53.566882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:53.566882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:53.566882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:53.566882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:53.566882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:53.566882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:53.566882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:53.566882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:53.566882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:53.566882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:53.568048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:53.568048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:53.568048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:53.568048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:53.568048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:53.568048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:53.568048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:53.568048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:53.568048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:53.568048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:53.568048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:53.568048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:53.568048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:53.568048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:53.568048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:53.568048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:53.568900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:53.568900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:53.568900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:53.568900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:53.568900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:53.568900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:53.568900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:53.568900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:53.568900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:53.568900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:53.568900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:19:53.568900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:53.568900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 307/631] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 14:19:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:53.569685 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633b6dc-66b8-478a-a73a-6d993afec6c1 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:53.570003 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633b6dc-66b8-478a-a73a-6d993afec6c1 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:53.570279 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633b6dc-66b8-478a-a73a-6d993afec6c1 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:53.571835 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 308/632] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:53.573229 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef0531-8a06-4a2b-acf8-003cf0a828e4 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:53.573495 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef0531-8a06-4a2b-acf8-003cf0a828e4 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:53.577788 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef0531-8a06-4a2b-acf8-003cf0a828e4 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:53.577788 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 309/633] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:53.577788 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef0531-8a06-4a2b-acf8-003cf0a828e4 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:53.583233 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:53.606830 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:53.617620 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967cdfd-67c3-4937-ad93-49f42ec1d01b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:53.662927 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797709c9-ca92-45c0-9122-17e606689018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:53.663612 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797709c9-ca92-45c0-9122-17e606689018 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:53.663987 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797709c9-ca92-45c0-9122-17e606689018 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:53.664361 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797709c9-ca92-45c0-9122-17e606689018 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:53.697954 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef0531-8a06-4a2b-acf8-003cf0a828e4 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:53.734313 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247ec03-148d-4b21-b03c-98140e85ab7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:53.735060 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247ec03-148d-4b21-b03c-98140e85ab7b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:53.735439 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247ec03-148d-4b21-b03c-98140e85ab7b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:53.735835 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247ec03-148d-4b21-b03c-98140e85ab7b None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:53.736581 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247ec03-148d-4b21-b03c-98140e85ab7b None admin] RBAC: Adding query filter params (name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:53.736981 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247ec03-148d-4b21-b03c-98140e85ab7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:53.738479 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247ec03-148d-4b21-b03c-98140e85ab7b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:53.739301 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797709c9-ca92-45c0-9122-17e606689018 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:53.741218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797709c9-ca92-45c0-9122-17e606689018 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:53.746416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 310/634] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 14:19:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:53.747785 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312630cf-49a8-46d0-8e3f-55c401192848 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:53.748150 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312630cf-49a8-46d0-8e3f-55c401192848 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:53.748426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312630cf-49a8-46d0-8e3f-55c401192848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:53.768649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-312630cf-49a8-46d0-8e3f-55c401192848 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:53.770438 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-312630cf-49a8-46d0-8e3f-55c401192848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:53.821654 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:53.849065 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 311/635] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:53.850556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efd828-7520-4eca-8f5a-0cdcdd573100 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:53.850977 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efd828-7520-4eca-8f5a-0cdcdd573100 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:53.851389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efd828-7520-4eca-8f5a-0cdcdd573100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:53.863605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 325/636] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:19:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:19:53.863605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797709c9-ca92-45c0-9122-17e606689018 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:53.880125 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-f9efd828-7520-4eca-8f5a-0cdcdd573100 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:53.881861 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f9efd828-7520-4eca-8f5a-0cdcdd573100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:53.897099 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:53.954669 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 312/637] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:53.955873 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efd828-7520-4eca-8f5a-0cdcdd573100 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:53.987637 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797709c9-ca92-45c0-9122-17e606689018 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:54.046188 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213b748-e7d6-4d30-ba01-731065a2714b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:54.047014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213b748-e7d6-4d30-ba01-731065a2714b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:54.047593 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213b748-e7d6-4d30-ba01-731065a2714b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:54.047714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213b748-e7d6-4d30-ba01-731065a2714b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:54.064462 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213b748-e7d6-4d30-ba01-731065a2714b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:54.070766 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efd828-7520-4eca-8f5a-0cdcdd573100 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:54.074109 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213b748-e7d6-4d30-ba01-731065a2714b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:54.094316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-e213b748-e7d6-4d30-ba01-731065a2714b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:54.094316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:54.094316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:54.094316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:54.094316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:54.094316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:54.094316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:54.094316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:54.094316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:54.094316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:54.094316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:54.094316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:54.094316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:54.094316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:54.094316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:54.094316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:54.095316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:54.095316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:54.095316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:54.095316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:54.095316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:54.095316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:54.095316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:54.095316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:54.095316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:54.095316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:54.095316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:54.095316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:54.095316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:54.095316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:54.095316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:54.095316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:54.095316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:54.096194 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:54.096194 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:54.096194 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:54.099293 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 326/638] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:54.107220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213b748-e7d6-4d30-ba01-731065a2714b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:54.112097 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9d8f0-dfd1-4a72-b579-4e53961ace06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:54.112993 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9d8f0-dfd1-4a72-b579-4e53961ace06 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:54.113501 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9d8f0-dfd1-4a72-b579-4e53961ace06 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:54.114016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9d8f0-dfd1-4a72-b579-4e53961ace06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:54.125077 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9d8f0-dfd1-4a72-b579-4e53961ace06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:54.126857 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9d8f0-dfd1-4a72-b579-4e53961ace06 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:54.136186 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:54.144143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-f0b9d8f0-dfd1-4a72-b579-4e53961ace06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:54.144143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:54.144143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:54.144143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:54.144143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:54.144143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:54.144143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:54.144143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:54.144143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:54.144143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:54.144143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:54.144143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:54.144143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:54.144143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:54.144143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:54.144143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:54.145131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:54.145131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:54.145131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:54.145131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:54.145131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:54.145131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:54.145131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:54.145131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:54.145131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:54.145131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:54.145131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:54.145131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:54.145131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:54.145131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:54.145131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:54.145131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:54.145131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:54.146033 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:54.146033 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:54.146033 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:54.150238 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 313/639] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:54.150238 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9d8f0-dfd1-4a72-b579-4e53961ace06 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:54.166432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:54.241557 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213b748-e7d6-4d30-ba01-731065a2714b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:54.265985 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9d8f0-dfd1-4a72-b579-4e53961ace06 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:54.294612 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad67ae-8959-48c8-b0fd-23bfae35caff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:54.295804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad67ae-8959-48c8-b0fd-23bfae35caff None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:54.296273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad67ae-8959-48c8-b0fd-23bfae35caff None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:54.296858 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad67ae-8959-48c8-b0fd-23bfae35caff None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:54.298019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad67ae-8959-48c8-b0fd-23bfae35caff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:54.298846 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad67ae-8959-48c8-b0fd-23bfae35caff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:54.300752 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad67ae-8959-48c8-b0fd-23bfae35caff None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:54.302493 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80d6c6-7b43-42be-85e9-ad51a1e28ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:54.303191 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80d6c6-7b43-42be-85e9-ad51a1e28ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:54.303536 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80d6c6-7b43-42be-85e9-ad51a1e28ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:54.303879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80d6c6-7b43-42be-85e9-ad51a1e28ca5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:54.316054 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80d6c6-7b43-42be-85e9-ad51a1e28ca5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:54.316586 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 327/640] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:54.317650 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad67ae-8959-48c8-b0fd-23bfae35caff None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:54.322737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-1d80d6c6-7b43-42be-85e9-ad51a1e28ca5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:19:54.322737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:54.322737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:54.322737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:54.322737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:54.322737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:54.322737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:54.322737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:54.322737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:54.322737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:54.322737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:54.322737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:54.322737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:54.322737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:54.322737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:54.322737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:54.323738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:54.323738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:54.323738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:54.323738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:54.323738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:54.323738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:54.323738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:54.323738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:54.323738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:54.323738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:54.323738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:54.323738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:54.323738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:54.323738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:54.323738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:54.323738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:54.324891 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:54.324891 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:54.324891 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:54.324891 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:54.324891 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:54.324891 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:54.324891 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:54.324891 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:54.324891 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:54.324891 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:54.324891 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:19:54.324891 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:54.324891 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 314/641] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 14:19:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:54.326196 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80d6c6-7b43-42be-85e9-ad51a1e28ca5 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:54.391456 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:54.423084 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:54.435836 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80d6c6-7b43-42be-85e9-ad51a1e28ca5 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:54.438252 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad67ae-8959-48c8-b0fd-23bfae35caff None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:54.475679 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b931e7c-29b0-43fb-89b2-99f8d7be84c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:54.476056 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178455a1-897f-4409-b1f0-cb5f16d3f5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:54.476304 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b931e7c-29b0-43fb-89b2-99f8d7be84c7 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:54.476582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b931e7c-29b0-43fb-89b2-99f8d7be84c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:54.476679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178455a1-897f-4409-b1f0-cb5f16d3f5f6 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:54.476852 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b931e7c-29b0-43fb-89b2-99f8d7be84c7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:54.476949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178455a1-897f-4409-b1f0-cb5f16d3f5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:54.477185 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178455a1-897f-4409-b1f0-cb5f16d3f5f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:54.477859 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178455a1-897f-4409-b1f0-cb5f16d3f5f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:54.478165 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178455a1-897f-4409-b1f0-cb5f16d3f5f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:54.479637 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178455a1-897f-4409-b1f0-cb5f16d3f5f6 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:54.484825 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b931e7c-29b0-43fb-89b2-99f8d7be84c7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:54.486685 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b931e7c-29b0-43fb-89b2-99f8d7be84c7 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:54.496120 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 328/642] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:54.496120 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178455a1-897f-4409-b1f0-cb5f16d3f5f6 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:54.501999 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-9b931e7c-29b0-43fb-89b2-99f8d7be84c7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 14:19:54.501999 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:54.501999 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:54.501999 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:54.501999 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:54.501999 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:54.501999 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:54.501999 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:54.501999 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:54.501999 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:54.501999 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:54.501999 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:54.501999 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:19:54.501999 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:19:54.501999 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:19:54.501999 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:19:54.503006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:54.503006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:54.503006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:19:54.503006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:54.503006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:19:54.503006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:54.503006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:54.503006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:54.503006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:54.503006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:54.503006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:54.503006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:54.503006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:54.503006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:54.503006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:54.503006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:54.503006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:54.503006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:54.504235 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:54.504235 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:54.504235 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:19:54.504235 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:19:54.504235 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:19:54.504235 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:19:54.504235 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:19:54.504235 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:19:54.504235 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 14:19:54.504235 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:54.504235 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 315/643] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:19:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:54.504832 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b931e7c-29b0-43fb-89b2-99f8d7be84c7 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:54.612355 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178455a1-897f-4409-b1f0-cb5f16d3f5f6 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:54.619472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b931e7c-29b0-43fb-89b2-99f8d7be84c7 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:54.641145 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:54.651881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7be43-91f5-4ec1-b267-f0c78631ce48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:54.652765 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7be43-91f5-4ec1-b267-f0c78631ce48 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:54.657138 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7be43-91f5-4ec1-b267-f0c78631ce48 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:54.657138 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7be43-91f5-4ec1-b267-f0c78631ce48 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:54.657138 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7be43-91f5-4ec1-b267-f0c78631ce48 None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:54.657138 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7be43-91f5-4ec1-b267-f0c78631ce48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:54.657441 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd1bc5-f2ac-4c75-931f-d5dcf34f4b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:54.657441 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd1bc5-f2ac-4c75-931f-d5dcf34f4b1a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:54.657615 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7be43-91f5-4ec1-b267-f0c78631ce48 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:54.657688 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd1bc5-f2ac-4c75-931f-d5dcf34f4b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:54.657688 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd1bc5-f2ac-4c75-931f-d5dcf34f4b1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:54.666926 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 329/644] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 14:19:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:54.667716 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7be43-91f5-4ec1-b267-f0c78631ce48 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:54.676249 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd1bc5-f2ac-4c75-931f-d5dcf34f4b1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:54.678707 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:54.681582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-b9bd1bc5-f2ac-4c75-931f-d5dcf34f4b1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:19:54.681582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:54.681582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:54.681582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:54.681582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:54.681582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:54.681582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:54.681582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:54.681582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:54.681582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:54.681582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:54.681582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:54.681582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:54.681582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:54.681582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:54.681582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:54.682548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:54.682548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:54.682548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:54.682548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:54.682548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:54.682548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:54.682548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:54.682548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:54.682548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:54.682548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:54.682548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:54.682548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:54.682548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:54.682548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:54.682548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:54.682548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:54.683421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:54.683421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:54.683421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:54.683421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:54.683421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:54.683421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:54.683421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:54.683421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:54.683421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:54.683421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:54.683421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:19:54.683421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:54.683421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 316/645] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 14:19:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:54.684211 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd1bc5-f2ac-4c75-931f-d5dcf34f4b1a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:54.782808 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7be43-91f5-4ec1-b267-f0c78631ce48 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:54.791441 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd1bc5-f2ac-4c75-931f-d5dcf34f4b1a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:54.819491 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092e1ec-c4f4-4bd4-90de-26d9756c7c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:54.820113 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092e1ec-c4f4-4bd4-90de-26d9756c7c5f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:54.820395 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092e1ec-c4f4-4bd4-90de-26d9756c7c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:54.820667 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092e1ec-c4f4-4bd4-90de-26d9756c7c5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:54.826906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c920170-b77d-4304-b86e-c8e391a99406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:54.827407 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092e1ec-c4f4-4bd4-90de-26d9756c7c5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:54.827929 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c920170-b77d-4304-b86e-c8e391a99406 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:54.828382 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c920170-b77d-4304-b86e-c8e391a99406 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:54.828849 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c920170-b77d-4304-b86e-c8e391a99406 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:54.828960 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092e1ec-c4f4-4bd4-90de-26d9756c7c5f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:54.829870 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c920170-b77d-4304-b86e-c8e391a99406 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:54.830350 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c920170-b77d-4304-b86e-c8e391a99406 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:54.832436 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c920170-b77d-4304-b86e-c8e391a99406 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:54.840328 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-0092e1ec-c4f4-4bd4-90de-26d9756c7c5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:19:54.840328 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:54.840328 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:54.840328 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:54.840328 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:54.840328 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:54.840328 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:54.840328 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:54.840328 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:54.840328 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:54.840328 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:54.840328 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:54.840328 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:19:54.840328 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:19:54.840328 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:19:54.841809 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:19:54.841809 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:54.841809 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:54.841809 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:54.841809 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:54.841809 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:54.841809 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:54.841809 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:54.841809 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:54.841809 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:54.841809 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:54.841809 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:54.841809 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:54.841809 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:54.841809 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:54.841809 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:54.841809 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:54.847855 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:19:54.847855 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:19:54.847855 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:19:54.847855 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:19:54.847855 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:19:54.847855 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:19:54.847855 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:19:54.847855 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:54.847855 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 330/646] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:19:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:54.847855 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092e1ec-c4f4-4bd4-90de-26d9756c7c5f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:54.860854 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 317/647] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Aug 24 14:19:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:54.860854 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c920170-b77d-4304-b86e-c8e391a99406 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:54.901307 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:54.927017 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:54.962256 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092e1ec-c4f4-4bd4-90de-26d9756c7c5f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:54.965165 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c920170-b77d-4304-b86e-c8e391a99406 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:54.996854 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661a4d0-41fa-480a-b03e-c0d28d4433e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:54.998052 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661a4d0-41fa-480a-b03e-c0d28d4433e7 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:54.998397 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661a4d0-41fa-480a-b03e-c0d28d4433e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:54.998573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661a4d0-41fa-480a-b03e-c0d28d4433e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:55.001486 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266b639-7aa1-462e-b3fb-e05fbcc0d138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:55.002040 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266b639-7aa1-462e-b3fb-e05fbcc0d138 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:55.002383 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266b639-7aa1-462e-b3fb-e05fbcc0d138 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:55.002598 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266b639-7aa1-462e-b3fb-e05fbcc0d138 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:55.003251 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266b639-7aa1-462e-b3fb-e05fbcc0d138 None admin] RBAC: Adding query filter params (name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:55.003552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266b639-7aa1-462e-b3fb-e05fbcc0d138 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:55.005162 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266b639-7aa1-462e-b3fb-e05fbcc0d138 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:55.010001 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661a4d0-41fa-480a-b03e-c0d28d4433e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:55.011455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661a4d0-41fa-480a-b03e-c0d28d4433e7 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:55.014262 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 318/648] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 14:19:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:55.015225 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266b639-7aa1-462e-b3fb-e05fbcc0d138 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:55.031649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-6661a4d0-41fa-480a-b03e-c0d28d4433e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:55.031649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:55.031649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:55.031649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:55.031649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:55.031649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:55.031649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:55.031649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:55.031649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:55.031649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:55.031649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:55.031649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:55.031649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:55.031649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:55.031649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:55.031649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:55.032899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:55.032899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:55.032899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:55.032899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:55.032899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:55.032899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:55.032899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:55.032899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:55.032899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:55.032899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:55.032899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:55.032899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:55.032899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:55.032899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:55.032899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:55.032899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:55.032899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:55.034030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:55.034030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:55.034030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:55.035703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 331/649] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:55.036646 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661a4d0-41fa-480a-b03e-c0d28d4433e7 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:55.128098 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:55.132303 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266b639-7aa1-462e-b3fb-e05fbcc0d138 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:55.144505 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661a4d0-41fa-480a-b03e-c0d28d4433e7 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:55.163889 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:55.173344 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73ea24-9653-42a3-a284-d5fd21ee149a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:55.173981 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73ea24-9653-42a3-a284-d5fd21ee149a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:55.174255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73ea24-9653-42a3-a284-d5fd21ee149a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:55.174619 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73ea24-9653-42a3-a284-d5fd21ee149a None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:55.175205 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73ea24-9653-42a3-a284-d5fd21ee149a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:55.175505 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73ea24-9653-42a3-a284-d5fd21ee149a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:55.176908 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73ea24-9653-42a3-a284-d5fd21ee149a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:55.181330 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a3af9-3553-4fe0-abe3-eef92c3f17fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:55.181988 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a3af9-3553-4fe0-abe3-eef92c3f17fd None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:55.182266 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a3af9-3553-4fe0-abe3-eef92c3f17fd None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:55.182537 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a3af9-3553-4fe0-abe3-eef92c3f17fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:55.195028 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 319/650] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:19:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:55.195028 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73ea24-9653-42a3-a284-d5fd21ee149a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:55.271988 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a3af9-3553-4fe0-abe3-eef92c3f17fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:55.274417 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a3af9-3553-4fe0-abe3-eef92c3f17fd None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:55.306594 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73ea24-9653-42a3-a284-d5fd21ee149a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:55.347427 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5391ccb-9615-4aac-918b-015bb19b2e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:55.348077 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5391ccb-9615-4aac-918b-015bb19b2e0e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:55.348353 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5391ccb-9615-4aac-918b-015bb19b2e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:55.348621 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5391ccb-9615-4aac-918b-015bb19b2e0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:55.359016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5391ccb-9615-4aac-918b-015bb19b2e0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:55.360443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5391ccb-9615-4aac-918b-015bb19b2e0e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:55.374976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-d5391ccb-9615-4aac-918b-015bb19b2e0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:55.374976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:55.374976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:55.374976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:55.374976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:55.374976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:55.374976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:55.374976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:55.374976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:55.374976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:55.374976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:55.374976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:55.374976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:55.374976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:55.374976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:55.374976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:55.375937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:55.375937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:55.375937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:55.375937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:55.375937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:55.375937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:55.375937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:55.375937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:55.375937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:55.375937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:55.375937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:55.375937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:55.375937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:55.375937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:55.375937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:55.375937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:55.375937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:55.376803 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:55.376803 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:55.376803 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:55.376803 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 320/651] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:55.377034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5391ccb-9615-4aac-918b-015bb19b2e0e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:55.387546 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 332/652] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:19:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:19:55.393815 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a3af9-3553-4fe0-abe3-eef92c3f17fd None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:55.394298 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:55.423931 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:55.484921 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5391ccb-9615-4aac-918b-015bb19b2e0e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:55.507408 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a3af9-3553-4fe0-abe3-eef92c3f17fd None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:55.519404 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92051772-772f-450c-b1a5-ac6f2ccfa436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:55.519991 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92051772-772f-450c-b1a5-ac6f2ccfa436 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:55.520264 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92051772-772f-450c-b1a5-ac6f2ccfa436 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:55.520537 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92051772-772f-450c-b1a5-ac6f2ccfa436 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:55.521167 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92051772-772f-450c-b1a5-ac6f2ccfa436 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:55.521461 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92051772-772f-450c-b1a5-ac6f2ccfa436 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:55.522856 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92051772-772f-450c-b1a5-ac6f2ccfa436 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:55.537936 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 321/653] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:55.538754 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92051772-772f-450c-b1a5-ac6f2ccfa436 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:55.546239 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee17d13-39c0-4215-914f-34b528a304e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:55.546239 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee17d13-39c0-4215-914f-34b528a304e1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:55.546472 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee17d13-39c0-4215-914f-34b528a304e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:55.546658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee17d13-39c0-4215-914f-34b528a304e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:55.547341 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee17d13-39c0-4215-914f-34b528a304e1 None admin] RBAC: Adding query filter params (role.id=0df7ee13692d4eb5a741a8b79fd58d58, scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e, user.id=8d099678d6454f7eb494892a69feaf62) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:55.547647 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee17d13-39c0-4215-914f-34b528a304e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:55.549076 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee17d13-39c0-4215-914f-34b528a304e1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:55.555005 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 333/654] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:19:55 2022] GET /identity/v3/role_assignments?user.id=8d099678d6454f7eb494892a69feaf62&scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e&role.id=0df7ee13692d4eb5a741a8b79fd58d58 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:55.555772 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee17d13-39c0-4215-914f-34b528a304e1 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:55.631030 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:55.652170 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:55.668484 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92051772-772f-450c-b1a5-ac6f2ccfa436 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:55.672244 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee17d13-39c0-4215-914f-34b528a304e1 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:55.707575 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e09cd1-cf32-4a75-8aaa-20d983d3b266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:55.708582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e09cd1-cf32-4a75-8aaa-20d983d3b266 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:55.709058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e09cd1-cf32-4a75-8aaa-20d983d3b266 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:55.709549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e09cd1-cf32-4a75-8aaa-20d983d3b266 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:55.710417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e09cd1-cf32-4a75-8aaa-20d983d3b266 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:55.710926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e09cd1-cf32-4a75-8aaa-20d983d3b266 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:55.712523 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e09cd1-cf32-4a75-8aaa-20d983d3b266 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:55.718196 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48731670-5468-478f-873c-23a6092479d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:55.718827 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48731670-5468-478f-873c-23a6092479d7 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:55.719100 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48731670-5468-478f-873c-23a6092479d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:55.719367 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48731670-5468-478f-873c-23a6092479d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:55.725181 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 322/655] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:55.726466 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3f650-79ca-49b4-8ad8-d8c8d327c758 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:55.726758 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3f650-79ca-49b4-8ad8-d8c8d327c758 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:55.727152 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3f650-79ca-49b4-8ad8-d8c8d327c758 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:55.728795 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 323/656] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:55.729637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3f650-79ca-49b4-8ad8-d8c8d327c758 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:55.731198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48731670-5468-478f-873c-23a6092479d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:55.733709 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48731670-5468-478f-873c-23a6092479d7 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:55.749071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-48731670-5468-478f-873c-23a6092479d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:55.749071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:55.749071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:55.749071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:55.749071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:55.749071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:55.749071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:55.749071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:55.749071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:55.749071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:55.749071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:55.749071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:55.749071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:55.749071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:55.749071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:55.749071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:55.750147 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:55.750147 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:55.750147 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:55.750147 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:55.750147 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:55.750147 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:55.750147 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:55.750147 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:55.750147 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:55.750147 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:55.750147 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:55.750147 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:55.750147 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:55.750147 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:55.750147 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:55.750147 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:55.750147 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:55.751053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:55.751053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:55.751053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:55.751053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 334/657] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:55.751053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48731670-5468-478f-873c-23a6092479d7 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:55.860780 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3f650-79ca-49b4-8ad8-d8c8d327c758 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:55.864646 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48731670-5468-478f-873c-23a6092479d7 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:55.891452 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:55.897919 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0132c-ee1b-4488-928a-fc8a184c5c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:55.898987 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0132c-ee1b-4488-928a-fc8a184c5c9d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:55.904881 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0132c-ee1b-4488-928a-fc8a184c5c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:55.904881 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0132c-ee1b-4488-928a-fc8a184c5c9d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:55.905110 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab0501-f6a8-4f2c-9a2a-ad60fee719bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:55.905110 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab0501-f6a8-4f2c-9a2a-ad60fee719bb None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:55.905110 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab0501-f6a8-4f2c-9a2a-ad60fee719bb None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:55.905110 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab0501-f6a8-4f2c-9a2a-ad60fee719bb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:55.907211 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:55.907674 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0132c-ee1b-4488-928a-fc8a184c5c9d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:55.909840 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0132c-ee1b-4488-928a-fc8a184c5c9d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:55.913076 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab0501-f6a8-4f2c-9a2a-ad60fee719bb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:55.914544 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab0501-f6a8-4f2c-9a2a-ad60fee719bb None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:55.923331 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-ccd0132c-ee1b-4488-928a-fc8a184c5c9d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 14:19:55.923331 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:55.923331 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:55.923331 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:55.923331 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:55.923331 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:55.923331 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:55.923331 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:55.923331 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:55.923331 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:55.923331 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:55.923331 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:55.923331 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:19:55.923331 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:19:55.923331 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:19:55.923331 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:19:55.924574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:55.924574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:55.924574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:19:55.924574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:55.924574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:19:55.924574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:55.924574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:55.924574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:55.924574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:55.924574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:55.924574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:55.924574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:55.924574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:55.924574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:55.924574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:55.924574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:55.924574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:55.924574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:55.925499 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:55.925499 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:55.925499 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:19:55.925499 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:19:55.925499 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:19:55.925499 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:19:55.925499 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:19:55.925499 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:19:55.925499 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 14:19:55.925499 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:55.926559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-06ab0501-f6a8-4f2c-9a2a-ad60fee719bb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 14:19:55.926559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:55.926559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:55.926559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:55.926559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:55.926559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:55.926559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:55.926559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:55.926559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:55.926559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:55.926559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:55.926559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:55.926559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:19:55.926559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:19:55.926559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:19:55.926559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:19:55.927644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:55.927644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:55.927644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:19:55.927644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:55.927644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:19:55.927644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:55.927644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:55.927644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:55.927644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:55.927644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:55.927644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:55.927644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:55.927644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:55.927644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:55.927644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:55.927644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:55.927644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:55.927644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:55.930061 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:55.930061 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:55.930061 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:19:55.930061 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:19:55.930061 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:19:55.930061 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:19:55.930061 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:19:55.930061 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:19:55.930061 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 14:19:55.930061 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:55.931807 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 324/658] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:19:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:55.931807 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92626c6-b560-4006-a1de-3aa7beb15023 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:55.931807 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92626c6-b560-4006-a1de-3aa7beb15023 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:55.931807 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92626c6-b560-4006-a1de-3aa7beb15023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:55.932356 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 335/659] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 14:19:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:55.932887 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab0501-f6a8-4f2c-9a2a-ad60fee719bb None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:55.956230 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-e92626c6-b560-4006-a1de-3aa7beb15023 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:55.957791 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e92626c6-b560-4006-a1de-3aa7beb15023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:56.036293 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 325/660] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:56.037159 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92626c6-b560-4006-a1de-3aa7beb15023 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:56.045867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab0501-f6a8-4f2c-9a2a-ad60fee719bb None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:56.087608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cdd215-864a-4ada-b9ea-6b67f00189a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:56.088473 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cdd215-864a-4ada-b9ea-6b67f00189a1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:56.088761 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cdd215-864a-4ada-b9ea-6b67f00189a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:56.089090 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cdd215-864a-4ada-b9ea-6b67f00189a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:56.089818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cdd215-864a-4ada-b9ea-6b67f00189a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:56.090135 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cdd215-864a-4ada-b9ea-6b67f00189a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:56.091777 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cdd215-864a-4ada-b9ea-6b67f00189a1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:56.109711 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 336/661] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:56.109711 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cdd215-864a-4ada-b9ea-6b67f00189a1 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:56.166534 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:56.179000 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92626c6-b560-4006-a1de-3aa7beb15023 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:56.209403 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:56.221075 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cdd215-864a-4ada-b9ea-6b67f00189a1 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:56.221587 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413770a9-8d57-4bb7-a622-e7a20cd63e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:56.222287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413770a9-8d57-4bb7-a622-e7a20cd63e65 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:56.222634 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413770a9-8d57-4bb7-a622-e7a20cd63e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:56.222980 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413770a9-8d57-4bb7-a622-e7a20cd63e65 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:56.223783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413770a9-8d57-4bb7-a622-e7a20cd63e65 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:56.224213 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413770a9-8d57-4bb7-a622-e7a20cd63e65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:56.225786 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413770a9-8d57-4bb7-a622-e7a20cd63e65 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:56.244810 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 326/662] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Aug 24 14:19:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:56.245793 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413770a9-8d57-4bb7-a622-e7a20cd63e65 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:56.266108 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a09994-ac87-47bc-a8e3-1712eca68ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:56.266933 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a09994-ac87-47bc-a8e3-1712eca68ddd None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:56.267910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a09994-ac87-47bc-a8e3-1712eca68ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:56.268370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a09994-ac87-47bc-a8e3-1712eca68ddd None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:56.269597 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a09994-ac87-47bc-a8e3-1712eca68ddd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:56.270263 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a09994-ac87-47bc-a8e3-1712eca68ddd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:56.272121 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a09994-ac87-47bc-a8e3-1712eca68ddd None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:56.295619 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 337/663] 10.222.0.65 () {56 vars in 1139 bytes} [Wed Aug 24 14:19:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:56.296751 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a09994-ac87-47bc-a8e3-1712eca68ddd None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:56.369092 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413770a9-8d57-4bb7-a622-e7a20cd63e65 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:56.408922 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c985bbf-7ce8-4b48-8c18-d444f815a05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:56.409534 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c985bbf-7ce8-4b48-8c18-d444f815a05a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:56.409847 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c985bbf-7ce8-4b48-8c18-d444f815a05a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:56.410180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c985bbf-7ce8-4b48-8c18-d444f815a05a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:56.416351 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a09994-ac87-47bc-a8e3-1712eca68ddd None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:56.416765 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c985bbf-7ce8-4b48-8c18-d444f815a05a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:56.418180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c985bbf-7ce8-4b48-8c18-d444f815a05a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:56.429966 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-7c985bbf-7ce8-4b48-8c18-d444f815a05a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:19:56.429966 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:56.429966 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:56.429966 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:56.429966 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:56.429966 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:56.429966 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:56.429966 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:56.429966 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:56.429966 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:56.429966 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:56.429966 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:56.429966 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:19:56.429966 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:19:56.429966 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:19:56.431026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:19:56.431026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:56.431026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:56.431026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:56.431026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:56.431026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:56.431026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:56.431026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:56.431026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:56.431026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:56.431026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:56.431026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:56.431026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:56.431026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:56.431026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:56.431026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:56.431026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:56.431915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:19:56.431915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:19:56.431915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:19:56.431915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:19:56.431915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:19:56.431915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:19:56.431915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:19:56.431915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:56.431915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 327/664] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:19:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:56.432406 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c985bbf-7ce8-4b48-8c18-d444f815a05a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:56.433262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:56.457635 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c33cd-f645-4b9c-89dc-7f7cb64e6f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:56.458263 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c33cd-f645-4b9c-89dc-7f7cb64e6f55 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:56.458539 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c33cd-f645-4b9c-89dc-7f7cb64e6f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:56.458806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c33cd-f645-4b9c-89dc-7f7cb64e6f55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:56.475120 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:56.534186 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c985bbf-7ce8-4b48-8c18-d444f815a05a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:56.538260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c33cd-f645-4b9c-89dc-7f7cb64e6f55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:56.539700 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c33cd-f645-4b9c-89dc-7f7cb64e6f55 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:56.570257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cdf12-2810-477e-8fe4-986ae5ae1430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:56.571087 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cdf12-2810-477e-8fe4-986ae5ae1430 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:56.571366 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cdf12-2810-477e-8fe4-986ae5ae1430 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:56.571642 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cdf12-2810-477e-8fe4-986ae5ae1430 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:56.645566 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717cdf12-2810-477e-8fe4-986ae5ae1430 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:56.647055 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717cdf12-2810-477e-8fe4-986ae5ae1430 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:56.655816 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 338/665] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:19:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:19:56.656801 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c33cd-f645-4b9c-89dc-7f7cb64e6f55 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:56.673574 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:56.697389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:56.763075 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 328/666] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:19:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:19:56.764359 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cdf12-2810-477e-8fe4-986ae5ae1430 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:56.773380 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c33cd-f645-4b9c-89dc-7f7cb64e6f55 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:56.810733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e67d52-f9dc-4627-b9d5-f76b42bef917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:56.811365 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e67d52-f9dc-4627-b9d5-f76b42bef917 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:56.811641 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e67d52-f9dc-4627-b9d5-f76b42bef917 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:56.811910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e67d52-f9dc-4627-b9d5-f76b42bef917 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:56.821878 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e67d52-f9dc-4627-b9d5-f76b42bef917 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:56.827027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-49e67d52-f9dc-4627-b9d5-f76b42bef917 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:19:56.827027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:56.827027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:56.827027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:56.827027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:56.827027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:56.827027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:56.827027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:56.827027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:56.827027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:56.827027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:56.827027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:56.827027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:56.827027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:56.827027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:56.827027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:56.827957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:56.827957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:56.827957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:56.827957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:56.827957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:56.827957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:56.827957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:56.827957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:56.827957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:56.827957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:56.827957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:56.827957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:56.827957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:56.827957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:56.827957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:56.827957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:56.828811 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:56.828811 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:56.828811 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:56.828811 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:56.828811 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:56.828811 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:56.828811 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:56.828811 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:56.828811 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:56.828811 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:56.828811 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:19:56.828811 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:56.828811 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 339/667] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 14:19:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:56.829506 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e67d52-f9dc-4627-b9d5-f76b42bef917 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:56.868966 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cdf12-2810-477e-8fe4-986ae5ae1430 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:56.907744 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d2fc8-810a-4f44-8b37-9206517eea79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:56.908348 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d2fc8-810a-4f44-8b37-9206517eea79 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:56.908626 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d2fc8-810a-4f44-8b37-9206517eea79 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:56.909056 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d2fc8-810a-4f44-8b37-9206517eea79 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:56.909679 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d2fc8-810a-4f44-8b37-9206517eea79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:56.910147 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:56.910665 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d2fc8-810a-4f44-8b37-9206517eea79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:56.912091 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d2fc8-810a-4f44-8b37-9206517eea79 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:56.921844 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:56.926116 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 329/668] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:19:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:56.927328 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d2fc8-810a-4f44-8b37-9206517eea79 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:56.946505 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e67d52-f9dc-4627-b9d5-f76b42bef917 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:56.983059 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a7091-3fc5-4338-91bc-2a54610d98ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:56.983969 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a7091-3fc5-4338-91bc-2a54610d98ed None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:56.984252 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a7091-3fc5-4338-91bc-2a54610d98ed None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:56.984543 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a7091-3fc5-4338-91bc-2a54610d98ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:56.994557 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a7091-3fc5-4338-91bc-2a54610d98ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:56.995981 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a7091-3fc5-4338-91bc-2a54610d98ed None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:57.011384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-819a7091-3fc5-4338-91bc-2a54610d98ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:57.011384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:57.011384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:57.011384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:57.011384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:57.011384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:57.011384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:57.011384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:57.011384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:57.011384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:57.011384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:57.011384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:57.011384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:57.011384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:57.011384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:57.011384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:57.012352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:57.012352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:57.012352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:57.012352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:57.012352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:57.012352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:57.012352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:57.012352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:57.012352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:57.012352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:57.012352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:57.012352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:57.012352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:57.012352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:57.012352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:57.012352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:57.012352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:57.014081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:57.014081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:57.014081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:57.014081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 340/669] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:57.014081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a7091-3fc5-4338-91bc-2a54610d98ed None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:57.037141 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d2fc8-810a-4f44-8b37-9206517eea79 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:57.073021 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f865f-20c1-4a44-ad49-d47acaaafa95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:57.073643 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f865f-20c1-4a44-ad49-d47acaaafa95 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:57.073942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f865f-20c1-4a44-ad49-d47acaaafa95 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:57.074212 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f865f-20c1-4a44-ad49-d47acaaafa95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:57.085566 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f865f-20c1-4a44-ad49-d47acaaafa95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:57.087031 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f865f-20c1-4a44-ad49-d47acaaafa95 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:57.100978 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-3f6f865f-20c1-4a44-ad49-d47acaaafa95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:57.100978 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:57.100978 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:57.100978 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:57.100978 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:57.100978 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:57.100978 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:57.100978 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:57.100978 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:57.100978 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:57.100978 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:57.100978 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:57.100978 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:57.100978 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:57.100978 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:57.100978 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:57.102169 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:57.102169 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:57.102169 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:57.102169 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:57.102169 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:57.102169 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:57.102169 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:57.102169 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:57.102169 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:57.102169 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:57.102169 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:57.102169 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:57.102169 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:57.102169 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:57.102169 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:57.102169 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:57.102169 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:57.103255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:57.103255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:57.103255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:57.106629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 330/670] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:57.107352 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f865f-20c1-4a44-ad49-d47acaaafa95 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:57.121403 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a7091-3fc5-4338-91bc-2a54610d98ed None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:57.148594 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:57.159749 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc0632-47ed-4287-8045-2ca6fef00761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:57.160358 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc0632-47ed-4287-8045-2ca6fef00761 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:57.162431 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc0632-47ed-4287-8045-2ca6fef00761 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:57.162431 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc0632-47ed-4287-8045-2ca6fef00761 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:57.162431 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc0632-47ed-4287-8045-2ca6fef00761 None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:57.162431 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc0632-47ed-4287-8045-2ca6fef00761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:57.162855 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:57.163249 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc0632-47ed-4287-8045-2ca6fef00761 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:57.171884 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 341/671] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 14:19:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:57.172481 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc0632-47ed-4287-8045-2ca6fef00761 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:57.216308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f865f-20c1-4a44-ad49-d47acaaafa95 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:57.250781 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fa0b3-75ec-4cd9-af89-c2b56f58ce12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:57.251380 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fa0b3-75ec-4cd9-af89-c2b56f58ce12 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:57.251672 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fa0b3-75ec-4cd9-af89-c2b56f58ce12 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:57.251921 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fa0b3-75ec-4cd9-af89-c2b56f58ce12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:57.252642 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fa0b3-75ec-4cd9-af89-c2b56f58ce12 None admin] RBAC: Adding query filter params (role.id=0df7ee13692d4eb5a741a8b79fd58d58, scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e, user.id=78745f9dbf544ab291acfa7a063c1493) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:57.252942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fa0b3-75ec-4cd9-af89-c2b56f58ce12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:57.254676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fa0b3-75ec-4cd9-af89-c2b56f58ce12 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:57.264541 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 331/672] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:19:57 2022] GET /identity/v3/role_assignments?user.id=78745f9dbf544ab291acfa7a063c1493&scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e&role.id=0df7ee13692d4eb5a741a8b79fd58d58 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:57.265469 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fa0b3-75ec-4cd9-af89-c2b56f58ce12 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:57.291308 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc0632-47ed-4287-8045-2ca6fef00761 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:57.344050 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb4f7d-0877-40a3-bea9-5ba9c8f04e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:57.344948 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb4f7d-0877-40a3-bea9-5ba9c8f04e08 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:57.345379 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb4f7d-0877-40a3-bea9-5ba9c8f04e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:57.346136 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb4f7d-0877-40a3-bea9-5ba9c8f04e08 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:57.347834 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb4f7d-0877-40a3-bea9-5ba9c8f04e08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:57.348990 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb4f7d-0877-40a3-bea9-5ba9c8f04e08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:57.350651 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb4f7d-0877-40a3-bea9-5ba9c8f04e08 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:57.368538 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 342/673] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:57.368538 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb4f7d-0877-40a3-bea9-5ba9c8f04e08 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:57.416248 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fa0b3-75ec-4cd9-af89-c2b56f58ce12 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:57.434410 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:57.438519 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:57.460386 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c005988-6ebe-46a7-9d96-65518534c8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:57.461340 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c005988-6ebe-46a7-9d96-65518534c8e9 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:57.461919 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c005988-6ebe-46a7-9d96-65518534c8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:57.462271 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c005988-6ebe-46a7-9d96-65518534c8e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:57.462996 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c005988-6ebe-46a7-9d96-65518534c8e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:57.463371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c005988-6ebe-46a7-9d96-65518534c8e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:57.464839 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c005988-6ebe-46a7-9d96-65518534c8e9 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:57.478564 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 332/674] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:57.479901 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c005988-6ebe-46a7-9d96-65518534c8e9 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:57.509655 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb4f7d-0877-40a3-bea9-5ba9c8f04e08 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:57.557945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bdfcc4-5f7e-410c-8815-d3abca931491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:57.559106 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdfcc4-5f7e-410c-8815-d3abca931491 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:57.561359 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdfcc4-5f7e-410c-8815-d3abca931491 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:57.561842 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdfcc4-5f7e-410c-8815-d3abca931491 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:57.577389 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bdfcc4-5f7e-410c-8815-d3abca931491 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:57.578892 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bdfcc4-5f7e-410c-8815-d3abca931491 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:57.593109 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-e2bdfcc4-5f7e-410c-8815-d3abca931491 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:57.593109 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:57.593109 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:57.593109 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:57.593109 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:57.593109 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:57.593109 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:57.593109 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:57.593109 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:57.593109 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:57.593109 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:57.593109 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:57.593109 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:57.593109 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:57.593109 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:57.593109 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:57.594320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:57.594320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:57.594320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:57.594320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:57.594320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:57.594320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:57.594320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:57.594320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:57.594320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:57.594320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:57.594320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:57.594320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:57.594320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:57.594320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:57.594320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:57.594320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:57.594320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:57.595497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:57.595497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:57.595497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:57.595497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 343/675] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:57.595497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bdfcc4-5f7e-410c-8815-d3abca931491 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:57.599041 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c005988-6ebe-46a7-9d96-65518534c8e9 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:57.637490 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f2dab-00ff-4fc8-99e0-5a25ff9f20a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:57.638333 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f2dab-00ff-4fc8-99e0-5a25ff9f20a4 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:57.638707 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f2dab-00ff-4fc8-99e0-5a25ff9f20a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:57.639092 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f2dab-00ff-4fc8-99e0-5a25ff9f20a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:57.646431 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f2dab-00ff-4fc8-99e0-5a25ff9f20a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:57.648147 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f2dab-00ff-4fc8-99e0-5a25ff9f20a4 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:57.660213 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-5c4f2dab-00ff-4fc8-99e0-5a25ff9f20a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:19:57.660213 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:57.660213 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:57.660213 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:57.660213 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:57.660213 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:57.660213 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:57.660213 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:57.660213 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:57.660213 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:57.660213 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:57.660213 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:57.660213 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:19:57.660213 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:19:57.660213 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:19:57.661308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:19:57.661308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:57.661308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:57.661308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:57.661308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:57.661308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:57.661308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:57.661308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:57.661308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:57.661308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:57.661308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:57.661308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:57.661308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:57.661308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:57.661308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:57.661308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:57.661308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:57.662483 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:19:57.662483 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:19:57.662483 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:19:57.662483 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:19:57.662483 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:19:57.662483 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:19:57.662483 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:19:57.662483 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:57.662483 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 333/676] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:19:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:57.663169 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601268e7-8339-4874-8c94-fa80f86ef1da None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:57.663450 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601268e7-8339-4874-8c94-fa80f86ef1da None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:57.663743 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601268e7-8339-4874-8c94-fa80f86ef1da None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:57.665077 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 334/677] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:57.665623 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601268e7-8339-4874-8c94-fa80f86ef1da None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:57.705222 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:57.711798 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:57.716128 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bdfcc4-5f7e-410c-8815-d3abca931491 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:57.751203 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653f2bf-0326-4101-99bc-68f4d0b4458e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:57.751901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653f2bf-0326-4101-99bc-68f4d0b4458e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:57.752299 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653f2bf-0326-4101-99bc-68f4d0b4458e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:57.752729 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653f2bf-0326-4101-99bc-68f4d0b4458e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:57.760218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653f2bf-0326-4101-99bc-68f4d0b4458e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:57.762023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653f2bf-0326-4101-99bc-68f4d0b4458e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:57.773337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-6653f2bf-0326-4101-99bc-68f4d0b4458e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:19:57.773337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:57.773337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:57.773337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:57.773337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:57.773337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:57.773337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:57.773337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:57.773337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:57.773337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:57.773337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:57.773337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:57.773337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:19:57.773337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:19:57.773337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:19:57.774512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:19:57.774512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:57.774512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:57.774512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:57.774512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:57.774512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:57.774512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:57.774512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:57.774512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:57.774512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:57.774512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:57.774512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:57.774512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:57.774512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:57.774512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:57.774512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:57.774512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:57.775642 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:19:57.775642 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:19:57.775642 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:19:57.775642 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:19:57.775642 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:19:57.775642 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:19:57.775642 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:19:57.775642 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:57.781780 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 344/678] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:19:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:57.781916 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601268e7-8339-4874-8c94-fa80f86ef1da None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:57.782008 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653f2bf-0326-4101-99bc-68f4d0b4458e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:57.818340 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bc6ca-78fe-4121-a19b-0e75987f5213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:57.819042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bc6ca-78fe-4121-a19b-0e75987f5213 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:57.819394 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bc6ca-78fe-4121-a19b-0e75987f5213 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:57.819738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bc6ca-78fe-4121-a19b-0e75987f5213 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:57.820455 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131bc6ca-78fe-4121-a19b-0e75987f5213 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:57.820830 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131bc6ca-78fe-4121-a19b-0e75987f5213 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:57.822292 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131bc6ca-78fe-4121-a19b-0e75987f5213 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:57.836930 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 335/679] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:57.837139 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1de32-e504-48ea-be1e-07deeceb647d None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:57.837431 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1de32-e504-48ea-be1e-07deeceb647d None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:57.837709 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1de32-e504-48ea-be1e-07deeceb647d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:57.857557 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-35f1de32-e504-48ea-be1e-07deeceb647d None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:57.858800 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-35f1de32-e504-48ea-be1e-07deeceb647d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:57.890232 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653f2bf-0326-4101-99bc-68f4d0b4458e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:57.928675 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7e2a3-4b13-42de-8a73-8715ced1c6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:57.929618 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7e2a3-4b13-42de-8a73-8715ced1c6cc None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:57.929927 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7e2a3-4b13-42de-8a73-8715ced1c6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:57.933789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7e2a3-4b13-42de-8a73-8715ced1c6cc None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:57.933921 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 336/680] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:57.934003 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7e2a3-4b13-42de-8a73-8715ced1c6cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:57.934076 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1de32-e504-48ea-be1e-07deeceb647d None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:57.934168 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7e2a3-4b13-42de-8a73-8715ced1c6cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:57.934168 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7e2a3-4b13-42de-8a73-8715ced1c6cc None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:57.953912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 345/681] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:19:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:57.955150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7e2a3-4b13-42de-8a73-8715ced1c6cc None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:57.971226 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:57.981258 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:58.074595 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1de32-e504-48ea-be1e-07deeceb647d None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:58.089663 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7e2a3-4b13-42de-8a73-8715ced1c6cc None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:58.116630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e11fa7-37a9-43ac-a749-d2fb38a4b606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:58.117551 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e11fa7-37a9-43ac-a749-d2fb38a4b606 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:58.117928 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e11fa7-37a9-43ac-a749-d2fb38a4b606 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:58.118266 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e11fa7-37a9-43ac-a749-d2fb38a4b606 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:58.119436 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e11fa7-37a9-43ac-a749-d2fb38a4b606 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:58.119808 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e11fa7-37a9-43ac-a749-d2fb38a4b606 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:58.122027 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e11fa7-37a9-43ac-a749-d2fb38a4b606 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:58.127294 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2588c15-f4d6-4c33-adc8-a72c91edf964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:58.128833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2588c15-f4d6-4c33-adc8-a72c91edf964 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:58.129315 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2588c15-f4d6-4c33-adc8-a72c91edf964 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:58.129812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2588c15-f4d6-4c33-adc8-a72c91edf964 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:58.136927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 337/682] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:19:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:58.138621 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e11fa7-37a9-43ac-a749-d2fb38a4b606 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:58.138902 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2588c15-f4d6-4c33-adc8-a72c91edf964 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:58.140830 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2588c15-f4d6-4c33-adc8-a72c91edf964 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:58.153056 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-a2588c15-f4d6-4c33-adc8-a72c91edf964 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 14:19:58.153056 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:58.153056 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:58.153056 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:58.153056 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:58.153056 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:58.153056 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:58.153056 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:58.153056 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:58.153056 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:58.153056 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:58.153056 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:58.153056 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:19:58.153056 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:19:58.153056 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:19:58.153056 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:19:58.154789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:58.154789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:58.154789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:19:58.154789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:58.154789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:19:58.154789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:58.154789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:58.154789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:58.154789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:58.154789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:58.154789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:58.154789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:58.154789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:58.154789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:58.154789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:58.154789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:58.154789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:58.154789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:58.155767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:58.155767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:58.155767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:19:58.155767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:19:58.155767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:19:58.155767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:19:58.155767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:19:58.155767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:19:58.155767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 14:19:58.155767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:58.161855 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 346/683] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:19:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:58.162906 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2588c15-f4d6-4c33-adc8-a72c91edf964 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:58.243972 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:58.249601 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:58.263639 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e11fa7-37a9-43ac-a749-d2fb38a4b606 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:58.277667 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2588c15-f4d6-4c33-adc8-a72c91edf964 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:58.300451 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0a7b2-2995-4e86-abd6-ae8e541f108b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:58.301134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0a7b2-2995-4e86-abd6-ae8e541f108b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:58.301504 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0a7b2-2995-4e86-abd6-ae8e541f108b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:58.301883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0a7b2-2995-4e86-abd6-ae8e541f108b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:58.302671 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0a7b2-2995-4e86-abd6-ae8e541f108b None admin] RBAC: Adding query filter params (role.id=0df7ee13692d4eb5a741a8b79fd58d58, scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e, user.id=d03ddcf4bcc24f86be508345ad63ab5f) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:58.302983 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0a7b2-2995-4e86-abd6-ae8e541f108b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:58.304410 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0a7b2-2995-4e86-abd6-ae8e541f108b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:58.311262 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 338/684] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:19:58 2022] GET /identity/v3/role_assignments?user.id=d03ddcf4bcc24f86be508345ad63ab5f&scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e&role.id=0df7ee13692d4eb5a741a8b79fd58d58 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:58.312052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0a7b2-2995-4e86-abd6-ae8e541f108b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:58.324435 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af276c91-f19c-4d00-a27e-3049a54238fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:58.325816 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af276c91-f19c-4d00-a27e-3049a54238fa None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:58.326272 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af276c91-f19c-4d00-a27e-3049a54238fa None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:58.326542 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af276c91-f19c-4d00-a27e-3049a54238fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:58.327300 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af276c91-f19c-4d00-a27e-3049a54238fa None admin] RBAC: Adding query filter params (role.id=0df7ee13692d4eb5a741a8b79fd58d58, scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e, user.id=cb5021b569db41a08218cbec928442af) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:58.327607 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af276c91-f19c-4d00-a27e-3049a54238fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:58.329101 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af276c91-f19c-4d00-a27e-3049a54238fa None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:58.336160 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 347/685] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:19:58 2022] GET /identity/v3/role_assignments?user.id=cb5021b569db41a08218cbec928442af&scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e&role.id=0df7ee13692d4eb5a741a8b79fd58d58 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:58.337179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af276c91-f19c-4d00-a27e-3049a54238fa None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:58.536063 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af276c91-f19c-4d00-a27e-3049a54238fa None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:58.545191 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0a7b2-2995-4e86-abd6-ae8e541f108b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:58.580996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a209f6-3866-4734-b531-d6ba0ca7e634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:58.581556 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a209f6-3866-4734-b531-d6ba0ca7e634 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:58.581863 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a209f6-3866-4734-b531-d6ba0ca7e634 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:58.582132 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a209f6-3866-4734-b531-d6ba0ca7e634 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:58.599289 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921da91-dd54-4b92-ab0a-4e78f2a2cdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:58.599900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921da91-dd54-4b92-ab0a-4e78f2a2cdb8 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:58.600177 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921da91-dd54-4b92-ab0a-4e78f2a2cdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:58.600447 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921da91-dd54-4b92-ab0a-4e78f2a2cdb8 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:58.601180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921da91-dd54-4b92-ab0a-4e78f2a2cdb8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:58.601485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921da91-dd54-4b92-ab0a-4e78f2a2cdb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:58.602612 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a209f6-3866-4734-b531-d6ba0ca7e634 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:19:58.602934 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921da91-dd54-4b92-ab0a-4e78f2a2cdb8 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:58.610388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-f8a209f6-3866-4734-b531-d6ba0ca7e634 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:19:58.610388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:58.610388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:58.610388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:58.610388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:58.610388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:58.610388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:58.610388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:58.610388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:58.610388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:58.610388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:58.610388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:58.610388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:19:58.610388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:19:58.610388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:19:58.610388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:19:58.611419 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:19:58.611419 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:19:58.611419 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:19:58.611419 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:19:58.611419 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:58.611419 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:58.611419 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:58.611419 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:58.611419 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:58.611419 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:58.611419 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:58.611419 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:58.611419 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:58.611419 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:58.611419 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:58.611419 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:58.612865 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:58.612865 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:58.612865 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:58.612865 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:58.612865 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:19:58.612865 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:19:58.612865 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:19:58.612865 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:19:58.612865 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:19:58.612865 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:19:58.612865 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:19:58.612865 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:58.612865 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 348/686] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:19:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:58.620812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a209f6-3866-4734-b531-d6ba0ca7e634 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:58.624171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 339/687] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Aug 24 14:19:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:58.624526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:58.630084 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921da91-dd54-4b92-ab0a-4e78f2a2cdb8 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:58.643982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:58.756539 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a209f6-3866-4734-b531-d6ba0ca7e634 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:58.802658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246bc21-7900-489d-93a0-07dcc685b37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:58.803367 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246bc21-7900-489d-93a0-07dcc685b37b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:58.804329 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246bc21-7900-489d-93a0-07dcc685b37b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:58.804824 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246bc21-7900-489d-93a0-07dcc685b37b None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:58.806760 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246bc21-7900-489d-93a0-07dcc685b37b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:58.807399 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246bc21-7900-489d-93a0-07dcc685b37b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:58.810742 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246bc21-7900-489d-93a0-07dcc685b37b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:58.819746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921da91-dd54-4b92-ab0a-4e78f2a2cdb8 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:58.830676 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 349/688] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:19:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:19:58.836938 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246bc21-7900-489d-93a0-07dcc685b37b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:58.876593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7312b-6545-48fb-8f58-49b2073018b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:58.877383 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7312b-6545-48fb-8f58-49b2073018b9 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:58.877734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7312b-6545-48fb-8f58-49b2073018b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:58.878257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7312b-6545-48fb-8f58-49b2073018b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:58.974235 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7312b-6545-48fb-8f58-49b2073018b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:58.975715 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7312b-6545-48fb-8f58-49b2073018b9 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:58.987054 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:58.989019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:59.062089 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246bc21-7900-489d-93a0-07dcc685b37b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:59.122609 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da35bd7-f771-40fd-bd6a-ed6e34a9130f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:59.123505 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da35bd7-f771-40fd-bd6a-ed6e34a9130f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:59.123938 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da35bd7-f771-40fd-bd6a-ed6e34a9130f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:59.124418 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da35bd7-f771-40fd-bd6a-ed6e34a9130f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:59.146715 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 340/689] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:19:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:19:59.147964 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7312b-6545-48fb-8f58-49b2073018b9 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:59.149084 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da35bd7-f771-40fd-bd6a-ed6e34a9130f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:59.151277 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da35bd7-f771-40fd-bd6a-ed6e34a9130f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:59.180904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-6da35bd7-f771-40fd-bd6a-ed6e34a9130f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:59.180904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:59.180904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:59.180904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:59.180904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:59.180904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:59.180904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:59.180904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:59.180904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:59.180904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:59.180904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:59.180904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:59.180904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:59.180904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:59.180904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:59.180904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:59.182182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:59.182182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:59.182182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:59.182182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:59.182182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:59.182182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:59.182182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:59.182182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:59.182182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:59.182182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:59.182182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:59.182182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:59.182182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:59.182182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:59.182182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:59.182182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:59.182182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:59.183260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:59.183260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:59.183260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:59.185625 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 350/690] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:59.202035 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da35bd7-f771-40fd-bd6a-ed6e34a9130f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:59.273078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7312b-6545-48fb-8f58-49b2073018b9 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:59.284018 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:59.309927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c601c1-dc9f-42d9-bdf5-30921018e89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:59.310909 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c601c1-dc9f-42d9-bdf5-30921018e89c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:59.311411 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c601c1-dc9f-42d9-bdf5-30921018e89c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:59.311949 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c601c1-dc9f-42d9-bdf5-30921018e89c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:59.322988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c601c1-dc9f-42d9-bdf5-30921018e89c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:59.324712 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c601c1-dc9f-42d9-bdf5-30921018e89c None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:59.340900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-f2c601c1-dc9f-42d9-bdf5-30921018e89c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:59.340900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:59.340900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:59.340900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:59.340900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:59.340900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:59.340900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:59.340900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:59.340900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:59.340900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:59.340900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:59.340900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:59.340900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:19:59.340900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:19:59.340900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:19:59.340900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:19:59.341892 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:59.341892 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:59.341892 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:59.341892 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:59.341892 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:59.341892 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:59.341892 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:59.341892 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:59.341892 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:59.341892 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:59.341892 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:59.341892 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:59.341892 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:59.341892 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:59.341892 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:59.341892 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:59.341892 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:19:59.342813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:19:59.342813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:19:59.342813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:59.349212 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 341/691] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:59.350646 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c601c1-dc9f-42d9-bdf5-30921018e89c None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:59.393702 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da35bd7-f771-40fd-bd6a-ed6e34a9130f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:59.419668 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:59.459145 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b289f-4d64-4705-b771-e60ed7c13ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:59.460007 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b289f-4d64-4705-b771-e60ed7c13ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:59.460204 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b289f-4d64-4705-b771-e60ed7c13ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:59.460429 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b289f-4d64-4705-b771-e60ed7c13ce3 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:59.461079 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b289f-4d64-4705-b771-e60ed7c13ce3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:59.461392 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b289f-4d64-4705-b771-e60ed7c13ce3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:59.463172 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b289f-4d64-4705-b771-e60ed7c13ce3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:59.464580 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c601c1-dc9f-42d9-bdf5-30921018e89c None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:59.496265 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 351/692] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:59.507949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b289f-4d64-4705-b771-e60ed7c13ce3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:59.519833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3214b-e8ae-4b1e-927c-13636b63af5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:59.524503 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3214b-e8ae-4b1e-927c-13636b63af5d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:59.525011 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3214b-e8ae-4b1e-927c-13636b63af5d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:59.525453 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3214b-e8ae-4b1e-927c-13636b63af5d None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:59.526368 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3214b-e8ae-4b1e-927c-13636b63af5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:59.526952 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3214b-e8ae-4b1e-927c-13636b63af5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:59.529483 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3214b-e8ae-4b1e-927c-13636b63af5d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:59.554391 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 342/693] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:19:59.571389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3214b-e8ae-4b1e-927c-13636b63af5d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:59.603295 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:59.693390 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b289f-4d64-4705-b771-e60ed7c13ce3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:59.715001 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3214b-e8ae-4b1e-927c-13636b63af5d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:59.759255 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce0ed2-87ba-4e60-8f0d-450bd5a0529f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:59.759914 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce0ed2-87ba-4e60-8f0d-450bd5a0529f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:59.760194 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce0ed2-87ba-4e60-8f0d-450bd5a0529f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:59.760461 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce0ed2-87ba-4e60-8f0d-450bd5a0529f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:59.771736 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce0ed2-87ba-4e60-8f0d-450bd5a0529f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:59.773186 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce0ed2-87ba-4e60-8f0d-450bd5a0529f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:59.781258 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc829062-d61f-441d-bc01-8b850c2c33fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:59.782486 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc829062-d61f-441d-bc01-8b850c2c33fe None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:59.782997 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc829062-d61f-441d-bc01-8b850c2c33fe None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:59.783472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc829062-d61f-441d-bc01-8b850c2c33fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:59.788788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-a3ce0ed2-87ba-4e60-8f0d-450bd5a0529f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:19:59.788788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:59.788788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:59.788788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:59.788788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:59.788788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:59.788788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:59.788788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:59.788788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:59.788788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:59.788788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:59.788788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:59.788788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:19:59.788788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:19:59.788788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:19:59.788788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:19:59.789812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:59.789812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:59.789812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:19:59.789812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:59.789812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:19:59.789812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:19:59.789812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:59.789812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:59.789812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:59.789812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:59.789812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:59.789812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:59.789812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:59.789812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:59.789812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:59.789812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:59.789812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:59.789812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:59.790799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:59.790799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:59.790799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:19:59.790799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:19:59.790799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:19:59.790799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:19:59.790799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:19:59.790799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:19:59.790799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:19:59.790799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:19:59.795413 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 352/694] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Aug 24 14:19:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:19:59.796010 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc829062-d61f-441d-bc01-8b850c2c33fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:19:59.796663 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcd99f-406e-4a1e-8d1c-584315daf9f9 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:59.796947 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcd99f-406e-4a1e-8d1c-584315daf9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:59.797216 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcd99f-406e-4a1e-8d1c-584315daf9f9 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:59.798482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc829062-d61f-441d-bc01-8b850c2c33fe None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:19:59.798781 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 353/695] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:19:59.799510 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcd99f-406e-4a1e-8d1c-584315daf9f9 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:59.813834 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-fc829062-d61f-441d-bc01-8b850c2c33fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:19:59.813834 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:19:59.813834 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:19:59.813834 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:19:59.813834 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:19:59.813834 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:19:59.813834 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:19:59.813834 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:19:59.813834 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:19:59.813834 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:19:59.813834 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:19:59.813834 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:19:59.813834 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:19:59.813834 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:19:59.813834 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:19:59.814804 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:19:59.814804 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:19:59.814804 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:19:59.814804 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:19:59.814804 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:19:59.814804 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:19:59.814804 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:19:59.814804 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:19:59.814804 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:19:59.814804 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:19:59.814804 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:19:59.814804 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:19:59.814804 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:19:59.814804 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:19:59.814804 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:19:59.814804 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:19:59.814804 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:19:59.815686 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:19:59.815686 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:19:59.815686 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:19:59.815686 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:19:59.815686 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:19:59.815686 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:19:59.815686 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:19:59.815686 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:19:59.822703 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 343/696] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:19:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:19:59.824435 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af011ff6-044d-4984-bc1e-a9c92c4c1610 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:59.824984 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af011ff6-044d-4984-bc1e-a9c92c4c1610 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:59.825479 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af011ff6-044d-4984-bc1e-a9c92c4c1610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:59.842093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:59.847730 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-af011ff6-044d-4984-bc1e-a9c92c4c1610 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:19:59.849211 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-af011ff6-044d-4984-bc1e-a9c92c4c1610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:19:59.914488 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcd99f-406e-4a1e-8d1c-584315daf9f9 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:19:59.926409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 344/697] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:19:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:19:59.927950 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af011ff6-044d-4984-bc1e-a9c92c4c1610 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:19:59.941308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:19:59.995448 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2632a-0c62-45e4-bc82-93e2b17ad555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:19:59.995976 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2632a-0c62-45e4-bc82-93e2b17ad555 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:19:59.996256 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2632a-0c62-45e4-bc82-93e2b17ad555 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:19:59.996524 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2632a-0c62-45e4-bc82-93e2b17ad555 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:19:59.997301 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2632a-0c62-45e4-bc82-93e2b17ad555 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:19:59.997660 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2632a-0c62-45e4-bc82-93e2b17ad555 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:00.003349 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2632a-0c62-45e4-bc82-93e2b17ad555 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:00.043360 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 354/698] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Aug 24 14:19:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:00.045314 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2632a-0c62-45e4-bc82-93e2b17ad555 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:00.063052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af011ff6-044d-4984-bc1e-a9c92c4c1610 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:00.129119 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce95d4-ae94-43ba-b101-ae88f2a93ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:00.130140 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce95d4-ae94-43ba-b101-ae88f2a93ebd None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:00.130627 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce95d4-ae94-43ba-b101-ae88f2a93ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:00.131140 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce95d4-ae94-43ba-b101-ae88f2a93ebd None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:00.132154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce95d4-ae94-43ba-b101-ae88f2a93ebd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:00.132720 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce95d4-ae94-43ba-b101-ae88f2a93ebd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:00.134483 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce95d4-ae94-43ba-b101-ae88f2a93ebd None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:00.156805 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 345/699] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:19:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:00.158787 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce95d4-ae94-43ba-b101-ae88f2a93ebd None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:00.171917 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:00.189032 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2632a-0c62-45e4-bc82-93e2b17ad555 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:00.238659 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:00.287558 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce95d4-ae94-43ba-b101-ae88f2a93ebd None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:00.307137 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f42b4-f767-43d2-88b3-93367136cb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:00.307611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f42b4-f767-43d2-88b3-93367136cb43 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:00.307893 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f42b4-f767-43d2-88b3-93367136cb43 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:00.308163 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f42b4-f767-43d2-88b3-93367136cb43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:00.337673 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16126c-5510-4c7d-bcdd-7c0507752fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:00.338686 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16126c-5510-4c7d-bcdd-7c0507752fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:00.339184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16126c-5510-4c7d-bcdd-7c0507752fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:00.339684 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16126c-5510-4c7d-bcdd-7c0507752fc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:00.340896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16126c-5510-4c7d-bcdd-7c0507752fc3 None admin] RBAC: Adding query filter params (role.id=0df7ee13692d4eb5a741a8b79fd58d58, scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e, user.id=6b3c32ecfdcf40629f09a7f52b2b5fa8) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:00.341542 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16126c-5510-4c7d-bcdd-7c0507752fc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:00.343329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16126c-5510-4c7d-bcdd-7c0507752fc3 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:00.363656 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 346/700] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:20:00 2022] GET /identity/v3/role_assignments?user.id=6b3c32ecfdcf40629f09a7f52b2b5fa8&scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e&role.id=0df7ee13692d4eb5a741a8b79fd58d58 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:00.443839 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16126c-5510-4c7d-bcdd-7c0507752fc3 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:00.491641 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f42b4-f767-43d2-88b3-93367136cb43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:00.493236 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f42b4-f767-43d2-88b3-93367136cb43 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:00.653785 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16126c-5510-4c7d-bcdd-7c0507752fc3 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:00.666539 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:00.675317 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 355/701] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:20:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:20:00.676594 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9a9d8-b8db-4229-b646-6833d10bf03a None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:00.679713 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9a9d8-b8db-4229-b646-6833d10bf03a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:00.679713 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9a9d8-b8db-4229-b646-6833d10bf03a None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:00.679713 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 356/702] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:00.683343 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9a9d8-b8db-4229-b646-6833d10bf03a None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:00.699137 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34132a3f-a972-4e1a-84ef-bb9a77a36646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:00.699774 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34132a3f-a972-4e1a-84ef-bb9a77a36646 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:00.700132 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34132a3f-a972-4e1a-84ef-bb9a77a36646 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:00.700400 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34132a3f-a972-4e1a-84ef-bb9a77a36646 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:00.702578 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:00.712641 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34132a3f-a972-4e1a-84ef-bb9a77a36646 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:00.714371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34132a3f-a972-4e1a-84ef-bb9a77a36646 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:00.729180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-34132a3f-a972-4e1a-84ef-bb9a77a36646 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:00.729180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:00.729180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:00.729180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:00.729180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:00.729180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:00.729180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:00.729180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:00.729180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:00.729180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:00.729180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:00.729180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:00.729180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:00.729180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:00.729180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:00.729180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:00.730401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:00.730401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:00.730401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:00.730401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:00.730401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:00.730401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:00.730401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:00.730401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:00.730401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:00.730401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:00.730401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:00.730401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:00.730401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:00.730401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:00.730401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:00.730401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:00.730401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:00.731679 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:00.731679 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:00.731679 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:00.733903 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 347/703] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:00.736069 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c53831-1bbf-42a4-a9c1-5b06aeada3f3 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:00.736543 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c53831-1bbf-42a4-a9c1-5b06aeada3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:00.736783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c53831-1bbf-42a4-a9c1-5b06aeada3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:00.756818 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a9c53831-1bbf-42a4-a9c1-5b06aeada3f3 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:00.758054 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a9c53831-1bbf-42a4-a9c1-5b06aeada3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:00.801574 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9a9d8-b8db-4229-b646-6833d10bf03a None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:00.837773 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 348/704] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:20:00.837773 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa8368-188f-4df9-82f6-2ea12c74d545 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:00.837773 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa8368-188f-4df9-82f6-2ea12c74d545 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:00.837773 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa8368-188f-4df9-82f6-2ea12c74d545 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:00.837773 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 349/705] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:00.837773 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa8368-188f-4df9-82f6-2ea12c74d545 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:00.848336 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0ee27-282e-48d9-b922-949a6f114679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:00.849088 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0ee27-282e-48d9-b922-949a6f114679 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:00.849438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0ee27-282e-48d9-b922-949a6f114679 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:00.849703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0ee27-282e-48d9-b922-949a6f114679 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:00.861066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0ee27-282e-48d9-b922-949a6f114679 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:00.862963 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0ee27-282e-48d9-b922-949a6f114679 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:00.879608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-00a0ee27-282e-48d9-b922-949a6f114679 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:00.879608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:00.879608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:00.879608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:00.879608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:00.879608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:00.879608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:00.879608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:00.879608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:00.879608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:00.879608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:00.879608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:00.879608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:00.879608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:00.879608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:00.879608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:00.880637 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:00.880637 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:00.880637 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:00.880637 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:00.880637 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:00.880637 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:00.880637 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:00.880637 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:00.880637 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:00.880637 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:00.880637 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:00.880637 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:00.880637 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:00.880637 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:00.880637 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:00.880637 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:00.880637 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:00.881581 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:00.881581 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:00.881581 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:00.881581 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 357/706] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:00.882259 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b919617-5a96-453b-8420-b8e117625911 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:00.882259 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b919617-5a96-453b-8420-b8e117625911 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:00.882455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b919617-5a96-453b-8420-b8e117625911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:00.901200 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-0b919617-5a96-453b-8420-b8e117625911 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:00.902634 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0b919617-5a96-453b-8420-b8e117625911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:00.950523 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:00.974841 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa8368-188f-4df9-82f6-2ea12c74d545 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:00.986649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 358/707] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:20:00.986649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b919617-5a96-453b-8420-b8e117625911 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:01.013663 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:01.051864 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fce19-27de-4036-8aaf-6c079c120720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:01.052502 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fce19-27de-4036-8aaf-6c079c120720 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:01.052786 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fce19-27de-4036-8aaf-6c079c120720 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:01.053059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fce19-27de-4036-8aaf-6c079c120720 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:01.053714 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4fce19-27de-4036-8aaf-6c079c120720 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:01.054039 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4fce19-27de-4036-8aaf-6c079c120720 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:01.055415 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4fce19-27de-4036-8aaf-6c079c120720 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:01.080340 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 350/708] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:01.083351 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fce19-27de-4036-8aaf-6c079c120720 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:01.146885 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b919617-5a96-453b-8420-b8e117625911 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:01.196682 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cf9ca-9741-4703-9ce6-b953e1a832bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:01.197861 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cf9ca-9741-4703-9ce6-b953e1a832bd None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:01.198144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cf9ca-9741-4703-9ce6-b953e1a832bd None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:01.198416 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cf9ca-9741-4703-9ce6-b953e1a832bd None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:01.200464 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2cf9ca-9741-4703-9ce6-b953e1a832bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:01.200842 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2cf9ca-9741-4703-9ce6-b953e1a832bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:01.202735 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2cf9ca-9741-4703-9ce6-b953e1a832bd None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:01.221854 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 359/709] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:01.222767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cf9ca-9741-4703-9ce6-b953e1a832bd None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:01.235811 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fce19-27de-4036-8aaf-6c079c120720 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:01.271856 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550dad7-989c-419c-852f-894234439299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:01.272756 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550dad7-989c-419c-852f-894234439299 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:01.272869 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550dad7-989c-419c-852f-894234439299 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:01.273080 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550dad7-989c-419c-852f-894234439299 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:01.273719 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550dad7-989c-419c-852f-894234439299 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:01.275167 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550dad7-989c-419c-852f-894234439299 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:01.281514 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:01.346646 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cf9ca-9741-4703-9ce6-b953e1a832bd None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:01.354179 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 351/710] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 14:20:01 2022] POST /identity/v3/users => generated 254 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:20:01.355279 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550dad7-989c-419c-852f-894234439299 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:01.388772 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b96380-37f9-4d03-a9c4-80b3fd10b131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:01.391134 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b96380-37f9-4d03-a9c4-80b3fd10b131 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:01.391615 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b96380-37f9-4d03-a9c4-80b3fd10b131 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:01.392900 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b96380-37f9-4d03-a9c4-80b3fd10b131 None admin] PATH_INFO: `/v3/services/network` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:01.393735 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b96380-37f9-4d03-a9c4-80b3fd10b131 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:01.395349 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b96380-37f9-4d03-a9c4-80b3fd10b131 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:01.401627 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:01.408045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-e5b96380-37f9-4d03-a9c4-80b3fd10b131 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 14:20:01.408045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:01.408045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:20:01.408045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:20:01.408045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:20:01.408045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:20:01.408045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:20:01.408045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:01.408045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 14:20:01.408045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:01.408045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:20:01.408045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:01.408045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:01.408045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:01.408045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:01.408045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:01.408045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:01.414767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:01.414767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:01.414767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:01.414767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:01.414767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:01.414767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:01.414767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:20:01.414767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:20:01.414767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:20:01.414767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:20:01.414767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:01.414767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:01.414767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:01.414767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:01.414767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:01.414767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:01.415652 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:01.415652 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:01.415652 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:01.415652 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:01.415652 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:01.415652 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:01.415652 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:01.415652 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:01.415652 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:01.415652 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:01.415652 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:20:01.415652 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:01.415652 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 14:20:01.415652 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:01.415652 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 360/711] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:20:01 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:01.416487 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b96380-37f9-4d03-a9c4-80b3fd10b131 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:01.488216 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550dad7-989c-419c-852f-894234439299 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:01.526228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b96380-37f9-4d03-a9c4-80b3fd10b131 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:01.527909 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:01.531779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844dac1a-9aa9-40e9-8247-e9c42f3fe2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:01.532423 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844dac1a-9aa9-40e9-8247-e9c42f3fe2af None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:01.532755 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844dac1a-9aa9-40e9-8247-e9c42f3fe2af None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:01.533214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844dac1a-9aa9-40e9-8247-e9c42f3fe2af None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:01.542498 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844dac1a-9aa9-40e9-8247-e9c42f3fe2af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:01.544169 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844dac1a-9aa9-40e9-8247-e9c42f3fe2af None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:01.557106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-844dac1a-9aa9-40e9-8247-e9c42f3fe2af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:01.557106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:01.557106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:01.557106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:01.557106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:01.557106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:01.557106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:01.557106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:01.557106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:01.557106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:01.557106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:01.557106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:01.557106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:20:01.557106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:20:01.557106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:20:01.558093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:20:01.558093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:01.558093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:01.558093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:01.558093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:01.558093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:01.558093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:01.558093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:01.558093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:01.558093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:01.558093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:01.558093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:01.558093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:01.558093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:01.558093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:01.558093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:01.558093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:01.558987 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:20:01.558987 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:20:01.558987 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:20:01.558987 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:20:01.558987 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:20:01.558987 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:20:01.558987 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:01.558987 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:01.558987 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 352/712] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:20:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:01.560219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844dac1a-9aa9-40e9-8247-e9c42f3fe2af None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:01.578865 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad1cdf-b7a2-477b-8d27-2e1753d87620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:01.579510 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad1cdf-b7a2-477b-8d27-2e1753d87620 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:01.579871 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad1cdf-b7a2-477b-8d27-2e1753d87620 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:01.580113 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad1cdf-b7a2-477b-8d27-2e1753d87620 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:01.580709 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad1cdf-b7a2-477b-8d27-2e1753d87620 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:01.582107 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad1cdf-b7a2-477b-8d27-2e1753d87620 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:01.592210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-ddad1cdf-b7a2-477b-8d27-2e1753d87620 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 14:20:01.592210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:01.592210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:20:01.592210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:20:01.592210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:20:01.592210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:20:01.592210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:20:01.592210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:01.592210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 14:20:01.592210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:01.592210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:20:01.592210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:01.592210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:01.592210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:01.592210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:01.592210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:01.592210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:01.593532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:01.593532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:01.593532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:01.593532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:01.593532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:01.593532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:01.593532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:20:01.593532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:20:01.593532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:20:01.593532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:20:01.593532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:01.593532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:01.593532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:01.593532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:01.593532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:01.593532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:01.594605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:01.594605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:01.594605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:01.594605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:01.594605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:01.594605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:01.594605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:01.594605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:01.594605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:01.594605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:01.594605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:20:01.594605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:01.594605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 14:20:01.594605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:01.594605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 361/713] 10.222.0.65 () {56 vars in 1129 bytes} [Wed Aug 24 14:20:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:01.595526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad1cdf-b7a2-477b-8d27-2e1753d87620 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:01.684090 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:01.693471 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844dac1a-9aa9-40e9-8247-e9c42f3fe2af None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:01.712073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad1cdf-b7a2-477b-8d27-2e1753d87620 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:01.729805 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af14966-ba3e-4566-840e-87404777ba29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:01.730568 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af14966-ba3e-4566-840e-87404777ba29 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:01.730938 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af14966-ba3e-4566-840e-87404777ba29 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:01.732026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af14966-ba3e-4566-840e-87404777ba29 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:01.732765 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af14966-ba3e-4566-840e-87404777ba29 None admin] RBAC: Adding query filter params (name=network) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:01.733144 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af14966-ba3e-4566-840e-87404777ba29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:01.734612 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af14966-ba3e-4566-840e-87404777ba29 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:01.744140 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 353/714] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 14:20:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:01.745040 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af14966-ba3e-4566-840e-87404777ba29 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:01.754677 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd2099-48dc-4128-bcf0-f313fb24dbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:01.755293 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd2099-48dc-4128-bcf0-f313fb24dbfd None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:01.755572 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd2099-48dc-4128-bcf0-f313fb24dbfd None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:01.756474 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd2099-48dc-4128-bcf0-f313fb24dbfd None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:01.757208 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd2099-48dc-4128-bcf0-f313fb24dbfd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:01.757520 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd2099-48dc-4128-bcf0-f313fb24dbfd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:01.759448 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd2099-48dc-4128-bcf0-f313fb24dbfd None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:01.775929 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 362/715] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:20:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:01.776778 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd2099-48dc-4128-bcf0-f313fb24dbfd None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:01.869494 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af14966-ba3e-4566-840e-87404777ba29 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:01.890569 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd2099-48dc-4128-bcf0-f313fb24dbfd None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:01.906199 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:01.918368 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95fb8c-7fe4-4a6e-8f76-d04eba05a135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:01.932584 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95fb8c-7fe4-4a6e-8f76-d04eba05a135 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:01.932584 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95fb8c-7fe4-4a6e-8f76-d04eba05a135 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:01.932584 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95fb8c-7fe4-4a6e-8f76-d04eba05a135 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:01.932584 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95fb8c-7fe4-4a6e-8f76-d04eba05a135 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:01.932584 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95fb8c-7fe4-4a6e-8f76-d04eba05a135 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:01.932584 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95fb8c-7fe4-4a6e-8f76-d04eba05a135 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:01.933048 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8247a98e-0673-4193-b8c6-8d9c19f45d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:01.933048 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247a98e-0673-4193-b8c6-8d9c19f45d0a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:01.933048 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247a98e-0673-4193-b8c6-8d9c19f45d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:01.933048 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247a98e-0673-4193-b8c6-8d9c19f45d0a None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:01.933322 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 354/716] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Aug 24 14:20:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:01.933402 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8247a98e-0673-4193-b8c6-8d9c19f45d0a None admin] RBAC: Adding query filter params (type=network) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:01.933402 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8247a98e-0673-4193-b8c6-8d9c19f45d0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:01.933526 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95fb8c-7fe4-4a6e-8f76-d04eba05a135 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:01.933594 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8247a98e-0673-4193-b8c6-8d9c19f45d0a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:01.940555 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 363/717] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 14:20:01 2022] GET /identity/v3/services?type=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:01.941679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8247a98e-0673-4193-b8c6-8d9c19f45d0a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:01.960089 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:02.123709 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:02.133446 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95fb8c-7fe4-4a6e-8f76-d04eba05a135 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:02.138966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8247a98e-0673-4193-b8c6-8d9c19f45d0a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:02.175381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b40fe-ded4-45fd-aa4d-81be0338cf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:02.175618 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b40fe-ded4-45fd-aa4d-81be0338cf2e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:02.175859 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b40fe-ded4-45fd-aa4d-81be0338cf2e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:02.176118 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b40fe-ded4-45fd-aa4d-81be0338cf2e None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:02.176855 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b40fe-ded4-45fd-aa4d-81be0338cf2e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:02.177162 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b40fe-ded4-45fd-aa4d-81be0338cf2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:02.178365 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804754f-d115-48de-91e7-21303c2cfa79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:02.178720 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b40fe-ded4-45fd-aa4d-81be0338cf2e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:02.179416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804754f-d115-48de-91e7-21303c2cfa79 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:02.180003 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804754f-d115-48de-91e7-21303c2cfa79 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:02.180488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804754f-d115-48de-91e7-21303c2cfa79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:02.181486 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804754f-d115-48de-91e7-21303c2cfa79 None admin] RBAC: Adding query filter params (role.id=b779073cee3c470ca4ad7a7b27d72c5e, scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e, user.id=8d099678d6454f7eb494892a69feaf62) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:02.182061 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804754f-d115-48de-91e7-21303c2cfa79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:02.183621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 364/718] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Aug 24 14:20:01 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:02.183871 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804754f-d115-48de-91e7-21303c2cfa79 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:02.191605 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 355/719] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:20:01 2022] GET /identity/v3/role_assignments?user.id=8d099678d6454f7eb494892a69feaf62&scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e&role.id=b779073cee3c470ca4ad7a7b27d72c5e => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:02.553437 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8b19a-321a-4868-9df1-fd3d903bce08 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:02.553975 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8b19a-321a-4868-9df1-fd3d903bce08 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:02.553975 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8b19a-321a-4868-9df1-fd3d903bce08 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:02.555553 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 365/720] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:02.561867 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c46b0-370c-4599-be32-37ea50f9cfed None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:02.562405 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c46b0-370c-4599-be32-37ea50f9cfed None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:02.562889 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c46b0-370c-4599-be32-37ea50f9cfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:02.588640 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-1f4c46b0-370c-4599-be32-37ea50f9cfed None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:02.590204 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1f4c46b0-370c-4599-be32-37ea50f9cfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:02.679875 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 356/721] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:20:03.131919 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8b19a-321a-4868-9df1-fd3d903bce08 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:03.287438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8b19a-321a-4868-9df1-fd3d903bce08 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:03.335789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b61e64-98fc-4446-9186-29caa251e0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:03.336420 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b61e64-98fc-4446-9186-29caa251e0a1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:03.336697 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b61e64-98fc-4446-9186-29caa251e0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:03.336970 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b61e64-98fc-4446-9186-29caa251e0a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:03.351524 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b61e64-98fc-4446-9186-29caa251e0a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:20:03.356912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-c8b61e64-98fc-4446-9186-29caa251e0a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:20:03.356912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:03.356912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:03.356912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:03.356912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:03.356912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:03.356912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:03.356912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:03.356912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:03.356912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:03.356912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:03.356912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:03.356912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:20:03.356912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:20:03.356912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:20:03.356912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:20:03.357879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:20:03.357879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:20:03.357879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:20:03.357879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:20:03.357879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:03.357879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:03.357879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:03.357879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:03.357879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:03.357879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:03.357879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:03.357879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:03.357879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:03.357879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:03.357879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:03.357879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:03.358725 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:03.358725 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:03.358725 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:03.358725 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:03.358725 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:20:03.358725 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:20:03.358725 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:20:03.358725 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:20:03.358725 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:20:03.358725 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:20:03.358725 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:20:03.358725 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:03.362873 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 366/722] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:20:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:03.364242 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c46b0-370c-4599-be32-37ea50f9cfed None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:03.384635 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:03.500389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c46b0-370c-4599-be32-37ea50f9cfed None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:03.541254 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1fb0b-dc9a-4973-8984-d828ca00a00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:03.542269 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1fb0b-dc9a-4973-8984-d828ca00a00d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:03.542734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1fb0b-dc9a-4973-8984-d828ca00a00d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:03.543188 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1fb0b-dc9a-4973-8984-d828ca00a00d None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:03.544614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1fb0b-dc9a-4973-8984-d828ca00a00d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:03.545120 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1fb0b-dc9a-4973-8984-d828ca00a00d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:03.546687 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1fb0b-dc9a-4973-8984-d828ca00a00d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:03.557891 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 357/723] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:20:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:03.564336 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b61e64-98fc-4446-9186-29caa251e0a1 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:03.584249 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:03.616030 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076b428-07c5-48f9-b74b-9d9db519151f None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:03.616377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076b428-07c5-48f9-b74b-9d9db519151f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:03.616618 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076b428-07c5-48f9-b74b-9d9db519151f None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:03.618270 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 358/724] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:20:03.628840 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797c83a-bce2-4971-9b46-482bfa022d66 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:03.629398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797c83a-bce2-4971-9b46-482bfa022d66 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:03.629802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797c83a-bce2-4971-9b46-482bfa022d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:03.659789 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-f797c83a-bce2-4971-9b46-482bfa022d66 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:03.659789 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f797c83a-bce2-4971-9b46-482bfa022d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:03.706248 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b61e64-98fc-4446-9186-29caa251e0a1 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:03.751745 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d79d24-e6e2-4d92-9a7c-5a025fcff39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:03.752378 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d79d24-e6e2-4d92-9a7c-5a025fcff39a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:03.752659 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d79d24-e6e2-4d92-9a7c-5a025fcff39a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:03.752933 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d79d24-e6e2-4d92-9a7c-5a025fcff39a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:03.773358 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d79d24-e6e2-4d92-9a7c-5a025fcff39a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:03.774850 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d79d24-e6e2-4d92-9a7c-5a025fcff39a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:03.796239 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 359/725] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:20:03.803112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-15d79d24-e6e2-4d92-9a7c-5a025fcff39a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:03.803112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:03.803112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:03.803112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:03.803112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:03.803112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:03.803112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:03.803112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:03.803112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:03.803112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:03.803112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:03.803112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:03.803112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:03.803112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:03.803112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:03.803112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:03.804111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:03.804111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:03.804111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:03.804111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:03.804111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:03.804111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:03.804111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:03.804111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:03.804111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:03.804111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:03.804111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:03.804111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:03.804111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:03.804111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:03.804111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:03.804111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:03.804111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:03.804993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:03.804993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:03.804993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:03.804993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 367/726] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:03.810105 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797c83a-bce2-4971-9b46-482bfa022d66 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:03.822095 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:03.950727 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797c83a-bce2-4971-9b46-482bfa022d66 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:03.997788 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f1760-3276-4d0b-bc4b-6b9fcfeafb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:03.998388 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f1760-3276-4d0b-bc4b-6b9fcfeafb1b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:03.998667 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f1760-3276-4d0b-bc4b-6b9fcfeafb1b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:03.998940 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f1760-3276-4d0b-bc4b-6b9fcfeafb1b None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:03.999596 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f1760-3276-4d0b-bc4b-6b9fcfeafb1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:03.999899 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f1760-3276-4d0b-bc4b-6b9fcfeafb1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:04.001285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f1760-3276-4d0b-bc4b-6b9fcfeafb1b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:04.018420 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 360/727] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:04.023904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d79d24-e6e2-4d92-9a7c-5a025fcff39a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:04.095876 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:04.131441 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f1760-3276-4d0b-bc4b-6b9fcfeafb1b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:04.138504 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d79d24-e6e2-4d92-9a7c-5a025fcff39a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:04.180048 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbee65-a2a2-414a-a632-ef09e99e66f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:04.180687 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbee65-a2a2-414a-a632-ef09e99e66f8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:04.180969 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbee65-a2a2-414a-a632-ef09e99e66f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:04.181241 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbee65-a2a2-414a-a632-ef09e99e66f8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:04.198909 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbee65-a2a2-414a-a632-ef09e99e66f8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:04.200988 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbee65-a2a2-414a-a632-ef09e99e66f8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:04.226392 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-f1bbee65-a2a2-414a-a632-ef09e99e66f8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 14:20:04.226392 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:04.226392 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:04.226392 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:04.226392 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:04.226392 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:04.226392 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:04.226392 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:04.226392 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:04.226392 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:04.226392 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:04.226392 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:04.226392 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:20:04.226392 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:20:04.226392 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:20:04.226392 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:20:04.227373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:04.227373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:04.227373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:20:04.227373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:04.227373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:20:04.227373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:04.227373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:04.227373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:04.227373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:04.227373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:04.227373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:04.227373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:04.227373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:04.227373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:04.227373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:04.227373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:04.227373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:04.227373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:04.228301 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:04.228301 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:04.228301 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:20:04.228301 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:20:04.228301 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:20:04.228301 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:20:04.228301 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:20:04.228301 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:20:04.228301 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 14:20:04.228301 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:04.228301 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 368/728] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:20:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:04.234618 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbee65-a2a2-414a-a632-ef09e99e66f8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:04.334095 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:04.346282 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbee65-a2a2-414a-a632-ef09e99e66f8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:04.374211 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:04.387114 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0197be-8e80-41bf-a2ed-a3fc4c18a8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:04.388461 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0197be-8e80-41bf-a2ed-a3fc4c18a8c0 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:04.388891 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0197be-8e80-41bf-a2ed-a3fc4c18a8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:04.389342 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0197be-8e80-41bf-a2ed-a3fc4c18a8c0 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:04.393322 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0197be-8e80-41bf-a2ed-a3fc4c18a8c0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:04.394932 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0197be-8e80-41bf-a2ed-a3fc4c18a8c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:04.396692 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0197be-8e80-41bf-a2ed-a3fc4c18a8c0 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:04.416187 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f1760-3276-4d0b-bc4b-6b9fcfeafb1b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:04.445299 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 369/729] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Aug 24 14:20:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:04.455487 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0197be-8e80-41bf-a2ed-a3fc4c18a8c0 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:04.480754 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f90d62-3a91-4842-827f-7005f98fad87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:04.481973 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f90d62-3a91-4842-827f-7005f98fad87 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:04.482256 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f90d62-3a91-4842-827f-7005f98fad87 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:04.482558 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f90d62-3a91-4842-827f-7005f98fad87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:04.502270 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f90d62-3a91-4842-827f-7005f98fad87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:20:04.513608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-71f90d62-3a91-4842-827f-7005f98fad87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:20:04.513608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:04.513608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:04.513608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:04.513608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:04.513608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:04.513608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:04.513608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:04.513608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:04.513608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:04.513608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:04.513608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:04.513608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:20:04.513608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:20:04.513608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:20:04.513608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:20:04.514879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:20:04.514879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:20:04.514879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:20:04.514879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:20:04.514879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:04.514879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:04.514879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:04.514879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:04.514879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:04.514879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:04.514879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:04.514879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:04.514879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:04.514879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:04.514879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:04.514879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:04.515828 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:04.515828 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:04.515828 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:04.515828 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:04.515828 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:20:04.515828 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:20:04.515828 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:20:04.515828 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:20:04.515828 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:20:04.515828 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:20:04.515828 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:20:04.515828 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:04.518195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 361/730] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 14:20:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:20:04.525276 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f90d62-3a91-4842-827f-7005f98fad87 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:04.579740 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0197be-8e80-41bf-a2ed-a3fc4c18a8c0 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:04.616933 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639e5cf-3567-4f74-b20b-de1da09363f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:04.617649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639e5cf-3567-4f74-b20b-de1da09363f2 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:04.617958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639e5cf-3567-4f74-b20b-de1da09363f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:04.618334 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639e5cf-3567-4f74-b20b-de1da09363f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:04.638525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f90d62-3a91-4842-827f-7005f98fad87 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:04.665007 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:04.670024 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:04.674073 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd92ec-bd87-4e0c-a123-73ca8d4131be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:04.674671 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd92ec-bd87-4e0c-a123-73ca8d4131be None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:04.674952 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd92ec-bd87-4e0c-a123-73ca8d4131be None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:04.675225 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd92ec-bd87-4e0c-a123-73ca8d4131be None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:04.675883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd92ec-bd87-4e0c-a123-73ca8d4131be None admin] RBAC: Adding query filter params (name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:04.676185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd92ec-bd87-4e0c-a123-73ca8d4131be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:04.677545 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd92ec-bd87-4e0c-a123-73ca8d4131be None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:04.690260 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 362/731] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 14:20:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:04.690260 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc269f78-574d-4ee6-817f-3b4f041e7c20 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:04.690260 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc269f78-574d-4ee6-817f-3b4f041e7c20 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:04.690260 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc269f78-574d-4ee6-817f-3b4f041e7c20 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:04.690620 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639e5cf-3567-4f74-b20b-de1da09363f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:04.690708 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 363/732] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:04.690708 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fe6a4-0e0f-4e93-8a4b-aae94a0bec6f None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:04.690845 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639e5cf-3567-4f74-b20b-de1da09363f2 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:04.690915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fe6a4-0e0f-4e93-8a4b-aae94a0bec6f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:04.690915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fe6a4-0e0f-4e93-8a4b-aae94a0bec6f None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:04.693793 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 364/733] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:04.693793 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740b3f4-353c-494c-bab9-052a1d53a51c None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:04.693793 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740b3f4-353c-494c-bab9-052a1d53a51c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:04.693793 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740b3f4-353c-494c-bab9-052a1d53a51c None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:04.698173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 365/734] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:04.699141 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740b3f4-353c-494c-bab9-052a1d53a51c None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:04.791299 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 370/735] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:20:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 14:20:04.792611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ab61e-6caf-4955-bf67-32243fad1722 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:04.792933 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ab61e-6caf-4955-bf67-32243fad1722 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:04.793170 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ab61e-6caf-4955-bf67-32243fad1722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:04.800481 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740b3f4-353c-494c-bab9-052a1d53a51c None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:04.811369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d79ab61e-6caf-4955-bf67-32243fad1722 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:04.812551 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d79ab61e-6caf-4955-bf67-32243fad1722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:04.834722 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb6d66-1ddc-491a-9652-78b2765a03b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:04.835346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb6d66-1ddc-491a-9652-78b2765a03b8 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:04.835619 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb6d66-1ddc-491a-9652-78b2765a03b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:04.835886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb6d66-1ddc-491a-9652-78b2765a03b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:04.846459 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb6d66-1ddc-491a-9652-78b2765a03b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:04.848061 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb6d66-1ddc-491a-9652-78b2765a03b8 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:04.862255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-69fb6d66-1ddc-491a-9652-78b2765a03b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:04.862255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:04.862255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:04.862255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:04.862255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:04.862255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:04.862255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:04.862255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:04.862255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:04.862255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:04.862255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:04.862255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:04.862255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:04.862255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:04.862255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:04.862255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:04.863214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:04.863214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:04.863214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:04.863214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:04.863214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:04.863214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:04.863214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:04.863214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:04.863214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:04.863214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:04.863214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:04.863214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:04.863214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:04.863214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:04.863214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:04.863214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:04.863214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:04.864256 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:04.864256 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:04.864256 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:04.865886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 366/736] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:04.867317 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0facf-748d-4586-8798-57d31e429e19 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:04.867605 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0facf-748d-4586-8798-57d31e429e19 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:04.868033 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0facf-748d-4586-8798-57d31e429e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:04.878095 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 371/737] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:20:04.879568 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b6600-809a-4457-9ed1-71c4810f5173 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:04.879851 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b6600-809a-4457-9ed1-71c4810f5173 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:04.880116 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b6600-809a-4457-9ed1-71c4810f5173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:04.890048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-3ce0facf-748d-4586-8798-57d31e429e19 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:04.891236 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3ce0facf-748d-4586-8798-57d31e429e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:04.901315 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-8c2b6600-809a-4457-9ed1-71c4810f5173 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:04.902759 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8c2b6600-809a-4457-9ed1-71c4810f5173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:04.911851 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:04.927523 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:04.968963 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 367/738] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:20:04.968963 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0facf-748d-4586-8798-57d31e429e19 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:04.985913 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 372/739] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:20:04.989009 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b6600-809a-4457-9ed1-71c4810f5173 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:05.150805 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0facf-748d-4586-8798-57d31e429e19 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:05.161639 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b6600-809a-4457-9ed1-71c4810f5173 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:05.194213 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ae2c6-3bbc-4729-942a-a8f0d7eae2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:05.194839 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ae2c6-3bbc-4729-942a-a8f0d7eae2e9 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:05.195120 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ae2c6-3bbc-4729-942a-a8f0d7eae2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:05.195391 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ae2c6-3bbc-4729-942a-a8f0d7eae2e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:05.197075 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf4eea-acc8-4dda-94de-cc5a53e263d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:05.197679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf4eea-acc8-4dda-94de-cc5a53e263d3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:05.197980 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf4eea-acc8-4dda-94de-cc5a53e263d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:05.198248 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf4eea-acc8-4dda-94de-cc5a53e263d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:05.198907 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf4eea-acc8-4dda-94de-cc5a53e263d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:05.199205 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf4eea-acc8-4dda-94de-cc5a53e263d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:05.200716 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf4eea-acc8-4dda-94de-cc5a53e263d3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:05.206455 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ae2c6-3bbc-4729-942a-a8f0d7eae2e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:05.207916 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ae2c6-3bbc-4729-942a-a8f0d7eae2e9 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:05.213596 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 373/740] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:05.214478 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf4eea-acc8-4dda-94de-cc5a53e263d3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:05.218873 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:05.226164 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-554ae2c6-3bbc-4729-942a-a8f0d7eae2e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:05.226164 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:05.226164 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:05.226164 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:05.226164 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:05.226164 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:05.226164 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:05.226164 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:05.226164 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:05.226164 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:05.226164 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:05.226164 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:05.226164 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:05.226164 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:05.226164 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:05.226164 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:05.227094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:05.227094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:05.227094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:05.227094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:05.227094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:05.227094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:05.227094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:05.227094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:05.227094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:05.227094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:05.227094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:05.227094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:05.227094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:05.227094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:05.227094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:05.227094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:05.227094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:05.227985 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:05.227985 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:05.227985 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:05.229829 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 368/741] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:05.230951 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ae2c6-3bbc-4729-942a-a8f0d7eae2e9 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:05.266560 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:05.332854 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf4eea-acc8-4dda-94de-cc5a53e263d3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:05.335078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ae2c6-3bbc-4729-942a-a8f0d7eae2e9 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:05.366620 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0895854-b528-4d65-96c6-83747c0e40fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:05.367224 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0895854-b528-4d65-96c6-83747c0e40fd None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:05.367503 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0895854-b528-4d65-96c6-83747c0e40fd None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:05.367776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0895854-b528-4d65-96c6-83747c0e40fd None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:05.368414 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0895854-b528-4d65-96c6-83747c0e40fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:05.368782 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a230e9-7d65-48e8-a8da-b7da2afcde69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:05.369400 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a230e9-7d65-48e8-a8da-b7da2afcde69 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:05.369678 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a230e9-7d65-48e8-a8da-b7da2afcde69 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:05.369837 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0895854-b528-4d65-96c6-83747c0e40fd None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:05.369976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a230e9-7d65-48e8-a8da-b7da2afcde69 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:05.377550 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a230e9-7d65-48e8-a8da-b7da2afcde69 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:05.379253 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a230e9-7d65-48e8-a8da-b7da2afcde69 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:05.390190 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-63a230e9-7d65-48e8-a8da-b7da2afcde69 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 14:20:05.390190 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:05.390190 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:05.390190 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:05.390190 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:05.390190 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:05.390190 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:05.390190 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:05.390190 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:05.390190 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:05.390190 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:05.390190 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:05.390190 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:20:05.390190 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:20:05.390190 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:20:05.390190 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:20:05.391314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:05.391314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:05.391314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:20:05.391314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:05.391314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:20:05.391314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:05.391314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:05.391314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:05.391314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:05.391314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:05.391314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:05.391314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:05.391314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:05.391314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:05.391314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:05.391314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:05.391314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:05.391314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:05.392332 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:05.392332 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:05.392332 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:20:05.392332 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:20:05.392332 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:20:05.392332 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:20:05.392332 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:20:05.392332 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:20:05.392332 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 14:20:05.392332 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:05.392332 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 369/742] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Aug 24 14:20:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:05.392332 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a230e9-7d65-48e8-a8da-b7da2afcde69 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:05.469500 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 374/743] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 14:20:05 2022] POST /identity/v3/services => generated 251 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:20:05.471282 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0895854-b528-4d65-96c6-83747c0e40fd None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:05.484554 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:05.505942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a230e9-7d65-48e8-a8da-b7da2afcde69 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:05.543213 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:05.552870 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012134f-d523-4731-8cf6-de2ada1aa5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:05.553485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012134f-d523-4731-8cf6-de2ada1aa5cb None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:05.553798 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012134f-d523-4731-8cf6-de2ada1aa5cb None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:05.554057 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012134f-d523-4731-8cf6-de2ada1aa5cb None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:05.554713 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012134f-d523-4731-8cf6-de2ada1aa5cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:05.555015 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012134f-d523-4731-8cf6-de2ada1aa5cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:05.556415 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012134f-d523-4731-8cf6-de2ada1aa5cb None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:05.574145 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 370/744] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:05.576236 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012134f-d523-4731-8cf6-de2ada1aa5cb None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:05.596571 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0895854-b528-4d65-96c6-83747c0e40fd None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:05.640256 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d0d55-b41b-4c89-b9f0-3e04e2444669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:05.640872 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d0d55-b41b-4c89-b9f0-3e04e2444669 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:05.641152 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d0d55-b41b-4c89-b9f0-3e04e2444669 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:05.641423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d0d55-b41b-4c89-b9f0-3e04e2444669 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:05.642178 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d0d55-b41b-4c89-b9f0-3e04e2444669 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:05.643866 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d0d55-b41b-4c89-b9f0-3e04e2444669 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:05.684214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012134f-d523-4731-8cf6-de2ada1aa5cb None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:05.719354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c4076-ab88-45b7-8ff8-ea1d520655fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:05.720274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c4076-ab88-45b7-8ff8-ea1d520655fb None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:05.720384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 375/745] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 14:20:05 2022] POST /identity/v3/services => generated 240 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:20:05.720773 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c4076-ab88-45b7-8ff8-ea1d520655fb None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:05.721202 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c4076-ab88-45b7-8ff8-ea1d520655fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:05.727300 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d0d55-b41b-4c89-b9f0-3e04e2444669 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:05.729902 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:05.736844 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c4076-ab88-45b7-8ff8-ea1d520655fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:20:05.741917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-9d7c4076-ab88-45b7-8ff8-ea1d520655fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:20:05.741917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:05.741917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:05.741917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:05.741917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:05.741917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:05.741917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:05.741917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:05.741917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:05.741917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:05.741917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:05.741917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:05.741917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:20:05.741917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:20:05.741917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:20:05.741917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:20:05.743023 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:20:05.743023 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:20:05.743023 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:20:05.743023 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:20:05.743023 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:05.743023 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:05.743023 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:05.743023 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:05.743023 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:05.743023 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:05.743023 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:05.743023 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:05.743023 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:05.743023 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:05.743023 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:05.743023 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:05.743885 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:05.743885 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:05.743885 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:05.743885 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:05.743885 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:20:05.743885 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:20:05.743885 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:20:05.743885 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:20:05.743885 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:20:05.743885 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:20:05.743885 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:20:05.743885 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:05.745956 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 371/746] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:20:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:05.747933 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c4076-ab88-45b7-8ff8-ea1d520655fb None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:05.872140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d0d55-b41b-4c89-b9f0-3e04e2444669 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:05.893796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c4076-ab88-45b7-8ff8-ea1d520655fb None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:05.895462 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:05.920658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85582a83-376c-4186-ab8e-0c405f1e4db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:05.921632 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85582a83-376c-4186-ab8e-0c405f1e4db6 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:05.922156 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85582a83-376c-4186-ab8e-0c405f1e4db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:05.922609 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85582a83-376c-4186-ab8e-0c405f1e4db6 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:05.923533 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85582a83-376c-4186-ab8e-0c405f1e4db6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:05.924012 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85582a83-376c-4186-ab8e-0c405f1e4db6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:05.925619 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85582a83-376c-4186-ab8e-0c405f1e4db6 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:05.939178 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b56515-56b1-400a-af9f-38e3a0b8bab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:05.939866 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b56515-56b1-400a-af9f-38e3a0b8bab1 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:05.940248 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b56515-56b1-400a-af9f-38e3a0b8bab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:05.941135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b56515-56b1-400a-af9f-38e3a0b8bab1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:05.945530 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 376/747] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Aug 24 14:20:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:05.946463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85582a83-376c-4186-ab8e-0c405f1e4db6 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:05.949565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b56515-56b1-400a-af9f-38e3a0b8bab1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:05.951695 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b56515-56b1-400a-af9f-38e3a0b8bab1 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:05.964114 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-15b56515-56b1-400a-af9f-38e3a0b8bab1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:05.964114 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:05.964114 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:05.964114 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:05.964114 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:05.964114 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:05.964114 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:05.964114 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:05.964114 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:05.964114 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:05.964114 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:05.964114 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:05.964114 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:20:05.964114 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:20:05.964114 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:20:05.965735 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:20:05.965735 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:05.965735 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:05.965735 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:05.965735 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:05.965735 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:05.965735 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:05.965735 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:05.965735 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:05.965735 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:05.965735 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:05.965735 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:05.965735 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:05.965735 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:05.965735 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:05.965735 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:05.965735 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:05.967250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:20:05.967250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:20:05.967250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:20:05.967250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:20:05.967250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:20:05.967250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:20:05.967250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:05.967250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:05.969248 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 372/748] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:20:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:05.970362 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b56515-56b1-400a-af9f-38e3a0b8bab1 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:06.046349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:06.078897 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85582a83-376c-4186-ab8e-0c405f1e4db6 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:06.089122 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b56515-56b1-400a-af9f-38e3a0b8bab1 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:06.130558 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edca0d9-832c-4306-aa4b-ea641a254eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:06.131159 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edca0d9-832c-4306-aa4b-ea641a254eec None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:06.131435 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edca0d9-832c-4306-aa4b-ea641a254eec None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:06.131705 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edca0d9-832c-4306-aa4b-ea641a254eec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:06.133991 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2db644-ca0f-4c89-8319-895a6b879006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:06.134593 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2db644-ca0f-4c89-8319-895a6b879006 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:06.134867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2db644-ca0f-4c89-8319-895a6b879006 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:06.135130 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2db644-ca0f-4c89-8319-895a6b879006 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:06.135799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2db644-ca0f-4c89-8319-895a6b879006 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:06.136095 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2db644-ca0f-4c89-8319-895a6b879006 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:06.137708 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2db644-ca0f-4c89-8319-895a6b879006 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:06.151189 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 377/749] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:20:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:06.152077 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2db644-ca0f-4c89-8319-895a6b879006 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:06.194860 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:06.226072 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edca0d9-832c-4306-aa4b-ea641a254eec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:06.229630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edca0d9-832c-4306-aa4b-ea641a254eec None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:06.260994 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2db644-ca0f-4c89-8319-895a6b879006 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:06.297253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff81b6-1010-47fe-8731-c3191b893bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:06.298120 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff81b6-1010-47fe-8731-c3191b893bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:06.298567 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff81b6-1010-47fe-8731-c3191b893bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:06.298980 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff81b6-1010-47fe-8731-c3191b893bc3 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:06.299814 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff81b6-1010-47fe-8731-c3191b893bc3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:06.300264 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff81b6-1010-47fe-8731-c3191b893bc3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:06.301955 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff81b6-1010-47fe-8731-c3191b893bc3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:06.307995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:06.315625 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 378/750] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:20:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:06.316625 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff81b6-1010-47fe-8731-c3191b893bc3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:06.368336 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 373/751] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:20:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:20:06.369173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edca0d9-832c-4306-aa4b-ea641a254eec None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:06.445930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:06.449845 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff81b6-1010-47fe-8731-c3191b893bc3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:06.489384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1cb80f-ef29-44f8-84d3-b1333d861433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:06.489978 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cb80f-ef29-44f8-84d3-b1333d861433 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:06.490347 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cb80f-ef29-44f8-84d3-b1333d861433 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:06.490875 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cb80f-ef29-44f8-84d3-b1333d861433 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:06.502613 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1cb80f-ef29-44f8-84d3-b1333d861433 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:06.504309 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1cb80f-ef29-44f8-84d3-b1333d861433 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:06.519545 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-5e1cb80f-ef29-44f8-84d3-b1333d861433 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:06.519545 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:06.519545 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:06.519545 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:06.519545 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:06.519545 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:06.519545 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:06.519545 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:06.519545 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:06.519545 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:06.519545 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:06.519545 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:06.519545 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:06.519545 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:06.519545 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:06.519545 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:06.520567 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:06.520567 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:06.520567 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:06.520567 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:06.520567 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:06.520567 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:06.520567 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:06.520567 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:06.520567 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:06.520567 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:06.520567 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:06.520567 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:06.520567 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:06.520567 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:06.520567 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:06.520567 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:06.520567 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:06.521455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:06.521455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:06.521455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:06.521455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 379/752] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:06.522194 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1cb80f-ef29-44f8-84d3-b1333d861433 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:06.614814 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edca0d9-832c-4306-aa4b-ea641a254eec None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:06.657100 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2676ba1-37ca-4263-98e2-84826257da73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:06.657989 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2676ba1-37ca-4263-98e2-84826257da73 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:06.658278 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2676ba1-37ca-4263-98e2-84826257da73 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:06.658553 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2676ba1-37ca-4263-98e2-84826257da73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:06.659967 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2676ba1-37ca-4263-98e2-84826257da73 None admin] RBAC: Adding query filter params (role.id=b779073cee3c470ca4ad7a7b27d72c5e, scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e, user.id=6b3c32ecfdcf40629f09a7f52b2b5fa8) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:06.660297 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2676ba1-37ca-4263-98e2-84826257da73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:06.661741 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2676ba1-37ca-4263-98e2-84826257da73 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:06.670566 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 374/753] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:20:06 2022] GET /identity/v3/role_assignments?user.id=6b3c32ecfdcf40629f09a7f52b2b5fa8&scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e&role.id=b779073cee3c470ca4ad7a7b27d72c5e => generated 259 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:06.671395 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2676ba1-37ca-4263-98e2-84826257da73 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:06.701403 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:06.748649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1cb80f-ef29-44f8-84d3-b1333d861433 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:06.798974 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a70e16-5051-4dab-8cff-310296fc47d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:06.799624 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a70e16-5051-4dab-8cff-310296fc47d5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:06.799902 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a70e16-5051-4dab-8cff-310296fc47d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:06.800174 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a70e16-5051-4dab-8cff-310296fc47d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:06.830501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a70e16-5051-4dab-8cff-310296fc47d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:06.832438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a70e16-5051-4dab-8cff-310296fc47d5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:06.856423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-27a70e16-5051-4dab-8cff-310296fc47d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:06.856423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:06.856423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:06.856423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:06.856423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:06.856423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:06.856423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:06.856423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:06.856423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:06.856423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:06.856423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:06.856423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:06.856423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:06.856423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:06.856423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:06.856423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:06.858800 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:06.858800 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:06.858800 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:06.858800 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:06.858800 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:06.858800 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:06.858800 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:06.858800 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:06.858800 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:06.858800 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:06.858800 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:06.858800 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:06.858800 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:06.858800 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:06.858800 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:06.858800 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:06.858800 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:06.860946 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:06.860946 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:06.860946 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:06.865562 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 380/754] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:06.870601 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a70e16-5051-4dab-8cff-310296fc47d5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:06.874744 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:06.875926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2676ba1-37ca-4263-98e2-84826257da73 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:06.922819 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263dde5-b0b9-485c-8d57-6ddc98d389dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:06.923479 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263dde5-b0b9-485c-8d57-6ddc98d389dd None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:06.923759 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263dde5-b0b9-485c-8d57-6ddc98d389dd None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:06.924026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263dde5-b0b9-485c-8d57-6ddc98d389dd None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:06.924676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263dde5-b0b9-485c-8d57-6ddc98d389dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:06.924975 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263dde5-b0b9-485c-8d57-6ddc98d389dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:06.926394 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263dde5-b0b9-485c-8d57-6ddc98d389dd None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:06.953386 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 375/755] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:06.958580 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263dde5-b0b9-485c-8d57-6ddc98d389dd None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:07.049529 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a70e16-5051-4dab-8cff-310296fc47d5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:07.075229 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:07.094055 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263dde5-b0b9-485c-8d57-6ddc98d389dd None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:07.121310 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292253ed-23e4-437f-8316-e2531a00a878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:07.122884 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292253ed-23e4-437f-8316-e2531a00a878 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:07.122884 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292253ed-23e4-437f-8316-e2531a00a878 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:07.123241 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292253ed-23e4-437f-8316-e2531a00a878 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:07.123710 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292253ed-23e4-437f-8316-e2531a00a878 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:07.124016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292253ed-23e4-437f-8316-e2531a00a878 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:07.125396 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292253ed-23e4-437f-8316-e2531a00a878 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:07.135391 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c8e65-4536-4a9e-a8dc-458235ec9510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:07.136014 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c8e65-4536-4a9e-a8dc-458235ec9510 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:07.136290 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c8e65-4536-4a9e-a8dc-458235ec9510 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:07.136562 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c8e65-4536-4a9e-a8dc-458235ec9510 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:07.148018 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c8e65-4536-4a9e-a8dc-458235ec9510 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:07.149494 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c8e65-4536-4a9e-a8dc-458235ec9510 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:07.156063 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 381/756] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:07.161119 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292253ed-23e4-437f-8316-e2531a00a878 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:07.162175 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-892c8e65-4536-4a9e-a8dc-458235ec9510 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:20:07.162175 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:07.162175 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:07.162175 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:07.162175 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:07.162175 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:07.162175 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:07.162175 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:07.162175 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:07.162175 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:07.162175 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:07.162175 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:07.162175 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:20:07.162175 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:20:07.162175 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:20:07.162175 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:20:07.164134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:07.164134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:07.164134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:20:07.164134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:07.164134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:20:07.164134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:07.164134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:07.164134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:07.164134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:07.164134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:07.164134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:07.164134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:07.164134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:07.164134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:07.164134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:07.164134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:07.164134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:07.164134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:07.165365 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:07.165365 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:07.165365 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:20:07.165365 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:20:07.165365 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:20:07.165365 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:20:07.165365 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:20:07.165365 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:20:07.165365 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:20:07.165365 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:07.165365 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 376/757] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Aug 24 14:20:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:07.170892 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c8e65-4536-4a9e-a8dc-458235ec9510 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:07.308073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:07.346422 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c8e65-4536-4a9e-a8dc-458235ec9510 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:07.346853 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292253ed-23e4-437f-8316-e2531a00a878 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:07.385044 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bbec6-ee25-43f9-8426-942be0bbc6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:07.386098 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bbec6-ee25-43f9-8426-942be0bbc6ed None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:07.386380 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bbec6-ee25-43f9-8426-942be0bbc6ed None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:07.386658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bbec6-ee25-43f9-8426-942be0bbc6ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:07.394965 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395bbec6-ee25-43f9-8426-942be0bbc6ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:07.396578 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395bbec6-ee25-43f9-8426-942be0bbc6ed None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:07.409152 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-395bbec6-ee25-43f9-8426-942be0bbc6ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:07.409152 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:07.409152 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:07.409152 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:07.409152 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:07.409152 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:07.409152 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:07.409152 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:07.409152 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:07.409152 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:07.409152 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:07.409152 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:07.409152 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:20:07.409152 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:20:07.409152 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:20:07.411352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:20:07.411352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:07.411352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:07.411352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:07.411352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:07.411352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:07.411352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:07.411352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:07.411352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:07.411352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:07.411352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:07.411352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:07.411352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:07.411352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:07.411352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:07.411352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:07.411352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:07.413467 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:20:07.413467 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:20:07.413467 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:20:07.413467 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:20:07.413467 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:20:07.413467 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:20:07.413467 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:07.413467 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:07.413467 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 382/758] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:20:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:20:07.417774 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bbec6-ee25-43f9-8426-942be0bbc6ed None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:07.428962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c49cad-7c8e-441c-beab-91a87028c1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:07.429573 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c49cad-7c8e-441c-beab-91a87028c1bf None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:07.429894 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c49cad-7c8e-441c-beab-91a87028c1bf None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:07.430174 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c49cad-7c8e-441c-beab-91a87028c1bf None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:07.430912 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c49cad-7c8e-441c-beab-91a87028c1bf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:07.431219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c49cad-7c8e-441c-beab-91a87028c1bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:07.432659 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c49cad-7c8e-441c-beab-91a87028c1bf None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:07.447880 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:07.452194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 377/759] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Aug 24 14:20:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:07.457572 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c49cad-7c8e-441c-beab-91a87028c1bf None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:07.545282 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bbec6-ee25-43f9-8426-942be0bbc6ed None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:07.575041 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:07.589391 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b70cf-0f9c-4d30-b17c-aa3d3ac0d481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:07.590614 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b70cf-0f9c-4d30-b17c-aa3d3ac0d481 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:07.591251 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b70cf-0f9c-4d30-b17c-aa3d3ac0d481 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:07.591528 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b70cf-0f9c-4d30-b17c-aa3d3ac0d481 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:07.592516 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b70cf-0f9c-4d30-b17c-aa3d3ac0d481 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:07.592832 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b70cf-0f9c-4d30-b17c-aa3d3ac0d481 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:07.594296 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b70cf-0f9c-4d30-b17c-aa3d3ac0d481 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:07.610000 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 383/760] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:20:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:07.611378 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c18c6-715f-404f-a431-2396f6a386fd None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:07.611666 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c18c6-715f-404f-a431-2396f6a386fd None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:07.611941 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c18c6-715f-404f-a431-2396f6a386fd None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:07.617591 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 384/761] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:07.617591 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c18c6-715f-404f-a431-2396f6a386fd None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:07.642015 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c49cad-7c8e-441c-beab-91a87028c1bf None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:07.680175 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a20564-c3a0-42be-ab2b-aa5dfe0e8366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:07.681205 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a20564-c3a0-42be-ab2b-aa5dfe0e8366 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:07.681715 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a20564-c3a0-42be-ab2b-aa5dfe0e8366 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:07.682285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a20564-c3a0-42be-ab2b-aa5dfe0e8366 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:07.694836 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a20564-c3a0-42be-ab2b-aa5dfe0e8366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:07.696799 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a20564-c3a0-42be-ab2b-aa5dfe0e8366 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:07.714005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-37a20564-c3a0-42be-ab2b-aa5dfe0e8366 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:07.714005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:07.714005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:07.714005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:07.714005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:07.714005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:07.714005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:07.714005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:07.714005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:07.714005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:07.714005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:07.714005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:07.714005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:07.714005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:07.714005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:07.714005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:07.714995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:07.714995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:07.714995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:07.714995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:07.714995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:07.714995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:07.714995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:07.714995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:07.714995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:07.714995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:07.714995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:07.714995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:07.714995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:07.714995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:07.714995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:07.714995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:07.714995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:07.716329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:07.716329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:07.716329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:07.718597 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 378/762] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:07.720093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec448379-293a-4392-a1e2-a953509346ad None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:07.720599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec448379-293a-4392-a1e2-a953509346ad None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:07.721200 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec448379-293a-4392-a1e2-a953509346ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:07.732922 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c18c6-715f-404f-a431-2396f6a386fd None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:07.740328 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ec448379-293a-4392-a1e2-a953509346ad None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:07.741911 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ec448379-293a-4392-a1e2-a953509346ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:07.773786 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2f909-5583-4ea4-9150-7678048b7d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:07.775587 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2f909-5583-4ea4-9150-7678048b7d35 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:07.776170 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2f909-5583-4ea4-9150-7678048b7d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:07.776658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2f909-5583-4ea4-9150-7678048b7d35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:07.777618 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2f909-5583-4ea4-9150-7678048b7d35 None admin] RBAC: Adding query filter params (role.id=0df7ee13692d4eb5a741a8b79fd58d58, scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e, user.id=477ab357d285415e8c0c82d414d242ba) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:07.778152 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2f909-5583-4ea4-9150-7678048b7d35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:07.780246 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2f909-5583-4ea4-9150-7678048b7d35 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:07.788136 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 385/763] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:20:07 2022] GET /identity/v3/role_assignments?user.id=477ab357d285415e8c0c82d414d242ba&scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e&role.id=0df7ee13692d4eb5a741a8b79fd58d58 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:07.789284 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2f909-5583-4ea4-9150-7678048b7d35 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:07.815863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:07.864489 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 379/764] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:20:07.869164 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3b322-f83b-4453-9156-de95e67a5b73 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:07.869164 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3b322-f83b-4453-9156-de95e67a5b73 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:07.869164 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3b322-f83b-4453-9156-de95e67a5b73 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:07.869164 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 380/765] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:07.873271 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672242f-6d73-467d-b4a1-127d4dd11769 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:07.873552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672242f-6d73-467d-b4a1-127d4dd11769 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:07.873857 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672242f-6d73-467d-b4a1-127d4dd11769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:07.894760 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:07.899018 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-6672242f-6d73-467d-b4a1-127d4dd11769 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:07.900246 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6672242f-6d73-467d-b4a1-127d4dd11769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:07.998907 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2f909-5583-4ea4-9150-7678048b7d35 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:08.041868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 381/766] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:20:08.061808 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112f3b8-754c-46cc-acf2-dbc114d08e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:08.062427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112f3b8-754c-46cc-acf2-dbc114d08e51 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:08.062703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112f3b8-754c-46cc-acf2-dbc114d08e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:08.062974 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112f3b8-754c-46cc-acf2-dbc114d08e51 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:08.063628 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112f3b8-754c-46cc-acf2-dbc114d08e51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:08.063928 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112f3b8-754c-46cc-acf2-dbc114d08e51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:08.065285 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112f3b8-754c-46cc-acf2-dbc114d08e51 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:08.086983 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 386/767] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:08.092313 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672242f-6d73-467d-b4a1-127d4dd11769 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:08.190847 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112f3b8-754c-46cc-acf2-dbc114d08e51 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:08.221984 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672242f-6d73-467d-b4a1-127d4dd11769 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:08.237976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:08.281138 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1bf3b-526b-435e-b002-8d36e1554437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:08.282168 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1bf3b-526b-435e-b002-8d36e1554437 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:08.282682 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1bf3b-526b-435e-b002-8d36e1554437 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:08.283167 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1bf3b-526b-435e-b002-8d36e1554437 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:08.296345 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1bf3b-526b-435e-b002-8d36e1554437 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:08.300855 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1bf3b-526b-435e-b002-8d36e1554437 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:08.319475 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-cec1bf3b-526b-435e-b002-8d36e1554437 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:08.319475 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:08.319475 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:08.319475 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:08.319475 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:08.319475 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:08.319475 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:08.319475 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:08.319475 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:08.319475 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:08.319475 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:08.319475 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:08.319475 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:20:08.319475 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:20:08.319475 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:20:08.320421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:20:08.320421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:08.320421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:08.320421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:08.320421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:08.320421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:08.320421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:08.320421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:08.320421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:08.320421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:08.320421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:08.320421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:08.320421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:08.320421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:08.320421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:08.320421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:08.320421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:08.321427 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:20:08.321427 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:20:08.321427 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:20:08.321427 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:20:08.321427 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:20:08.321427 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:20:08.321427 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:08.321427 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:08.324377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 382/768] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:20:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:08.329614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1bf3b-526b-435e-b002-8d36e1554437 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:08.418859 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112f3b8-754c-46cc-acf2-dbc114d08e51 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:08.427195 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:08.455790 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90d6a4-1ceb-4313-b19f-e7b852aca895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:08.456811 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90d6a4-1ceb-4313-b19f-e7b852aca895 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:08.457310 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90d6a4-1ceb-4313-b19f-e7b852aca895 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:08.457824 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90d6a4-1ceb-4313-b19f-e7b852aca895 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:08.458624 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90d6a4-1ceb-4313-b19f-e7b852aca895 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:08.460202 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90d6a4-1ceb-4313-b19f-e7b852aca895 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:08.463098 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1bf3b-526b-435e-b002-8d36e1554437 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:08.470782 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-7d90d6a4-1ceb-4313-b19f-e7b852aca895 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 14:20:08.470782 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:08.470782 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:20:08.470782 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:20:08.470782 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:20:08.470782 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:20:08.470782 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:20:08.470782 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:08.470782 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 14:20:08.470782 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:08.470782 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:20:08.470782 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:08.470782 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:08.470782 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:08.470782 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:08.470782 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:08.470782 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:08.471776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:08.471776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:08.471776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:08.471776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:08.471776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:08.471776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:08.471776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:20:08.471776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:20:08.471776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:20:08.471776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:20:08.471776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:08.471776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:08.471776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:08.471776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:08.471776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:08.471776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:08.472617 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:08.472617 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:08.472617 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:08.472617 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:08.472617 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:08.472617 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:08.472617 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:08.472617 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:08.472617 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:08.472617 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:08.472617 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:20:08.472617 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:08.472617 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 14:20:08.472617 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:08.475399 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 387/769] 10.222.0.65 () {56 vars in 1129 bytes} [Wed Aug 24 14:20:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:20:08.476470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90d6a4-1ceb-4313-b19f-e7b852aca895 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:08.500997 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2fab0-4dc9-4615-ab29-b6bcd14c5f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:08.501616 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2fab0-4dc9-4615-ab29-b6bcd14c5f84 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:08.502005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2fab0-4dc9-4615-ab29-b6bcd14c5f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:08.502287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2fab0-4dc9-4615-ab29-b6bcd14c5f84 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:08.502988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2fab0-4dc9-4615-ab29-b6bcd14c5f84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:08.503602 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2fab0-4dc9-4615-ab29-b6bcd14c5f84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:08.505031 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2fab0-4dc9-4615-ab29-b6bcd14c5f84 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:08.523739 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 383/770] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:20:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:08.524740 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2fab0-4dc9-4615-ab29-b6bcd14c5f84 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:08.558500 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:08.585809 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90d6a4-1ceb-4313-b19f-e7b852aca895 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:08.621343 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b447e3c-401a-4a04-8aa1-c80e6f2fb5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:08.622390 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b447e3c-401a-4a04-8aa1-c80e6f2fb5bf None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:08.622900 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b447e3c-401a-4a04-8aa1-c80e6f2fb5bf None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:08.623376 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b447e3c-401a-4a04-8aa1-c80e6f2fb5bf None admin] PATH_INFO: `/v3/services/network` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:08.624179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b447e3c-401a-4a04-8aa1-c80e6f2fb5bf None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:08.625735 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b447e3c-401a-4a04-8aa1-c80e6f2fb5bf None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:08.631500 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2fab0-4dc9-4615-ab29-b6bcd14c5f84 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:08.636185 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-8b447e3c-401a-4a04-8aa1-c80e6f2fb5bf None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 14:20:08.636185 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:08.636185 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:20:08.636185 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:20:08.636185 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:20:08.636185 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:20:08.636185 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:20:08.636185 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:08.636185 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 14:20:08.636185 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:08.636185 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:20:08.636185 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:08.636185 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:08.636185 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:08.636185 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:08.636185 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:08.636185 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:08.637945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:08.637945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:08.637945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:08.637945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:08.637945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:08.637945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:08.637945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:20:08.637945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:20:08.637945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:20:08.637945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:20:08.637945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:08.637945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:08.637945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:08.637945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:08.637945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:08.637945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:08.638792 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:08.638792 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:08.638792 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:08.638792 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:08.638792 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:08.638792 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:08.638792 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:08.638792 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:08.638792 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:08.638792 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:08.638792 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:20:08.638792 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:08.638792 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 14:20:08.638792 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:08.641494 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 388/771] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:20:08 2022] GET /identity/v3/services/network => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:08.642596 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b447e3c-401a-4a04-8aa1-c80e6f2fb5bf None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:08.675952 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7a3db-9683-4058-a8ed-dbf99c856043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:08.676689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7a3db-9683-4058-a8ed-dbf99c856043 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:08.676862 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7a3db-9683-4058-a8ed-dbf99c856043 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:08.677115 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7a3db-9683-4058-a8ed-dbf99c856043 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:08.678002 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b7a3db-9683-4058-a8ed-dbf99c856043 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:08.678181 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b7a3db-9683-4058-a8ed-dbf99c856043 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:08.679533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b7a3db-9683-4058-a8ed-dbf99c856043 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:08.684811 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:08.685264 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 384/772] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Aug 24 14:20:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:08.687283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7a3db-9683-4058-a8ed-dbf99c856043 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:08.756510 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b447e3c-401a-4a04-8aa1-c80e6f2fb5bf None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:08.791280 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:08.794397 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ef5bc-4f99-447c-9a14-241c6b218e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:08.795759 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ef5bc-4f99-447c-9a14-241c6b218e16 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:08.796278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ef5bc-4f99-447c-9a14-241c6b218e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:08.796715 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ef5bc-4f99-447c-9a14-241c6b218e16 None admin] PATH_INFO: `/v3/projects/34cce205e8ee4ae9b09bb89bc4bb081e/users/8d099678d6454f7eb494892a69feaf62/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:08.798953 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ef5bc-4f99-447c-9a14-241c6b218e16 None admin] RBAC: Authorizing `identity:create_grant(project_id=34cce205e8ee4ae9b09bb89bc4bb081e, user_id=8d099678d6454f7eb494892a69feaf62, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:08.804382 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7a3db-9683-4058-a8ed-dbf99c856043 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:08.804514 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ef5bc-4f99-447c-9a14-241c6b218e16 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:08.834531 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a597ee-c728-4c64-a726-14978124a543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:08.835137 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a597ee-c728-4c64-a726-14978124a543 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:08.835417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a597ee-c728-4c64-a726-14978124a543 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:08.837925 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a597ee-c728-4c64-a726-14978124a543 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:08.837925 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a597ee-c728-4c64-a726-14978124a543 None admin] RBAC: Adding query filter params (name=network) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:08.837925 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a597ee-c728-4c64-a726-14978124a543 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:08.838129 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a597ee-c728-4c64-a726-14978124a543 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:08.843414 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 385/773] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 14:20:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:08.843991 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a597ee-c728-4c64-a726-14978124a543 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:08.898773 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 389/774] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 14:20:08 2022] PUT /identity/v3/projects/34cce205e8ee4ae9b09bb89bc4bb081e/users/8d099678d6454f7eb494892a69feaf62/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:20:08.898773 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ef5bc-4f99-447c-9a14-241c6b218e16 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:08.989265 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a597ee-c728-4c64-a726-14978124a543 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:09.032956 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68358e-9607-449b-bc5b-0ea566f67d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:09.033535 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68358e-9607-449b-bc5b-0ea566f67d95 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:09.033852 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68358e-9607-449b-bc5b-0ea566f67d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:09.034128 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68358e-9607-449b-bc5b-0ea566f67d95 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:09.034955 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68358e-9607-449b-bc5b-0ea566f67d95 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:09.035262 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68358e-9607-449b-bc5b-0ea566f67d95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:09.036033 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:09.038021 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68358e-9607-449b-bc5b-0ea566f67d95 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:09.044659 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ef5bc-4f99-447c-9a14-241c6b218e16 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:09.045990 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 386/775] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Aug 24 14:20:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:09.047426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf18c44-b639-4b9e-883f-65d0b401cb7c None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:09.047869 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf18c44-b639-4b9e-883f-65d0b401cb7c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:09.048362 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf18c44-b639-4b9e-883f-65d0b401cb7c None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:09.049885 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 387/776] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:09.052128 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf18c44-b639-4b9e-883f-65d0b401cb7c None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:09.086648 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:09.186807 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf18c44-b639-4b9e-883f-65d0b401cb7c None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:09.220877 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe3d6e-dbff-487f-bc6e-914ec028f0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:09.221907 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe3d6e-dbff-487f-bc6e-914ec028f0af None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:09.222398 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe3d6e-dbff-487f-bc6e-914ec028f0af None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:09.222875 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe3d6e-dbff-487f-bc6e-914ec028f0af None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:09.223715 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe3d6e-dbff-487f-bc6e-914ec028f0af None admin] RBAC: Adding query filter params (type=network) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:09.224004 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12856865-cf45-47cb-b134-7d18b6c61443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:09.224490 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe3d6e-dbff-487f-bc6e-914ec028f0af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:09.224597 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12856865-cf45-47cb-b134-7d18b6c61443 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:09.224866 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12856865-cf45-47cb-b134-7d18b6c61443 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:09.225134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12856865-cf45-47cb-b134-7d18b6c61443 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:09.225869 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12856865-cf45-47cb-b134-7d18b6c61443 None admin] RBAC: Adding query filter params (interface=public, service_id=d422640f453e4275bd048de9e58e49c8, region_id=RegionOne) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:09.226179 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12856865-cf45-47cb-b134-7d18b6c61443 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:09.227019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe3d6e-dbff-487f-bc6e-914ec028f0af None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:09.227848 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12856865-cf45-47cb-b134-7d18b6c61443 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:09.238601 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 390/777] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 14:20:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:09.239266 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf33919-29da-4662-a00c-0f182e355ae3 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:09.239385 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf33919-29da-4662-a00c-0f182e355ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:09.239650 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf33919-29da-4662-a00c-0f182e355ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:09.243943 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 388/778] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Aug 24 14:20:09 2022] GET /identity/v3/endpoints?service_id=d422640f453e4275bd048de9e58e49c8&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:09.244986 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12856865-cf45-47cb-b134-7d18b6c61443 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:09.263789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-fdf33919-29da-4662-a00c-0f182e355ae3 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:09.265327 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fdf33919-29da-4662-a00c-0f182e355ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:09.335143 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 391/779] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:20:09.342325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf33919-29da-4662-a00c-0f182e355ae3 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:09.359446 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:09.375000 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12856865-cf45-47cb-b134-7d18b6c61443 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:09.417088 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f55ef-e537-442f-a723-739935c63362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:09.418099 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f55ef-e537-442f-a723-739935c63362 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:09.418662 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f55ef-e537-442f-a723-739935c63362 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:09.419662 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f55ef-e537-442f-a723-739935c63362 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:09.420603 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f55ef-e537-442f-a723-739935c63362 None admin] RBAC: Adding query filter params (interface=public, service_id=cf116260794c49fdaf005a950c3d9957, region_id=RegionOne) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:09.421121 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f55ef-e537-442f-a723-739935c63362 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:09.422739 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f55ef-e537-442f-a723-739935c63362 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:09.429924 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 389/780] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Aug 24 14:20:09 2022] GET /identity/v3/endpoints?service_id=cf116260794c49fdaf005a950c3d9957&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:09.439035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f55ef-e537-442f-a723-739935c63362 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:09.491261 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:09.506976 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf33919-29da-4662-a00c-0f182e355ae3 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:09.551269 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a05c8-1098-4b7c-8af8-0bd8f96e58fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:09.558676 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a05c8-1098-4b7c-8af8-0bd8f96e58fc None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:09.558902 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a05c8-1098-4b7c-8af8-0bd8f96e58fc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:09.559100 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a05c8-1098-4b7c-8af8-0bd8f96e58fc None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:09.559680 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a05c8-1098-4b7c-8af8-0bd8f96e58fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:09.561052 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a05c8-1098-4b7c-8af8-0bd8f96e58fc None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:09.572710 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 392/781] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Aug 24 14:20:09 2022] GET /identity/v3/services => generated 772 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:09.634116 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f55ef-e537-442f-a723-739935c63362 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:09.688740 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15507843-f1a8-4a5f-8324-414bcebfc84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:09.689383 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15507843-f1a8-4a5f-8324-414bcebfc84c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:09.689636 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15507843-f1a8-4a5f-8324-414bcebfc84c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:09.689934 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15507843-f1a8-4a5f-8324-414bcebfc84c None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:09.690563 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15507843-f1a8-4a5f-8324-414bcebfc84c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:09.691982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15507843-f1a8-4a5f-8324-414bcebfc84c None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:09.698220 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 390/782] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Aug 24 14:20:09 2022] GET /identity/v3/services => generated 772 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:09.725575 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a05c8-1098-4b7c-8af8-0bd8f96e58fc None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:09.842901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a05c8-1098-4b7c-8af8-0bd8f96e58fc None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:09.881157 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d929fc-de9c-46ad-baab-36dae757fd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:09.881813 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d929fc-de9c-46ad-baab-36dae757fd34 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:09.882095 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d929fc-de9c-46ad-baab-36dae757fd34 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:09.882367 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d929fc-de9c-46ad-baab-36dae757fd34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:09.889227 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74117b07-5d24-498e-a653-bd26402f3b95 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:09.889497 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74117b07-5d24-498e-a653-bd26402f3b95 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:09.889818 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74117b07-5d24-498e-a653-bd26402f3b95 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:09.891358 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 391/783] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:09.894301 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d929fc-de9c-46ad-baab-36dae757fd34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:20:09.900904 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4260ea-c86a-4766-b4f3-22fa04ae7e21 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:09.900904 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4260ea-c86a-4766-b4f3-22fa04ae7e21 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:09.900904 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4260ea-c86a-4766-b4f3-22fa04ae7e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:09.901216 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-a9d929fc-de9c-46ad-baab-36dae757fd34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:20:09.901216 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:09.901216 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:09.901216 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:09.901216 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:09.901216 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:09.901216 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:09.901216 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:09.901216 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:09.901216 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:09.901216 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:09.901216 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:09.901216 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:20:09.901216 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:20:09.901216 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:20:09.901216 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:20:09.902124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:20:09.902124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:20:09.902124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:20:09.902124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:20:09.902124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:09.902124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:09.902124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:09.902124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:09.902124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:09.902124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:09.902124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:09.902124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:09.902124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:09.902124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:09.902124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:09.902124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:09.903580 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:09.903580 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:09.903580 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:09.903580 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:09.903580 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:20:09.903580 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:20:09.903580 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:20:09.903580 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:20:09.903580 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:20:09.903580 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:20:09.903580 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:20:09.903580 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:09.903580 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 393/784] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:20:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:09.909791 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d929fc-de9c-46ad-baab-36dae757fd34 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:09.926273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:09.929986 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-1b4260ea-c86a-4766-b4f3-22fa04ae7e21 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:09.931424 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1b4260ea-c86a-4766-b4f3-22fa04ae7e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:09.944643 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:10.010217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 392/785] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:20:10.021708 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d929fc-de9c-46ad-baab-36dae757fd34 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:10.065526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d344f9-8275-42ae-bef5-6fbb5ec9e7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:10.066164 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d344f9-8275-42ae-bef5-6fbb5ec9e7dc None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:10.066439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d344f9-8275-42ae-bef5-6fbb5ec9e7dc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:10.066706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d344f9-8275-42ae-bef5-6fbb5ec9e7dc None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:10.067373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d344f9-8275-42ae-bef5-6fbb5ec9e7dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:10.067672 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d344f9-8275-42ae-bef5-6fbb5ec9e7dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:10.069018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d344f9-8275-42ae-bef5-6fbb5ec9e7dc None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:10.085013 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 394/786] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:20:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:10.091292 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4260ea-c86a-4766-b4f3-22fa04ae7e21 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:10.212170 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4260ea-c86a-4766-b4f3-22fa04ae7e21 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:10.247940 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0aa54-20ed-4f86-bf8b-8ce052887072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:10.248875 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0aa54-20ed-4f86-bf8b-8ce052887072 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:10.249340 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0aa54-20ed-4f86-bf8b-8ce052887072 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:10.249821 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0aa54-20ed-4f86-bf8b-8ce052887072 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:10.260743 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0aa54-20ed-4f86-bf8b-8ce052887072 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:10.263068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0aa54-20ed-4f86-bf8b-8ce052887072 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:10.274334 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:10.280437 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-76c0aa54-20ed-4f86-bf8b-8ce052887072 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:10.280437 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:10.280437 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:10.280437 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:10.280437 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:10.280437 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:10.280437 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:10.280437 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:10.280437 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:10.280437 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:10.280437 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:10.280437 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:10.280437 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:10.280437 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:10.280437 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:10.280437 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:10.281574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:10.281574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:10.281574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:10.281574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:10.281574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:10.281574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:10.281574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:10.281574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:10.281574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:10.281574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:10.281574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:10.281574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:10.281574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:10.281574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:10.281574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:10.281574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:10.281574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:10.307455 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:10.307455 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:10.307455 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:10.307455 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 393/787] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:10.307710 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d344f9-8275-42ae-bef5-6fbb5ec9e7dc None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:10.307785 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0aa54-20ed-4f86-bf8b-8ce052887072 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:10.446181 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:10.483491 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d344f9-8275-42ae-bef5-6fbb5ec9e7dc None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:10.548434 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f514884-d18e-4dd5-92fe-0854e94fff52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:10.549467 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f514884-d18e-4dd5-92fe-0854e94fff52 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:10.549927 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f514884-d18e-4dd5-92fe-0854e94fff52 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:10.550199 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f514884-d18e-4dd5-92fe-0854e94fff52 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:10.550889 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f514884-d18e-4dd5-92fe-0854e94fff52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:10.551188 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f514884-d18e-4dd5-92fe-0854e94fff52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:10.552542 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f514884-d18e-4dd5-92fe-0854e94fff52 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:10.575197 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 395/788] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:10.580365 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f514884-d18e-4dd5-92fe-0854e94fff52 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:10.608829 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0aa54-20ed-4f86-bf8b-8ce052887072 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:10.684393 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317aaed-5705-418b-9996-a31306e4ec01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:10.685038 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317aaed-5705-418b-9996-a31306e4ec01 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:10.685318 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317aaed-5705-418b-9996-a31306e4ec01 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:10.685591 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317aaed-5705-418b-9996-a31306e4ec01 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:10.720720 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317aaed-5705-418b-9996-a31306e4ec01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:20:10.722072 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f514884-d18e-4dd5-92fe-0854e94fff52 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:10.725476 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-7317aaed-5705-418b-9996-a31306e4ec01 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:20:10.725476 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:10.725476 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:10.725476 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:10.725476 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:10.725476 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:10.725476 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:10.725476 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:10.725476 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:10.725476 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:10.725476 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:10.725476 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:10.725476 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:20:10.725476 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:20:10.725476 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:20:10.725476 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:20:10.726443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:20:10.726443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:20:10.726443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:20:10.726443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:20:10.726443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:10.726443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:10.726443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:10.726443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:10.726443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:10.726443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:10.726443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:10.726443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:10.726443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:10.726443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:10.726443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:10.726443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:10.727297 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:10.727297 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:10.727297 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:10.727297 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:10.727297 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:20:10.727297 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:20:10.727297 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:20:10.727297 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:20:10.727297 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:20:10.727297 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:20:10.727297 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:20:10.727297 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:10.734258 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 394/789] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 14:20:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 445 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:20:10.740357 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317aaed-5705-418b-9996-a31306e4ec01 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:10.757226 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3257f2-4d75-4cfc-bdb7-46d64a83e604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:10.757880 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3257f2-4d75-4cfc-bdb7-46d64a83e604 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:10.758160 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3257f2-4d75-4cfc-bdb7-46d64a83e604 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:10.758427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3257f2-4d75-4cfc-bdb7-46d64a83e604 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:10.775123 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3257f2-4d75-4cfc-bdb7-46d64a83e604 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:10.778296 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3257f2-4d75-4cfc-bdb7-46d64a83e604 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:10.782057 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:10.799100 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-5a3257f2-4d75-4cfc-bdb7-46d64a83e604 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 14:20:10.799100 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:10.799100 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:10.799100 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:10.799100 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:10.799100 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:10.799100 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:10.799100 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:10.799100 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:10.799100 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:10.799100 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:10.799100 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:10.799100 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:20:10.799100 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:20:10.799100 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:20:10.799100 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:20:10.806074 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:10.806074 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:10.806074 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:20:10.806074 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:10.806074 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:20:10.806074 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:10.806074 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:10.806074 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:10.806074 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:10.806074 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:10.806074 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:10.806074 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:10.806074 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:10.806074 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:10.806074 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:10.806074 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:10.806074 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:10.806074 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:10.807218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:10.807218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:10.807218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:20:10.807218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:20:10.807218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:20:10.807218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:20:10.807218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:20:10.807218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:20:10.807218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 14:20:10.807218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:10.807218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 396/790] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:20:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:10.810226 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3257f2-4d75-4cfc-bdb7-46d64a83e604 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:10.835402 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:10.888135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317aaed-5705-418b-9996-a31306e4ec01 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:10.957764 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b4500-b0b5-4193-8e24-2a8a3967dd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:10.958832 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b4500-b0b5-4193-8e24-2a8a3967dd42 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:10.959342 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b4500-b0b5-4193-8e24-2a8a3967dd42 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:10.959814 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b4500-b0b5-4193-8e24-2a8a3967dd42 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:10.960675 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b4500-b0b5-4193-8e24-2a8a3967dd42 None admin] RBAC: Adding query filter params (name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:10.961272 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b4500-b0b5-4193-8e24-2a8a3967dd42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:10.962872 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b4500-b0b5-4193-8e24-2a8a3967dd42 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:10.977622 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3257f2-4d75-4cfc-bdb7-46d64a83e604 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:10.978182 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 395/791] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 14:20:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:10.980126 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b4500-b0b5-4193-8e24-2a8a3967dd42 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:11.039429 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fbe5e-0555-42df-9ec8-d468ec81d214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:11.040041 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fbe5e-0555-42df-9ec8-d468ec81d214 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:11.040316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fbe5e-0555-42df-9ec8-d468ec81d214 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:11.040580 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fbe5e-0555-42df-9ec8-d468ec81d214 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:11.041537 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fbe5e-0555-42df-9ec8-d468ec81d214 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:11.044614 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fbe5e-0555-42df-9ec8-d468ec81d214 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:11.046092 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fbe5e-0555-42df-9ec8-d468ec81d214 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:11.080658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 397/792] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Aug 24 14:20:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:11.087867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fbe5e-0555-42df-9ec8-d468ec81d214 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:11.173803 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b4500-b0b5-4193-8e24-2a8a3967dd42 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:11.183092 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:11.197426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:11.216902 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0078e2-67d1-41da-81b5-01adf47e4d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:11.217526 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0078e2-67d1-41da-81b5-01adf47e4d45 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:11.217827 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0078e2-67d1-41da-81b5-01adf47e4d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:11.218094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0078e2-67d1-41da-81b5-01adf47e4d45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:11.230378 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0078e2-67d1-41da-81b5-01adf47e4d45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:11.232592 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0078e2-67d1-41da-81b5-01adf47e4d45 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:11.236650 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fbe5e-0555-42df-9ec8-d468ec81d214 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:11.246908 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-ca0078e2-67d1-41da-81b5-01adf47e4d45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:11.246908 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:11.246908 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:11.246908 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:11.246908 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:11.246908 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:11.246908 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:11.246908 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:11.246908 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:11.246908 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:11.246908 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:11.246908 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:11.246908 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:11.246908 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:11.246908 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:11.246908 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:11.248184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:11.248184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:11.248184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:11.248184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:11.248184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:11.248184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:11.248184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:11.248184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:11.248184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:11.248184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:11.248184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:11.248184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:11.248184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:11.248184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:11.248184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:11.248184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:11.248184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:11.249156 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:11.249156 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:11.249156 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:11.249907 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 396/793] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:11.251266 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b802880-606a-42d6-ada5-e145445b30cc None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:11.251648 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b802880-606a-42d6-ada5-e145445b30cc None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:11.252023 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b802880-606a-42d6-ada5-e145445b30cc None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:11.258287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 397/794] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:11.262014 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c30f31-142b-491d-b1f6-fdded393a373 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:11.262014 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c30f31-142b-491d-b1f6-fdded393a373 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:11.262014 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c30f31-142b-491d-b1f6-fdded393a373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:11.277356 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89e57f-c2c1-46b5-b06c-884cf39f9fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:11.278714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89e57f-c2c1-46b5-b06c-884cf39f9fca None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:11.279042 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89e57f-c2c1-46b5-b06c-884cf39f9fca None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:11.279317 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89e57f-c2c1-46b5-b06c-884cf39f9fca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:11.289671 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-47c30f31-142b-491d-b1f6-fdded393a373 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:11.291053 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-47c30f31-142b-491d-b1f6-fdded393a373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:11.292527 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89e57f-c2c1-46b5-b06c-884cf39f9fca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:11.295003 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89e57f-c2c1-46b5-b06c-884cf39f9fca None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:11.310679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-8a89e57f-c2c1-46b5-b06c-884cf39f9fca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:11.310679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:11.310679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:11.310679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:11.310679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:11.310679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:11.310679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:11.310679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:11.310679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:11.310679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:11.310679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:11.310679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:11.310679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:11.310679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:11.310679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:11.310679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:11.311628 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:11.311628 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:11.311628 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:11.311628 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:11.311628 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:11.311628 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:11.311628 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:11.311628 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:11.311628 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:11.311628 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:11.311628 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:11.311628 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:11.311628 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:11.311628 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:11.311628 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:11.311628 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:11.311628 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:11.312527 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:11.312527 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:11.312527 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:11.314706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 398/795] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:11.319634 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89e57f-c2c1-46b5-b06c-884cf39f9fca None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:11.370403 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 398/796] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:20:11.372176 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c30f31-142b-491d-b1f6-fdded393a373 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:11.480124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89e57f-c2c1-46b5-b06c-884cf39f9fca None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:11.485270 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:11.534255 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4fdd5-02f4-4c20-9dd6-3859888bd5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:11.535156 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4fdd5-02f4-4c20-9dd6-3859888bd5e1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:11.535584 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4fdd5-02f4-4c20-9dd6-3859888bd5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:11.536014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4fdd5-02f4-4c20-9dd6-3859888bd5e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:11.536810 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4fdd5-02f4-4c20-9dd6-3859888bd5e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:11.537259 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4fdd5-02f4-4c20-9dd6-3859888bd5e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:11.538814 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4fdd5-02f4-4c20-9dd6-3859888bd5e1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:11.568791 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 399/797] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:11.573721 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4fdd5-02f4-4c20-9dd6-3859888bd5e1 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:11.590260 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c30f31-142b-491d-b1f6-fdded393a373 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:11.594470 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:11.662985 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afa738-cda4-469b-a47c-a0b061572216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:11.663927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afa738-cda4-469b-a47c-a0b061572216 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:11.664355 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afa738-cda4-469b-a47c-a0b061572216 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:11.665667 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afa738-cda4-469b-a47c-a0b061572216 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:11.666566 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afa738-cda4-469b-a47c-a0b061572216 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:11.668729 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afa738-cda4-469b-a47c-a0b061572216 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:11.671362 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afa738-cda4-469b-a47c-a0b061572216 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:11.696535 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 399/798] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:11.697614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afa738-cda4-469b-a47c-a0b061572216 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:11.738367 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4fdd5-02f4-4c20-9dd6-3859888bd5e1 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:11.774654 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03d9f7-d820-490f-b4c2-f2e4e0e315c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:11.775385 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03d9f7-d820-490f-b4c2-f2e4e0e315c9 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:11.775713 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03d9f7-d820-490f-b4c2-f2e4e0e315c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:11.775982 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03d9f7-d820-490f-b4c2-f2e4e0e315c9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:11.784151 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03d9f7-d820-490f-b4c2-f2e4e0e315c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:11.785635 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03d9f7-d820-490f-b4c2-f2e4e0e315c9 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:11.798440 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-2e03d9f7-d820-490f-b4c2-f2e4e0e315c9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 14:20:11.798440 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:11.798440 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:11.798440 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:11.798440 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:11.798440 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:11.798440 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:11.798440 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:11.798440 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:11.798440 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:11.798440 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:11.798440 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:11.798440 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:20:11.798440 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:20:11.798440 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:20:11.798440 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:20:11.799424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:11.799424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:11.799424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:20:11.799424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:11.799424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:20:11.799424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:11.799424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:11.799424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:11.799424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:11.799424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:11.799424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:11.799424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:11.799424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:11.799424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:11.799424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:11.799424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:11.799424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:11.799424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:11.800370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:11.800370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:11.800370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:20:11.800370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:20:11.800370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:20:11.800370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:20:11.800370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:20:11.800370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:20:11.800370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 14:20:11.800370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:11.800370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 400/799] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Aug 24 14:20:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:20:11.800951 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03d9f7-d820-490f-b4c2-f2e4e0e315c9 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:11.819614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afa738-cda4-469b-a47c-a0b061572216 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:11.830207 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:11.856619 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b6b47-8033-43b4-af3c-fba6feb43524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:11.857625 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b6b47-8033-43b4-af3c-fba6feb43524 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:11.858148 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b6b47-8033-43b4-af3c-fba6feb43524 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:11.858623 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b6b47-8033-43b4-af3c-fba6feb43524 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:11.869730 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b6b47-8033-43b4-af3c-fba6feb43524 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:20:11.876845 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-137b6b47-8033-43b4-af3c-fba6feb43524 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:20:11.876845 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:11.876845 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:11.876845 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:11.876845 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:11.876845 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:11.876845 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:11.876845 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:11.876845 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:11.876845 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:11.876845 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:11.876845 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:11.876845 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:20:11.876845 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:20:11.876845 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:20:11.876845 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:20:11.877808 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:20:11.877808 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:20:11.877808 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:20:11.877808 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:20:11.877808 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:11.877808 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:11.877808 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:11.877808 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:11.877808 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:11.877808 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:11.877808 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:11.877808 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:11.877808 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:11.877808 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:11.877808 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:11.877808 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:11.878952 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:11.878952 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:11.878952 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:11.878952 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:11.878952 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:20:11.878952 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:20:11.878952 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:20:11.878952 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:20:11.878952 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:20:11.878952 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:20:11.878952 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:20:11.878952 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:11.881520 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 400/800] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:20:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:11.882529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b6b47-8033-43b4-af3c-fba6feb43524 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:11.910571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:11.921452 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03d9f7-d820-490f-b4c2-f2e4e0e315c9 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:11.960730 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdd5f3-d484-46a1-b547-dcdcd04ffc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:11.960730 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdd5f3-d484-46a1-b547-dcdcd04ffc9f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:11.961061 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdd5f3-d484-46a1-b547-dcdcd04ffc9f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:11.961290 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdd5f3-d484-46a1-b547-dcdcd04ffc9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:11.969125 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cdd5f3-d484-46a1-b547-dcdcd04ffc9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:11.970593 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cdd5f3-d484-46a1-b547-dcdcd04ffc9f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:11.982671 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-36cdd5f3-d484-46a1-b547-dcdcd04ffc9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:11.982671 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:11.982671 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:11.982671 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:11.982671 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:11.982671 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:11.982671 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:11.982671 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:11.982671 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:11.982671 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:11.982671 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:11.982671 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:11.982671 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:20:11.982671 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:20:11.982671 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:20:11.984038 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:20:11.984038 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:11.984038 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:11.984038 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:11.984038 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:11.984038 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:11.984038 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:11.984038 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:11.984038 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:11.984038 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:11.984038 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:11.984038 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:11.984038 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:11.984038 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:11.984038 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:11.984038 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:11.984038 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:11.984921 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:20:11.984921 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:20:11.984921 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:20:11.984921 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:20:11.984921 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:20:11.984921 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:20:11.984921 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:11.984921 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:11.988652 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 401/801] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:20:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:11.989385 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdd5f3-d484-46a1-b547-dcdcd04ffc9f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:11.998817 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b6b47-8033-43b4-af3c-fba6feb43524 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:12.036544 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb71b4b-c55f-4e4c-8f7c-960bbed0372e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:12.037144 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb71b4b-c55f-4e4c-8f7c-960bbed0372e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:12.037413 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb71b4b-c55f-4e4c-8f7c-960bbed0372e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:12.037680 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb71b4b-c55f-4e4c-8f7c-960bbed0372e None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:12.038441 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb71b4b-c55f-4e4c-8f7c-960bbed0372e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:12.038722 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb71b4b-c55f-4e4c-8f7c-960bbed0372e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:12.040130 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb71b4b-c55f-4e4c-8f7c-960bbed0372e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:12.061787 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 401/802] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Aug 24 14:20:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:12.061787 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb71b4b-c55f-4e4c-8f7c-960bbed0372e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:12.084026 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:12.099115 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdd5f3-d484-46a1-b547-dcdcd04ffc9f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:12.133822 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa52dbf-b9ce-4b95-8e6a-8b2ed5b91bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:12.134423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa52dbf-b9ce-4b95-8e6a-8b2ed5b91bef None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:12.134702 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa52dbf-b9ce-4b95-8e6a-8b2ed5b91bef None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:12.134984 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa52dbf-b9ce-4b95-8e6a-8b2ed5b91bef None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:12.135646 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa52dbf-b9ce-4b95-8e6a-8b2ed5b91bef None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:12.135947 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa52dbf-b9ce-4b95-8e6a-8b2ed5b91bef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:12.138094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa52dbf-b9ce-4b95-8e6a-8b2ed5b91bef None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:12.141455 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:12.146477 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 402/803] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:20:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:12.147688 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff5766-d513-4ca4-bdf4-1f5ce0bbccde None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:12.147976 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff5766-d513-4ca4-bdf4-1f5ce0bbccde None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:12.148240 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff5766-d513-4ca4-bdf4-1f5ce0bbccde None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:12.149668 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 403/804] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:12.150658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfecf0-813f-404b-ba27-af33cc0cbf42 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:12.154420 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfecf0-813f-404b-ba27-af33cc0cbf42 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:12.154420 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfecf0-813f-404b-ba27-af33cc0cbf42 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:12.154420 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 404/805] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:12.154420 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfecf0-813f-404b-ba27-af33cc0cbf42 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:12.165249 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb71b4b-c55f-4e4c-8f7c-960bbed0372e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:12.200235 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f2264-74f0-4260-bfc0-5563ca5fe0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:12.200896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f2264-74f0-4260-bfc0-5563ca5fe0ca None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:12.201186 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f2264-74f0-4260-bfc0-5563ca5fe0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:12.201484 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f2264-74f0-4260-bfc0-5563ca5fe0ca None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:12.202212 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f2264-74f0-4260-bfc0-5563ca5fe0ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:12.202517 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f2264-74f0-4260-bfc0-5563ca5fe0ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:12.203931 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f2264-74f0-4260-bfc0-5563ca5fe0ca None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:12.215724 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 402/806] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:20:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:12.216611 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f2264-74f0-4260-bfc0-5563ca5fe0ca None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:12.260681 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfecf0-813f-404b-ba27-af33cc0cbf42 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:12.295130 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d6b68-cf60-40db-8087-40424d578961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:12.295751 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d6b68-cf60-40db-8087-40424d578961 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:12.296080 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d6b68-cf60-40db-8087-40424d578961 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:12.296357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d6b68-cf60-40db-8087-40424d578961 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:12.306988 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d6b68-cf60-40db-8087-40424d578961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:12.308438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d6b68-cf60-40db-8087-40424d578961 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:12.315186 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:12.315851 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f2264-74f0-4260-bfc0-5563ca5fe0ca None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:12.324023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-c36d6b68-cf60-40db-8087-40424d578961 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:12.324023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:12.324023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:12.324023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:12.324023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:12.324023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:12.324023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:12.324023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:12.324023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:12.324023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:12.324023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:12.324023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:12.324023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:12.324023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:12.324023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:12.324023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:12.328381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:12.328381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:12.328381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:12.328381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:12.328381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:12.328381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:12.328381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:12.328381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:12.328381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:12.328381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:12.328381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:12.328381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:12.328381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:12.328381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:12.328381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:12.328381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:12.328381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:12.329517 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:12.329517 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:12.329517 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:12.329517 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 405/807] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:12.329517 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5197ac-21e0-4d64-93a5-32213587fde7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:12.330089 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5197ac-21e0-4d64-93a5-32213587fde7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:12.330381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5197ac-21e0-4d64-93a5-32213587fde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:12.348433 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ff5197ac-21e0-4d64-93a5-32213587fde7 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:12.349559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ff5197ac-21e0-4d64-93a5-32213587fde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:12.350608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9b642-2ed4-422d-bd43-e629ed547194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:12.351231 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9b642-2ed4-422d-bd43-e629ed547194 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:12.351507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9b642-2ed4-422d-bd43-e629ed547194 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:12.351777 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9b642-2ed4-422d-bd43-e629ed547194 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:12.360521 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:12.362599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9b642-2ed4-422d-bd43-e629ed547194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:12.364036 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9b642-2ed4-422d-bd43-e629ed547194 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:12.378293 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-75a9b642-2ed4-422d-bd43-e629ed547194 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:12.378293 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:12.378293 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:12.378293 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:12.378293 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:12.378293 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:12.378293 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:12.378293 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:12.378293 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:12.378293 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:12.378293 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:12.378293 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:12.378293 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:12.378293 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:12.378293 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:12.378293 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:12.379256 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:12.379256 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:12.379256 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:12.379256 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:12.379256 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:12.379256 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:12.379256 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:12.379256 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:12.379256 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:12.379256 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:12.379256 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:12.379256 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:12.379256 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:12.379256 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:12.379256 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:12.379256 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:12.379256 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:12.380144 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:12.380144 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:12.380144 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:12.380144 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 403/808] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:12.380803 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f82d9-5242-45bb-b1c4-62af8d6cd0ed None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:12.380803 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f82d9-5242-45bb-b1c4-62af8d6cd0ed None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:12.381085 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f82d9-5242-45bb-b1c4-62af8d6cd0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:12.401065 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-8b3f82d9-5242-45bb-b1c4-62af8d6cd0ed None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:12.402277 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-8b3f82d9-5242-45bb-b1c4-62af8d6cd0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:12.420513 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 406/809] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:20:12.421319 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5197ac-21e0-4d64-93a5-32213587fde7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:12.470702 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 404/810] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:20:12.471730 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f82d9-5242-45bb-b1c4-62af8d6cd0ed None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:12.562769 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5197ac-21e0-4d64-93a5-32213587fde7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:12.584428 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f82d9-5242-45bb-b1c4-62af8d6cd0ed None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:12.598312 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:12.614044 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a847de-dff5-4ffe-93c9-e8ec2d1c6cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:12.614247 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:12.614332 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a847de-dff5-4ffe-93c9-e8ec2d1c6cff None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:12.614332 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a847de-dff5-4ffe-93c9-e8ec2d1c6cff None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:12.614332 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a847de-dff5-4ffe-93c9-e8ec2d1c6cff None admin] PATH_INFO: `/v3/projects/34cce205e8ee4ae9b09bb89bc4bb081e/users/6b3c32ecfdcf40629f09a7f52b2b5fa8/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:12.614332 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a847de-dff5-4ffe-93c9-e8ec2d1c6cff None admin] RBAC: Authorizing `identity:create_grant(project_id=34cce205e8ee4ae9b09bb89bc4bb081e, user_id=6b3c32ecfdcf40629f09a7f52b2b5fa8, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:12.616188 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a847de-dff5-4ffe-93c9-e8ec2d1c6cff None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:12.621925 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab16c4d-62c0-4253-ab6a-ba6e667a770f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:12.622534 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab16c4d-62c0-4253-ab6a-ba6e667a770f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:12.622815 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab16c4d-62c0-4253-ab6a-ba6e667a770f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:12.623089 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab16c4d-62c0-4253-ab6a-ba6e667a770f None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:12.623730 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab16c4d-62c0-4253-ab6a-ba6e667a770f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:12.624031 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab16c4d-62c0-4253-ab6a-ba6e667a770f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:12.625429 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab16c4d-62c0-4253-ab6a-ba6e667a770f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:12.637781 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 405/811] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:12.638400 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab16c4d-62c0-4253-ab6a-ba6e667a770f None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:12.698514 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 407/812] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 14:20:12 2022] PUT /identity/v3/projects/34cce205e8ee4ae9b09bb89bc4bb081e/users/6b3c32ecfdcf40629f09a7f52b2b5fa8/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:20:12.700809 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a847de-dff5-4ffe-93c9-e8ec2d1c6cff None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:12.759883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab16c4d-62c0-4253-ab6a-ba6e667a770f None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:12.800224 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a8378-c06c-4a52-8d0f-b35601d25256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:12.800959 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a8378-c06c-4a52-8d0f-b35601d25256 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:12.801240 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a8378-c06c-4a52-8d0f-b35601d25256 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:12.801512 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a8378-c06c-4a52-8d0f-b35601d25256 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:12.802196 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a8378-c06c-4a52-8d0f-b35601d25256 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:12.802509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a8378-c06c-4a52-8d0f-b35601d25256 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:12.804079 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a8378-c06c-4a52-8d0f-b35601d25256 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:12.818187 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 406/813] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:12.819057 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a8378-c06c-4a52-8d0f-b35601d25256 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:12.826665 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a847de-dff5-4ffe-93c9-e8ec2d1c6cff None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:12.868746 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f1171-6734-4846-86f9-53781fb21815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:12.869308 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f1171-6734-4846-86f9-53781fb21815 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:12.869593 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f1171-6734-4846-86f9-53781fb21815 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:12.869905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f1171-6734-4846-86f9-53781fb21815 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:12.874254 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:12.879889 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f1171-6734-4846-86f9-53781fb21815 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:12.881374 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f1171-6734-4846-86f9-53781fb21815 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:12.892664 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-6f9f1171-6734-4846-86f9-53781fb21815 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:12.892664 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:12.892664 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:12.892664 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:12.892664 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:12.892664 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:12.892664 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:12.892664 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:12.892664 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:12.892664 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:12.892664 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:12.892664 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:12.892664 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:20:12.892664 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:20:12.892664 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:20:12.893743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:20:12.893743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:12.893743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:12.893743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:12.893743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:12.893743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:12.893743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:12.893743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:12.893743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:12.893743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:12.893743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:12.893743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:12.893743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:12.893743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:12.893743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:12.893743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:12.893743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:12.894679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:20:12.894679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:20:12.894679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:20:12.894679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:20:12.894679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:20:12.894679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:20:12.894679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:12.894679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:12.894679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 408/814] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:20:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:12.895167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f1171-6734-4846-86f9-53781fb21815 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:12.939854 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a8378-c06c-4a52-8d0f-b35601d25256 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:12.951599 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:12.976624 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15796776-30b4-4346-8cc8-9e7399e89f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:12.977257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15796776-30b4-4346-8cc8-9e7399e89f60 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:12.977537 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15796776-30b4-4346-8cc8-9e7399e89f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:12.977838 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15796776-30b4-4346-8cc8-9e7399e89f60 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:12.978423 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15796776-30b4-4346-8cc8-9e7399e89f60 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:12.979789 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15796776-30b4-4346-8cc8-9e7399e89f60 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:12.991371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-15796776-30b4-4346-8cc8-9e7399e89f60 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 14:20:12.991371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:12.991371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:20:12.991371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:20:12.991371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:20:12.991371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:20:12.991371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:20:12.991371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:12.991371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 14:20:12.991371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:12.991371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:20:12.991371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:12.991371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:12.991371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:12.991371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:12.991371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:12.991371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:13.010044 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:13.010044 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:13.010044 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:13.010044 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:13.010044 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:13.010044 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:13.010044 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:20:13.010044 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:20:13.010044 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:20:13.010044 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:20:13.010044 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:13.010044 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:13.010044 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:13.010044 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:13.010044 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:13.010044 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:13.010877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:13.010877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:13.010877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:13.010877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:13.010877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:13.010877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:13.010877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:13.010877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:13.010877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:13.010877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:13.010877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:20:13.010877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:13.010877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 14:20:13.010877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:13.010877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 407/815] 10.222.0.65 () {56 vars in 1129 bytes} [Wed Aug 24 14:20:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:13.011655 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15796776-30b4-4346-8cc8-9e7399e89f60 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:13.011860 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f1171-6734-4846-86f9-53781fb21815 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:13.043546 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a4557-7e78-4e2d-bbd7-3bdcd58edfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:13.044352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a4557-7e78-4e2d-bbd7-3bdcd58edfa4 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:13.044630 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a4557-7e78-4e2d-bbd7-3bdcd58edfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:13.044903 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a4557-7e78-4e2d-bbd7-3bdcd58edfa4 None admin] PATH_INFO: `/v3/services/network` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:13.045488 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a4557-7e78-4e2d-bbd7-3bdcd58edfa4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:13.046880 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a4557-7e78-4e2d-bbd7-3bdcd58edfa4 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:13.055635 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-8a3a4557-7e78-4e2d-bbd7-3bdcd58edfa4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 14:20:13.055635 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:13.055635 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:20:13.055635 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:20:13.055635 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:20:13.055635 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:20:13.055635 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:20:13.055635 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:13.055635 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 14:20:13.055635 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:13.055635 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:20:13.055635 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:13.055635 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:13.055635 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:13.055635 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:13.055635 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:13.055635 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:13.056856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:13.056856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:13.056856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:13.056856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:13.056856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:13.056856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:13.056856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:20:13.056856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:20:13.056856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:20:13.056856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:20:13.056856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:13.056856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:13.056856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:13.056856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:13.056856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:13.056856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:13.057905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:13.057905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:13.057905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:13.057905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:13.057905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:13.057905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:13.057905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:13.057905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:13.057905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:13.057905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:13.057905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:20:13.057905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:13.057905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 14:20:13.057905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:13.061829 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 409/816] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:20:12 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:13.062673 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a4557-7e78-4e2d-bbd7-3bdcd58edfa4 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:13.110593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15796776-30b4-4346-8cc8-9e7399e89f60 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:13.118709 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:13.148166 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e378da-3a0a-4927-aa88-55b560f4ce1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:13.149219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e378da-3a0a-4927-aa88-55b560f4ce1a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:13.150031 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e378da-3a0a-4927-aa88-55b560f4ce1a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:13.150303 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e378da-3a0a-4927-aa88-55b560f4ce1a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:13.158625 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e378da-3a0a-4927-aa88-55b560f4ce1a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:13.160051 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e378da-3a0a-4927-aa88-55b560f4ce1a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:13.169875 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a4557-7e78-4e2d-bbd7-3bdcd58edfa4 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:13.171649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-46e378da-3a0a-4927-aa88-55b560f4ce1a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:20:13.171649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:13.171649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:13.171649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:13.171649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:13.171649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:13.171649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:13.171649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:13.171649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:13.171649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:13.171649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:13.171649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:13.171649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:20:13.171649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:20:13.171649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:20:13.171649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:20:13.172578 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:13.172578 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:13.172578 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:20:13.172578 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:13.172578 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:20:13.172578 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:13.172578 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:13.172578 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:13.172578 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:13.172578 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:13.172578 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:13.172578 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:13.172578 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:13.172578 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:13.172578 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:13.172578 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:13.172578 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:13.172578 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:13.173533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:13.173533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:13.173533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:20:13.173533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:20:13.173533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:20:13.173533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:20:13.173533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:20:13.173533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:20:13.173533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:20:13.173533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:13.173533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 408/817] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Aug 24 14:20:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:13.173533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e378da-3a0a-4927-aa88-55b560f4ce1a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:13.190336 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:13.212541 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b4ce9-374f-4939-a4ff-3a3f54685b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:13.213145 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b4ce9-374f-4939-a4ff-3a3f54685b35 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:13.213423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b4ce9-374f-4939-a4ff-3a3f54685b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:13.213691 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b4ce9-374f-4939-a4ff-3a3f54685b35 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:13.214442 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b4ce9-374f-4939-a4ff-3a3f54685b35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:13.214745 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b4ce9-374f-4939-a4ff-3a3f54685b35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:13.216948 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b4ce9-374f-4939-a4ff-3a3f54685b35 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:13.229175 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 410/818] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:20:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:13.230016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b4ce9-374f-4939-a4ff-3a3f54685b35 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:13.289761 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e378da-3a0a-4927-aa88-55b560f4ce1a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:13.328929 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65e499-8a11-42f9-9e6c-67b7a79bd16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:13.329802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65e499-8a11-42f9-9e6c-67b7a79bd16f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:13.330271 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65e499-8a11-42f9-9e6c-67b7a79bd16f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:13.330552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65e499-8a11-42f9-9e6c-67b7a79bd16f None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:13.331187 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65e499-8a11-42f9-9e6c-67b7a79bd16f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:13.331489 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65e499-8a11-42f9-9e6c-67b7a79bd16f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:13.332854 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65e499-8a11-42f9-9e6c-67b7a79bd16f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:13.337778 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b4ce9-374f-4939-a4ff-3a3f54685b35 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:13.337900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 409/819] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Aug 24 14:20:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:13.343439 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65e499-8a11-42f9-9e6c-67b7a79bd16f None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:13.373586 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:13.380320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0a282-61d1-41ff-8f83-fc95056209d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:13.380923 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0a282-61d1-41ff-8f83-fc95056209d6 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:13.381494 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0a282-61d1-41ff-8f83-fc95056209d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:13.381494 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0a282-61d1-41ff-8f83-fc95056209d6 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:13.382087 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0a282-61d1-41ff-8f83-fc95056209d6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:13.382384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0a282-61d1-41ff-8f83-fc95056209d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:13.383789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0a282-61d1-41ff-8f83-fc95056209d6 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:13.389920 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 411/820] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 14:20:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:13.390766 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0a282-61d1-41ff-8f83-fc95056209d6 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:13.428860 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:13.450787 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65e499-8a11-42f9-9e6c-67b7a79bd16f None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:13.485588 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f40aa8-e614-4b87-b7f3-8e53a01e607b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:13.486213 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f40aa8-e614-4b87-b7f3-8e53a01e607b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:13.486493 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f40aa8-e614-4b87-b7f3-8e53a01e607b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:13.486763 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f40aa8-e614-4b87-b7f3-8e53a01e607b None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:13.487491 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f40aa8-e614-4b87-b7f3-8e53a01e607b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:13.487794 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f40aa8-e614-4b87-b7f3-8e53a01e607b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:13.489254 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f40aa8-e614-4b87-b7f3-8e53a01e607b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:13.501039 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0a282-61d1-41ff-8f83-fc95056209d6 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:13.506539 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 410/821] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Aug 24 14:20:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:13.507340 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f40aa8-e614-4b87-b7f3-8e53a01e607b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:13.542934 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9157dfa-a1a9-4864-af78-cd67dd518151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:13.544688 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9157dfa-a1a9-4864-af78-cd67dd518151 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:13.545275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9157dfa-a1a9-4864-af78-cd67dd518151 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:13.545553 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9157dfa-a1a9-4864-af78-cd67dd518151 None admin] PATH_INFO: `/v3/projects/34cce205e8ee4ae9b09bb89bc4bb081e/users/477ab357d285415e8c0c82d414d242ba/roles/0df7ee13692d4eb5a741a8b79fd58d58` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:13.561128 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9157dfa-a1a9-4864-af78-cd67dd518151 None admin] RBAC: Authorizing `identity:create_grant(project_id=34cce205e8ee4ae9b09bb89bc4bb081e, user_id=477ab357d285415e8c0c82d414d242ba, role_id=0df7ee13692d4eb5a741a8b79fd58d58)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:13.562598 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9157dfa-a1a9-4864-af78-cd67dd518151 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:13.597553 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:13.609693 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f40aa8-e614-4b87-b7f3-8e53a01e607b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:13.639892 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 412/822] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 14:20:13 2022] PUT /identity/v3/projects/34cce205e8ee4ae9b09bb89bc4bb081e/users/477ab357d285415e8c0c82d414d242ba/roles/0df7ee13692d4eb5a741a8b79fd58d58 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:20:13.645035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3fb52-ffbf-4171-9670-4cd220846845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:13.645846 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3fb52-ffbf-4171-9670-4cd220846845 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:13.646224 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3fb52-ffbf-4171-9670-4cd220846845 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:13.646657 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3fb52-ffbf-4171-9670-4cd220846845 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:13.647351 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3fb52-ffbf-4171-9670-4cd220846845 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:13.647716 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3fb52-ffbf-4171-9670-4cd220846845 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:13.649198 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3fb52-ffbf-4171-9670-4cd220846845 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:13.650807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9157dfa-a1a9-4864-af78-cd67dd518151 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:13.660690 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 411/823] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Aug 24 14:20:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:13.660690 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3fb52-ffbf-4171-9670-4cd220846845 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:13.783941 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3fb52-ffbf-4171-9670-4cd220846845 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:13.796661 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:13.816974 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9157dfa-a1a9-4864-af78-cd67dd518151 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:13.828206 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287deba5-232e-4e06-a66f-a171159efb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:13.828880 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287deba5-232e-4e06-a66f-a171159efb07 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:13.829167 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287deba5-232e-4e06-a66f-a171159efb07 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:13.829440 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287deba5-232e-4e06-a66f-a171159efb07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:13.853279 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:13.858305 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4019ee0-bb96-4c41-be31-e881b0b60610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:13.858915 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4019ee0-bb96-4c41-be31-e881b0b60610 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:13.859196 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4019ee0-bb96-4c41-be31-e881b0b60610 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:13.859521 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4019ee0-bb96-4c41-be31-e881b0b60610 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:13.860156 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4019ee0-bb96-4c41-be31-e881b0b60610 None admin] RBAC: Adding query filter params (type=network) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:13.860582 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4019ee0-bb96-4c41-be31-e881b0b60610 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:13.861976 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4019ee0-bb96-4c41-be31-e881b0b60610 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:13.867124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 413/824] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 14:20:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:13.867919 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4019ee0-bb96-4c41-be31-e881b0b60610 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:13.913371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287deba5-232e-4e06-a66f-a171159efb07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:13.915205 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287deba5-232e-4e06-a66f-a171159efb07 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:14.004274 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4019ee0-bb96-4c41-be31-e881b0b60610 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:14.034335 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 412/825] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:20:13 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:20:14.035108 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287deba5-232e-4e06-a66f-a171159efb07 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:14.045280 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd3664-77b2-4cef-baf7-2ae8e4557b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:14.046043 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd3664-77b2-4cef-baf7-2ae8e4557b22 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:14.046424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd3664-77b2-4cef-baf7-2ae8e4557b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:14.046823 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd3664-77b2-4cef-baf7-2ae8e4557b22 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:14.047595 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd3664-77b2-4cef-baf7-2ae8e4557b22 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:14.049120 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd3664-77b2-4cef-baf7-2ae8e4557b22 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:14.096035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:14.143000 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287deba5-232e-4e06-a66f-a171159efb07 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:14.161941 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 414/826] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:20:13 2022] POST /identity/v3/endpoints => generated 346 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:20:14.163365 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd3664-77b2-4cef-baf7-2ae8e4557b22 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:14.182384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:14.225695 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9aa5d-3b41-49ad-8714-4bb18d46945f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:14.226372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9aa5d-3b41-49ad-8714-4bb18d46945f None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:14.226654 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9aa5d-3b41-49ad-8714-4bb18d46945f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:14.226925 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9aa5d-3b41-49ad-8714-4bb18d46945f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:14.227600 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9aa5d-3b41-49ad-8714-4bb18d46945f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:14.228984 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9aa5d-3b41-49ad-8714-4bb18d46945f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:14.324199 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd3664-77b2-4cef-baf7-2ae8e4557b22 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:14.332840 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 413/827] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:20:14 2022] POST /identity/v3/endpoints => generated 337 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:20:14.390121 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9a429-59cd-4bb5-9330-62403f1e8ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:14.390767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9a429-59cd-4bb5-9330-62403f1e8ef1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:14.391044 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9a429-59cd-4bb5-9330-62403f1e8ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:14.391312 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9a429-59cd-4bb5-9330-62403f1e8ef1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:14.403188 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9a429-59cd-4bb5-9330-62403f1e8ef1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:14.404695 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9a429-59cd-4bb5-9330-62403f1e8ef1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:14.421260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-10e9a429-59cd-4bb5-9330-62403f1e8ef1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:14.421260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:14.421260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:14.421260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:14.421260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:14.421260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:14.421260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:14.421260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:14.421260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:14.421260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:14.421260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:14.421260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:14.421260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:14.421260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:14.421260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:14.421260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:14.422383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:14.422383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:14.422383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:14.422383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:14.422383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:14.422383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:14.422383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:14.422383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:14.422383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:14.422383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:14.422383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:14.422383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:14.422383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:14.422383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:14.422383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:14.422383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:14.422383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:14.424036 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:14.424036 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:14.424036 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:14.424036 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 415/828] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:14.430223 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9aa5d-3b41-49ad-8714-4bb18d46945f None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:14.554046 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9aa5d-3b41-49ad-8714-4bb18d46945f None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:14.556585 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:14.589242 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867e893-7d0e-44c7-896b-19162f3288d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:14.590013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867e893-7d0e-44c7-896b-19162f3288d5 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:14.590398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867e893-7d0e-44c7-896b-19162f3288d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:14.590826 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867e893-7d0e-44c7-896b-19162f3288d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:14.591593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867e893-7d0e-44c7-896b-19162f3288d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:14.591996 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867e893-7d0e-44c7-896b-19162f3288d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:14.593460 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867e893-7d0e-44c7-896b-19162f3288d5 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:14.607072 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 414/829] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:14.612616 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9a429-59cd-4bb5-9330-62403f1e8ef1 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:14.682843 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:14.704263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e002f4-a850-40f4-bbba-fc0ac0cb530a None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:14.704536 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e002f4-a850-40f4-bbba-fc0ac0cb530a None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:14.704807 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e002f4-a850-40f4-bbba-fc0ac0cb530a None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:14.706467 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 415/830] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:20:14.711915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3d625-14bf-4317-9422-d4be1fc2b46c None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:14.712194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3d625-14bf-4317-9422-d4be1fc2b46c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:14.712464 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3d625-14bf-4317-9422-d4be1fc2b46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:14.722394 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9a429-59cd-4bb5-9330-62403f1e8ef1 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:14.735042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-15f3d625-14bf-4317-9422-d4be1fc2b46c None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:14.736244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-15f3d625-14bf-4317-9422-d4be1fc2b46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:14.764557 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c4551-3ab8-497b-bd1f-f55024bec2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:14.765411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c4551-3ab8-497b-bd1f-f55024bec2b3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:14.765889 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c4551-3ab8-497b-bd1f-f55024bec2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:14.766280 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c4551-3ab8-497b-bd1f-f55024bec2b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:14.773795 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c4551-3ab8-497b-bd1f-f55024bec2b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:14.775656 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c4551-3ab8-497b-bd1f-f55024bec2b3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:14.788131 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-796c4551-3ab8-497b-bd1f-f55024bec2b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:14.788131 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:14.788131 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:14.788131 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:14.788131 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:14.788131 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:14.788131 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:14.788131 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:14.788131 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:14.788131 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:14.788131 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:14.788131 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:14.788131 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:20:14.788131 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:20:14.788131 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:20:14.789368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:20:14.789368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:14.789368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:14.789368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:14.789368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:14.789368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:14.789368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:14.789368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:14.789368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:14.789368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:14.789368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:14.789368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:14.789368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:14.789368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:14.789368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:14.789368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:14.789368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:14.790519 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:20:14.790519 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:20:14.790519 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:20:14.790519 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:20:14.790519 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:20:14.790519 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:20:14.790519 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:14.790519 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:14.792198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 416/831] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:20:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:20:14.798610 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c4551-3ab8-497b-bd1f-f55024bec2b3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:14.816273 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 416/832] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:20:14.912044 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c4551-3ab8-497b-bd1f-f55024bec2b3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:14.927221 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:14.948717 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09eb651-2d46-4036-9d5c-377ed5dfd472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:14.949575 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09eb651-2d46-4036-9d5c-377ed5dfd472 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:14.949979 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09eb651-2d46-4036-9d5c-377ed5dfd472 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:14.950369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09eb651-2d46-4036-9d5c-377ed5dfd472 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:14.951171 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09eb651-2d46-4036-9d5c-377ed5dfd472 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:14.951577 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09eb651-2d46-4036-9d5c-377ed5dfd472 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:14.953180 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09eb651-2d46-4036-9d5c-377ed5dfd472 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:14.966609 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 417/833] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:20:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:14.972741 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3d625-14bf-4317-9422-d4be1fc2b46c None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:15.078189 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:15.085452 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3d625-14bf-4317-9422-d4be1fc2b46c None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:15.102785 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09eb651-2d46-4036-9d5c-377ed5dfd472 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:15.120814 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b44b80-be8f-4233-8c17-a8e3cc2602eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:15.122295 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b44b80-be8f-4233-8c17-a8e3cc2602eb None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:15.122295 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b44b80-be8f-4233-8c17-a8e3cc2602eb None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:15.122580 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b44b80-be8f-4233-8c17-a8e3cc2602eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:15.123356 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b44b80-be8f-4233-8c17-a8e3cc2602eb None admin] RBAC: Adding query filter params (role.id=b779073cee3c470ca4ad7a7b27d72c5e, scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e, user.id=8d099678d6454f7eb494892a69feaf62) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:15.123669 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b44b80-be8f-4233-8c17-a8e3cc2602eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:15.125098 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b44b80-be8f-4233-8c17-a8e3cc2602eb None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:15.131851 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 417/834] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:20:14 2022] GET /identity/v3/role_assignments?user.id=8d099678d6454f7eb494892a69feaf62&scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e&role.id=b779073cee3c470ca4ad7a7b27d72c5e => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:15.226073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09eb651-2d46-4036-9d5c-377ed5dfd472 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:15.269015 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e8d10-6dac-4169-9e26-0a607b9d89e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:15.269673 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e8d10-6dac-4169-9e26-0a607b9d89e4 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:15.269989 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e8d10-6dac-4169-9e26-0a607b9d89e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:15.270262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e8d10-6dac-4169-9e26-0a607b9d89e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:15.283328 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e8d10-6dac-4169-9e26-0a607b9d89e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:20:15.288209 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-124e8d10-6dac-4169-9e26-0a607b9d89e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:20:15.288209 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:15.288209 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:15.288209 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:15.288209 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:15.288209 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:15.288209 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:15.288209 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:15.288209 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:15.288209 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:15.288209 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:15.288209 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:15.288209 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:20:15.288209 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:20:15.288209 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:20:15.288209 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:20:15.289166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:20:15.289166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:20:15.289166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:20:15.289166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:20:15.289166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:15.289166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:15.289166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:15.289166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:15.289166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:15.289166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:15.289166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:15.289166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:15.289166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:15.289166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:15.289166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:15.289166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:15.290573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:15.290573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:15.290573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:15.290573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:15.290573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:20:15.290573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:20:15.290573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:20:15.290573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:20:15.290573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:20:15.290573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:20:15.290573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:20:15.290573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:15.290573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 418/835] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:20:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:15.295884 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b44b80-be8f-4233-8c17-a8e3cc2602eb None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:15.407077 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b44b80-be8f-4233-8c17-a8e3cc2602eb None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:15.443004 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5b917-f0bf-45fc-8cc6-4ed6d7e6af00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:15.443965 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5b917-f0bf-45fc-8cc6-4ed6d7e6af00 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:15.444408 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5b917-f0bf-45fc-8cc6-4ed6d7e6af00 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:15.447135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5b917-f0bf-45fc-8cc6-4ed6d7e6af00 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:15.447135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5b917-f0bf-45fc-8cc6-4ed6d7e6af00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:15.447135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5b917-f0bf-45fc-8cc6-4ed6d7e6af00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:15.447677 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5b917-f0bf-45fc-8cc6-4ed6d7e6af00 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:15.457295 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 418/836] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:20:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:15.463305 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e8d10-6dac-4169-9e26-0a607b9d89e4 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:15.522251 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:15.577437 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e8d10-6dac-4169-9e26-0a607b9d89e4 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:15.616507 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a8840-104e-47d3-a9a1-07bfe5feb6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:15.617512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a8840-104e-47d3-a9a1-07bfe5feb6bd None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:15.618034 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a8840-104e-47d3-a9a1-07bfe5feb6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:15.618518 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a8840-104e-47d3-a9a1-07bfe5feb6bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:15.630444 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a8840-104e-47d3-a9a1-07bfe5feb6bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:15.632138 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a8840-104e-47d3-a9a1-07bfe5feb6bd None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:15.647300 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-ea8a8840-104e-47d3-a9a1-07bfe5feb6bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:15.647300 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:15.647300 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:15.647300 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:15.647300 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:15.647300 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:15.647300 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:15.647300 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:15.647300 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:15.647300 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:15.647300 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:15.647300 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:15.647300 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:15.647300 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:15.647300 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:15.647300 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:15.648271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:15.648271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:15.648271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:15.648271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:15.648271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:15.648271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:15.648271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:15.648271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:15.648271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:15.648271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:15.648271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:15.648271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:15.648271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:15.648271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:15.648271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:15.648271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:15.648271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:15.649148 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:15.649148 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:15.649148 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:15.651226 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 419/837] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:15.657566 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5b917-f0bf-45fc-8cc6-4ed6d7e6af00 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:15.686126 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:15.738890 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041c0df-52c8-404e-a7ae-9bf45ff7b824 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:15.739544 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041c0df-52c8-404e-a7ae-9bf45ff7b824 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:15.740595 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041c0df-52c8-404e-a7ae-9bf45ff7b824 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:15.742736 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 420/838] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:20:15.748620 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06376bc0-40ff-476c-bc05-2ddb25124b79 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:15.748911 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06376bc0-40ff-476c-bc05-2ddb25124b79 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:15.749185 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06376bc0-40ff-476c-bc05-2ddb25124b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:15.767398 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-06376bc0-40ff-476c-bc05-2ddb25124b79 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:15.768582 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-06376bc0-40ff-476c-bc05-2ddb25124b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:15.772884 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5b917-f0bf-45fc-8cc6-4ed6d7e6af00 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:15.817443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0568693-f0ea-40e5-a24d-036ddf1c5d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:15.818624 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0568693-f0ea-40e5-a24d-036ddf1c5d05 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:15.819385 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0568693-f0ea-40e5-a24d-036ddf1c5d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:15.819860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0568693-f0ea-40e5-a24d-036ddf1c5d05 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:15.820701 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0568693-f0ea-40e5-a24d-036ddf1c5d05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:15.821196 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0568693-f0ea-40e5-a24d-036ddf1c5d05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:15.823491 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0568693-f0ea-40e5-a24d-036ddf1c5d05 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:15.839516 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 419/839] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:15.845094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 421/840] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:20:15.846303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06376bc0-40ff-476c-bc05-2ddb25124b79 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:15.878393 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:15.951223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06376bc0-40ff-476c-bc05-2ddb25124b79 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:15.986015 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df115f49-fc5a-4030-90bb-6b14fe7f1b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:15.986875 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df115f49-fc5a-4030-90bb-6b14fe7f1b32 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:15.987297 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df115f49-fc5a-4030-90bb-6b14fe7f1b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:15.987711 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df115f49-fc5a-4030-90bb-6b14fe7f1b32 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:15.994996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df115f49-fc5a-4030-90bb-6b14fe7f1b32 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:15.996767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df115f49-fc5a-4030-90bb-6b14fe7f1b32 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:16.008549 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-df115f49-fc5a-4030-90bb-6b14fe7f1b32 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 14:20:16.008549 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:16.008549 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:16.008549 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:16.008549 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:16.008549 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:16.008549 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:16.008549 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:16.008549 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:16.008549 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:16.008549 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:16.008549 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:16.008549 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:20:16.008549 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:20:16.008549 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:20:16.008549 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:20:16.009678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:16.009678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:16.009678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:20:16.009678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:16.009678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:20:16.009678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:16.009678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:16.009678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:16.009678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:16.009678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:16.009678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:16.009678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:16.009678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:16.009678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:16.009678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:16.009678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:16.009678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:16.009678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:16.010657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:16.010657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:16.010657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:20:16.010657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:20:16.010657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:20:16.010657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:20:16.010657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:20:16.010657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:20:16.010657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 14:20:16.010657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:16.011481 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 422/841] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:20:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:16.017405 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0568693-f0ea-40e5-a24d-036ddf1c5d05 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:16.104776 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:16.124077 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df115f49-fc5a-4030-90bb-6b14fe7f1b32 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:16.125184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0568693-f0ea-40e5-a24d-036ddf1c5d05 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:16.171366 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33bb2c-66eb-4974-9041-74437861bedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:16.171976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33bb2c-66eb-4974-9041-74437861bedc None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:16.172255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33bb2c-66eb-4974-9041-74437861bedc None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:16.172532 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33bb2c-66eb-4974-9041-74437861bedc None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:16.173264 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33bb2c-66eb-4974-9041-74437861bedc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:16.173817 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33bb2c-66eb-4974-9041-74437861bedc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:16.175017 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33bb2c-66eb-4974-9041-74437861bedc None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:16.194161 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 420/842] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Aug 24 14:20:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:16.200442 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33bb2c-66eb-4974-9041-74437861bedc None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:16.220627 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:16.250114 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df115f49-fc5a-4030-90bb-6b14fe7f1b32 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:16.296036 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97e206-d21e-41f3-b344-4becda01bf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:16.297472 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97e206-d21e-41f3-b344-4becda01bf11 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:16.297775 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97e206-d21e-41f3-b344-4becda01bf11 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:16.298055 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97e206-d21e-41f3-b344-4becda01bf11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:16.313727 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee97e206-d21e-41f3-b344-4becda01bf11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:20:16.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-ee97e206-d21e-41f3-b344-4becda01bf11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:20:16.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:16.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:16.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:16.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:16.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:16.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:16.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:16.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:16.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:16.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:16.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:16.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:20:16.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:20:16.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:20:16.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:20:16.321151 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:20:16.321151 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:20:16.321151 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:20:16.321151 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:20:16.321151 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:16.321151 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:16.321151 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:16.321151 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:16.321151 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:16.321151 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:16.321151 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:16.321151 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:16.321151 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:16.321151 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:16.321151 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:16.321151 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:16.322029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:16.322029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:16.322029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:16.322029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:16.322029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:20:16.322029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:20:16.322029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:20:16.322029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:20:16.322029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:20:16.322029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:20:16.322029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:20:16.322029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:16.325822 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 423/843] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 14:20:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:16.328652 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97e206-d21e-41f3-b344-4becda01bf11 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:16.342559 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33bb2c-66eb-4974-9041-74437861bedc None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:16.382353 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a29a8-2c20-40ec-82bb-ba0e86d27f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:16.383350 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a29a8-2c20-40ec-82bb-ba0e86d27f0e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:16.383874 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a29a8-2c20-40ec-82bb-ba0e86d27f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:16.384387 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a29a8-2c20-40ec-82bb-ba0e86d27f0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:16.394691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:16.432158 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97e206-d21e-41f3-b344-4becda01bf11 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:16.462778 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a29a8-2c20-40ec-82bb-ba0e86d27f0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:16.465194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a29a8-2c20-40ec-82bb-ba0e86d27f0e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:16.468099 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70390dd-9de8-49f9-9491-fbc5a16ae6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:16.469388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70390dd-9de8-49f9-9491-fbc5a16ae6cf None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:16.469388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70390dd-9de8-49f9-9491-fbc5a16ae6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:16.469388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70390dd-9de8-49f9-9491-fbc5a16ae6cf None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:16.469926 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70390dd-9de8-49f9-9491-fbc5a16ae6cf None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:16.470223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70390dd-9de8-49f9-9491-fbc5a16ae6cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:16.471694 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70390dd-9de8-49f9-9491-fbc5a16ae6cf None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:16.474058 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:16.487998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 424/844] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 14:20:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:16.487998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3b770-4168-4bff-8e83-7271c4a1e08d None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:16.487998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3b770-4168-4bff-8e83-7271c4a1e08d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:16.487998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3b770-4168-4bff-8e83-7271c4a1e08d None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:16.487998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 425/845] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:16.487998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3b770-4168-4bff-8e83-7271c4a1e08d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:16.585038 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 421/846] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:20:16 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:20:16.586463 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d2871-6fb7-457e-9788-e8c7702ccab0 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:16.586746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d2871-6fb7-457e-9788-e8c7702ccab0 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:16.587018 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d2871-6fb7-457e-9788-e8c7702ccab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:16.600737 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3b770-4168-4bff-8e83-7271c4a1e08d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:16.606795 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-647d2871-6fb7-457e-9788-e8c7702ccab0 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:16.607982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-647d2871-6fb7-457e-9788-e8c7702ccab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:16.636940 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343af4e5-6ea2-4210-a032-a22db760db99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:16.637460 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343af4e5-6ea2-4210-a032-a22db760db99 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:16.637743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343af4e5-6ea2-4210-a032-a22db760db99 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:16.638042 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343af4e5-6ea2-4210-a032-a22db760db99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:16.640243 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:16.648265 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343af4e5-6ea2-4210-a032-a22db760db99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:16.649713 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343af4e5-6ea2-4210-a032-a22db760db99 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:16.665611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-343af4e5-6ea2-4210-a032-a22db760db99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:16.665611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:16.665611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:16.665611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:16.665611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:16.665611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:16.665611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:16.665611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:16.665611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:16.665611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:16.665611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:16.665611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:16.665611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:16.665611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:16.665611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:16.665611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:16.666632 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:16.666632 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:16.666632 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:16.666632 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:16.666632 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:16.666632 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:16.666632 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:16.666632 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:16.666632 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:16.666632 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:16.666632 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:16.666632 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:16.666632 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:16.666632 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:16.666632 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:16.666632 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:16.666632 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:16.673473 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:16.673473 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:16.673473 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:16.673473 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 426/847] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:20:16.673473 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343af4e5-6ea2-4210-a032-a22db760db99 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:16.688282 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 422/848] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:20:16.688972 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d2871-6fb7-457e-9788-e8c7702ccab0 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:16.733253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:16.800778 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343af4e5-6ea2-4210-a032-a22db760db99 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:16.811988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d2871-6fb7-457e-9788-e8c7702ccab0 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:16.844901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1632f-d11e-4421-b877-1acb0de2ec26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:16.846449 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1632f-d11e-4421-b877-1acb0de2ec26 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:16.846918 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1632f-d11e-4421-b877-1acb0de2ec26 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:16.847374 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1632f-d11e-4421-b877-1acb0de2ec26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:16.853651 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72730b80-3da7-4387-a991-9b6c5521a622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:16.854366 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72730b80-3da7-4387-a991-9b6c5521a622 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:16.854714 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72730b80-3da7-4387-a991-9b6c5521a622 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:16.855058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72730b80-3da7-4387-a991-9b6c5521a622 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:16.856009 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72730b80-3da7-4387-a991-9b6c5521a622 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:16.856394 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72730b80-3da7-4387-a991-9b6c5521a622 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:16.858121 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72730b80-3da7-4387-a991-9b6c5521a622 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:16.863645 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1632f-d11e-4421-b877-1acb0de2ec26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:16.865358 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1632f-d11e-4421-b877-1acb0de2ec26 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:16.876052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 423/849] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:16.876945 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72730b80-3da7-4387-a991-9b6c5521a622 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:16.882411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-84f1632f-d11e-4421-b877-1acb0de2ec26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:16.882411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:16.882411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:16.882411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:16.882411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:16.882411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:16.882411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:16.882411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:16.882411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:16.882411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:16.882411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:16.882411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:16.882411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:16.882411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:16.882411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:16.882411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:16.883340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:16.883340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:16.883340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:16.883340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:16.883340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:16.883340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:16.883340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:16.883340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:16.883340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:16.883340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:16.883340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:16.883340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:16.883340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:16.883340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:16.883340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:16.883340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:16.883340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:16.884260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:16.884260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:16.884260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:16.886437 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 427/850] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:16.897887 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1632f-d11e-4421-b877-1acb0de2ec26 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:16.908062 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:16.983712 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72730b80-3da7-4387-a991-9b6c5521a622 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:17.020253 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ba9ac-68f6-4ec4-83b0-92493f0db6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:17.020892 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ba9ac-68f6-4ec4-83b0-92493f0db6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:17.021145 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ba9ac-68f6-4ec4-83b0-92493f0db6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:17.021313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1632f-d11e-4421-b877-1acb0de2ec26 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:17.021421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ba9ac-68f6-4ec4-83b0-92493f0db6f1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:17.023543 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:17.029986 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ba9ac-68f6-4ec4-83b0-92493f0db6f1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:17.031517 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ba9ac-68f6-4ec4-83b0-92493f0db6f1 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:17.043426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-424ba9ac-68f6-4ec4-83b0-92493f0db6f1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 14:20:17.043426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:17.043426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:17.043426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:17.043426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:17.043426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:17.043426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:17.043426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:17.043426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:17.043426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:17.043426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:17.043426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:17.043426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:20:17.043426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:20:17.043426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:20:17.043426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:20:17.044571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:17.044571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:17.044571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:20:17.044571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:17.044571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:20:17.044571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:17.044571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:17.044571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:17.044571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:17.044571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:17.044571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:17.044571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:17.044571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:17.044571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:17.044571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:17.044571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:17.044571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:17.044571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:17.045625 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:17.045625 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:17.045625 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:20:17.045625 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:20:17.045625 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:20:17.045625 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:20:17.045625 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:20:17.045625 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:20:17.045625 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 14:20:17.045625 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:17.045625 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 424/851] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Aug 24 14:20:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:17.046803 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ba9ac-68f6-4ec4-83b0-92493f0db6f1 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:17.064664 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856f098-c258-48e0-bf96-6bc72dec77c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:17.065278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856f098-c258-48e0-bf96-6bc72dec77c1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:17.065550 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856f098-c258-48e0-bf96-6bc72dec77c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:17.065846 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856f098-c258-48e0-bf96-6bc72dec77c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:17.066494 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856f098-c258-48e0-bf96-6bc72dec77c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:17.066845 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856f098-c258-48e0-bf96-6bc72dec77c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:17.068292 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856f098-c258-48e0-bf96-6bc72dec77c1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:17.080586 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 428/852] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:17.085841 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856f098-c258-48e0-bf96-6bc72dec77c1 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:17.144764 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:17.157316 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ba9ac-68f6-4ec4-83b0-92493f0db6f1 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:17.190669 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856f098-c258-48e0-bf96-6bc72dec77c1 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:17.191885 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55eaa69-e64c-466c-9b47-740fb299a949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:17.192509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55eaa69-e64c-466c-9b47-740fb299a949 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:17.192790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55eaa69-e64c-466c-9b47-740fb299a949 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:17.193065 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55eaa69-e64c-466c-9b47-740fb299a949 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:17.193645 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55eaa69-e64c-466c-9b47-740fb299a949 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:17.195033 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55eaa69-e64c-466c-9b47-740fb299a949 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:17.204217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-c55eaa69-e64c-466c-9b47-740fb299a949 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 14:20:17.204217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:17.204217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:20:17.204217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:20:17.204217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:20:17.204217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:20:17.204217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:20:17.204217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:17.204217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 14:20:17.204217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:17.204217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:20:17.204217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:17.204217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:17.204217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:17.204217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:17.204217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:17.204217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:17.205401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:17.205401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:17.205401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:17.205401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:17.205401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:17.205401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:17.205401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:20:17.205401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:20:17.205401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:20:17.205401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:20:17.205401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:17.205401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:17.205401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:17.205401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:17.205401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:17.205401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:17.206867 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:17.206867 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:17.206867 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:17.206867 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:17.206867 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:17.206867 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:17.206867 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:17.206867 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:17.206867 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:17.206867 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:17.206867 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:20:17.206867 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:17.206867 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 14:20:17.206867 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:17.206867 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 425/853] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 14:20:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:17.207862 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55eaa69-e64c-466c-9b47-740fb299a949 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:17.229643 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b48c0-62f2-4639-be7b-d98f6484f6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:17.230323 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b48c0-62f2-4639-be7b-d98f6484f6d3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:17.231142 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b48c0-62f2-4639-be7b-d98f6484f6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:17.231412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b48c0-62f2-4639-be7b-d98f6484f6d3 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:17.232321 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b48c0-62f2-4639-be7b-d98f6484f6d3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:17.232625 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b48c0-62f2-4639-be7b-d98f6484f6d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:17.234056 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b48c0-62f2-4639-be7b-d98f6484f6d3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:17.251729 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 429/854] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Aug 24 14:20:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:17.253160 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc5a69-807d-45bd-b583-d0565dad14a7 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:17.253439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc5a69-807d-45bd-b583-d0565dad14a7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:17.253706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc5a69-807d-45bd-b583-d0565dad14a7 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:17.255234 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 430/855] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:17.255945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc5a69-807d-45bd-b583-d0565dad14a7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:17.280379 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:17.318186 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55eaa69-e64c-466c-9b47-740fb299a949 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:17.351449 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce86ea-1a4a-45d5-93d4-1c9cad547f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:17.352064 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce86ea-1a4a-45d5-93d4-1c9cad547f8e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:17.352340 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce86ea-1a4a-45d5-93d4-1c9cad547f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:17.352606 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce86ea-1a4a-45d5-93d4-1c9cad547f8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:17.359602 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce86ea-1a4a-45d5-93d4-1c9cad547f8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:17.360017 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc5a69-807d-45bd-b583-d0565dad14a7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:17.361023 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce86ea-1a4a-45d5-93d4-1c9cad547f8e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:17.372264 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-36ce86ea-1a4a-45d5-93d4-1c9cad547f8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:17.372264 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:17.372264 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:17.372264 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:17.372264 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:17.372264 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:17.372264 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:17.372264 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:17.372264 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:17.372264 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:17.372264 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:17.372264 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:17.372264 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:20:17.372264 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:20:17.372264 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:20:17.373336 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:20:17.373336 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:17.373336 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:17.373336 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:17.373336 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:17.373336 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:17.373336 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:17.373336 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:17.373336 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:17.373336 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:17.373336 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:17.373336 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:17.373336 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:17.373336 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:17.373336 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:17.373336 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:17.373336 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:17.374409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:20:17.374409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:20:17.374409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:20:17.374409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:20:17.374409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:20:17.374409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:20:17.374409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:17.374409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:17.374409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 426/856] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:20:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:17.374912 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e2197-771c-4bd4-ab9f-254495181aee None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:17.375059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e2197-771c-4bd4-ab9f-254495181aee None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:17.375322 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e2197-771c-4bd4-ab9f-254495181aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:17.392803 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-667e2197-771c-4bd4-ab9f-254495181aee None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:17.394015 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-667e2197-771c-4bd4-ab9f-254495181aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:17.398456 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee093111-bf5d-4dca-b85c-c68a1e86f5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:17.399056 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee093111-bf5d-4dca-b85c-c68a1e86f5e4 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:17.399329 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee093111-bf5d-4dca-b85c-c68a1e86f5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:17.399595 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee093111-bf5d-4dca-b85c-c68a1e86f5e4 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:17.400227 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee093111-bf5d-4dca-b85c-c68a1e86f5e4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:17.400525 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee093111-bf5d-4dca-b85c-c68a1e86f5e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:17.401092 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:17.401952 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee093111-bf5d-4dca-b85c-c68a1e86f5e4 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:17.406802 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 431/857] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 14:20:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:17.409240 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee093111-bf5d-4dca-b85c-c68a1e86f5e4 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:17.466449 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 427/858] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:20:17.467286 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e2197-771c-4bd4-ab9f-254495181aee None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:17.494038 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:17.509649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee093111-bf5d-4dca-b85c-c68a1e86f5e4 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:17.545286 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681acf01-89d1-4c2e-82cf-2cddbf09024d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:17.546007 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681acf01-89d1-4c2e-82cf-2cddbf09024d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:17.546349 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681acf01-89d1-4c2e-82cf-2cddbf09024d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:17.546682 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681acf01-89d1-4c2e-82cf-2cddbf09024d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:17.575496 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e2197-771c-4bd4-ab9f-254495181aee None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:17.610469 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650baf6-9d66-4f3b-a0dd-0635399a17fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:17.611065 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650baf6-9d66-4f3b-a0dd-0635399a17fc None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:17.611341 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650baf6-9d66-4f3b-a0dd-0635399a17fc None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:17.611605 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650baf6-9d66-4f3b-a0dd-0635399a17fc None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:17.612284 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650baf6-9d66-4f3b-a0dd-0635399a17fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:17.612589 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650baf6-9d66-4f3b-a0dd-0635399a17fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:17.614043 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650baf6-9d66-4f3b-a0dd-0635399a17fc None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:17.620536 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681acf01-89d1-4c2e-82cf-2cddbf09024d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:17.622636 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681acf01-89d1-4c2e-82cf-2cddbf09024d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:17.625572 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 428/859] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:20:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:17.626543 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650baf6-9d66-4f3b-a0dd-0635399a17fc None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:17.631032 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:17.713207 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:17.727886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650baf6-9d66-4f3b-a0dd-0635399a17fc None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:17.730253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 432/860] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:20:17 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:20:17.731220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681acf01-89d1-4c2e-82cf-2cddbf09024d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:17.768163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b2011-e75e-495c-98f3-0cb168358b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:17.768766 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b2011-e75e-495c-98f3-0cb168358b9a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:17.769045 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b2011-e75e-495c-98f3-0cb168358b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:17.769314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b2011-e75e-495c-98f3-0cb168358b9a None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:17.769975 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b2011-e75e-495c-98f3-0cb168358b9a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:17.770275 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b2011-e75e-495c-98f3-0cb168358b9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:17.771629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b2011-e75e-495c-98f3-0cb168358b9a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:17.775990 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 429/861] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 14:20:17 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:17.776741 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b2011-e75e-495c-98f3-0cb168358b9a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:17.845885 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681acf01-89d1-4c2e-82cf-2cddbf09024d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:17.856714 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:17.885415 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fea8b-0ae8-4b51-a9d6-d998e054638d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:17.886062 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fea8b-0ae8-4b51-a9d6-d998e054638d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:17.886345 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fea8b-0ae8-4b51-a9d6-d998e054638d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:17.886816 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fea8b-0ae8-4b51-a9d6-d998e054638d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:17.887769 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68fea8b-0ae8-4b51-a9d6-d998e054638d None admin] RBAC: Adding query filter params (role.id=b779073cee3c470ca4ad7a7b27d72c5e, scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e, user.id=6b3c32ecfdcf40629f09a7f52b2b5fa8) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:17.888078 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68fea8b-0ae8-4b51-a9d6-d998e054638d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:17.889588 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68fea8b-0ae8-4b51-a9d6-d998e054638d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:17.905791 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 433/862] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:20:17 2022] GET /identity/v3/role_assignments?user.id=6b3c32ecfdcf40629f09a7f52b2b5fa8&scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e&role.id=b779073cee3c470ca4ad7a7b27d72c5e => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:17.905791 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fea8b-0ae8-4b51-a9d6-d998e054638d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:17.906148 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b2011-e75e-495c-98f3-0cb168358b9a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:17.957336 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f162bc4-4d9b-486d-9387-0362f2bbc31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:17.958668 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f162bc4-4d9b-486d-9387-0362f2bbc31a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:17.959147 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f162bc4-4d9b-486d-9387-0362f2bbc31a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:17.959588 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f162bc4-4d9b-486d-9387-0362f2bbc31a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:17.961302 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f162bc4-4d9b-486d-9387-0362f2bbc31a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:17.962826 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f162bc4-4d9b-486d-9387-0362f2bbc31a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:17.976608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-4f162bc4-4d9b-486d-9387-0362f2bbc31a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 14:20:17.976608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:17.976608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:20:17.976608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:20:17.976608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:20:17.976608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:20:17.976608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:20:17.976608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:17.976608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 14:20:17.976608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:17.976608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:20:17.976608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:17.976608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:17.976608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:17.976608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:17.976608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:17.977813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:17.977813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:17.977813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:17.977813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:17.977813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:17.977813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:17.977813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:17.977813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:20:17.977813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:20:17.977813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:20:17.977813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:20:17.977813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:17.977813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:17.977813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:17.977813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:17.977813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:17.977813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:17.978904 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:17.978904 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:17.978904 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:17.978904 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:17.978904 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:17.978904 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:17.978904 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:17.978904 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:17.978904 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:17.978904 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:17.978904 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:20:17.978904 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:17.978904 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 14:20:17.978904 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:17.979801 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:17.979895 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 430/863] 10.222.0.65 () {56 vars in 1132 bytes} [Wed Aug 24 14:20:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:17.987380 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f162bc4-4d9b-486d-9387-0362f2bbc31a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:18.040380 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fea8b-0ae8-4b51-a9d6-d998e054638d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:18.076204 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde28e58-086a-4b93-a24d-a69b07ad9961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:18.076982 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde28e58-086a-4b93-a24d-a69b07ad9961 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:18.077357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde28e58-086a-4b93-a24d-a69b07ad9961 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:18.077723 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde28e58-086a-4b93-a24d-a69b07ad9961 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:18.090213 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde28e58-086a-4b93-a24d-a69b07ad9961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:18.091789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde28e58-086a-4b93-a24d-a69b07ad9961 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:18.107183 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-dde28e58-086a-4b93-a24d-a69b07ad9961 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:18.107183 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:18.107183 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:18.107183 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:18.107183 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:18.107183 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:18.107183 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:18.107183 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:18.107183 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:18.107183 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:18.107183 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:18.107183 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:18.107183 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:18.107183 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:18.107183 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:18.107183 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:18.108378 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:18.108378 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:18.108378 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:18.108378 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:18.108378 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:18.108378 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:18.108378 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:18.108378 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:18.108378 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:18.108378 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:18.108378 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:18.108378 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:18.108378 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:18.108378 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:18.108378 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:18.108378 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:18.108378 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:18.109479 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:18.109479 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:18.109479 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:18.110222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 434/864] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:18.112335 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f162bc4-4d9b-486d-9387-0362f2bbc31a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:18.115538 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde28e58-086a-4b93-a24d-a69b07ad9961 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:18.155024 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:18.164253 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fbb18-00bc-4ba3-b531-778846fa1c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:18.166628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fbb18-00bc-4ba3-b531-778846fa1c31 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:18.166628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fbb18-00bc-4ba3-b531-778846fa1c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:18.166628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fbb18-00bc-4ba3-b531-778846fa1c31 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:18.166628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804fbb18-00bc-4ba3-b531-778846fa1c31 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:18.166628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804fbb18-00bc-4ba3-b531-778846fa1c31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:18.167734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804fbb18-00bc-4ba3-b531-778846fa1c31 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:18.173397 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 431/865] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 14:20:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:18.178911 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fbb18-00bc-4ba3-b531-778846fa1c31 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:18.245246 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:18.250519 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde28e58-086a-4b93-a24d-a69b07ad9961 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:18.289920 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387863c8-8421-4ed9-a6c0-40a5dba52a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:18.290728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387863c8-8421-4ed9-a6c0-40a5dba52a07 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:18.291211 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387863c8-8421-4ed9-a6c0-40a5dba52a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:18.291562 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387863c8-8421-4ed9-a6c0-40a5dba52a07 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:18.292392 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387863c8-8421-4ed9-a6c0-40a5dba52a07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:18.292875 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387863c8-8421-4ed9-a6c0-40a5dba52a07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:18.295104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387863c8-8421-4ed9-a6c0-40a5dba52a07 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:18.301136 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fbb18-00bc-4ba3-b531-778846fa1c31 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:18.315060 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 435/866] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:18.318587 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387863c8-8421-4ed9-a6c0-40a5dba52a07 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:18.349852 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a8f55-0d13-4051-83aa-83583ed02ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:18.350613 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a8f55-0d13-4051-83aa-83583ed02ccb None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:18.351020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a8f55-0d13-4051-83aa-83583ed02ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:18.351391 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a8f55-0d13-4051-83aa-83583ed02ccb None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:18.352129 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a8f55-0d13-4051-83aa-83583ed02ccb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:18.352566 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a8f55-0d13-4051-83aa-83583ed02ccb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:18.354254 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a8f55-0d13-4051-83aa-83583ed02ccb None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:18.365958 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 432/867] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 14:20:18 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:18.453609 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387863c8-8421-4ed9-a6c0-40a5dba52a07 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:18.497561 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d484ef-fd9b-4e2e-b9af-bd73f911c91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:18.498496 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d484ef-fd9b-4e2e-b9af-bd73f911c91d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:18.498921 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d484ef-fd9b-4e2e-b9af-bd73f911c91d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:18.499400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d484ef-fd9b-4e2e-b9af-bd73f911c91d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:18.508019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d484ef-fd9b-4e2e-b9af-bd73f911c91d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:18.510193 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d484ef-fd9b-4e2e-b9af-bd73f911c91d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:18.523432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-39d484ef-fd9b-4e2e-b9af-bd73f911c91d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:18.523432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:18.523432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:18.523432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:18.523432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:18.523432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:18.523432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:18.523432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:18.523432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:18.523432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:18.523432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:18.523432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:18.523432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:20:18.523432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:20:18.523432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:20:18.524526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:20:18.524526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:18.524526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:18.524526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:18.524526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:18.524526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:18.524526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:18.524526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:18.524526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:18.524526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:18.524526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:18.524526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:18.524526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:18.524526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:18.524526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:18.524526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:18.524526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:18.525616 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:20:18.525616 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:20:18.525616 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:20:18.525616 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:20:18.525616 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:20:18.525616 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:20:18.525616 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:18.525616 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:18.528144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 436/868] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:20:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:18.534317 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a8f55-0d13-4051-83aa-83583ed02ccb None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:18.604726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:18.652442 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a8f55-0d13-4051-83aa-83583ed02ccb None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:18.691628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbbb6f-0c98-444e-94ed-b01a4b08a1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:18.692238 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbbb6f-0c98-444e-94ed-b01a4b08a1f8 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:18.692526 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbbb6f-0c98-444e-94ed-b01a4b08a1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:18.692843 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbbb6f-0c98-444e-94ed-b01a4b08a1f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:18.693543 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbbb6f-0c98-444e-94ed-b01a4b08a1f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:18.693870 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbbb6f-0c98-444e-94ed-b01a4b08a1f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:18.695296 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbbb6f-0c98-444e-94ed-b01a4b08a1f8 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:18.710862 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 433/869] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:20:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:18.718751 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d484ef-fd9b-4e2e-b9af-bd73f911c91d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:18.745875 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:18.840320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d484ef-fd9b-4e2e-b9af-bd73f911c91d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:18.883996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cd535-5aba-4204-8924-87943155de70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:18.885018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cd535-5aba-4204-8924-87943155de70 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:18.885253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cd535-5aba-4204-8924-87943155de70 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:18.885670 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cd535-5aba-4204-8924-87943155de70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:18.887056 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1cd535-5aba-4204-8924-87943155de70 None admin] RBAC: Adding query filter params (role.id=0df7ee13692d4eb5a741a8b79fd58d58, scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e, user.id=477ab357d285415e8c0c82d414d242ba) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:18.887469 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1cd535-5aba-4204-8924-87943155de70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:18.889070 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1cd535-5aba-4204-8924-87943155de70 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:18.896237 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 437/870] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:20:18 2022] GET /identity/v3/role_assignments?user.id=477ab357d285415e8c0c82d414d242ba&scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e&role.id=0df7ee13692d4eb5a741a8b79fd58d58 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:19.804306 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818ca95-1bd6-4efe-baab-5b53a152ef47 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:19.805076 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818ca95-1bd6-4efe-baab-5b53a152ef47 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:19.805076 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818ca95-1bd6-4efe-baab-5b53a152ef47 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:19.806452 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 434/871] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:19.811823 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857df20-85ca-4ad7-bd78-3b3d6e93dc1e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:19.812262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857df20-85ca-4ad7-bd78-3b3d6e93dc1e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:19.812417 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857df20-85ca-4ad7-bd78-3b3d6e93dc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:19.830800 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-3857df20-85ca-4ad7-bd78-3b3d6e93dc1e None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:19.831999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3857df20-85ca-4ad7-bd78-3b3d6e93dc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:19.904740 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 438/872] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:20:20.105920 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0efd03-9b3c-4dfa-8bbe-b57ce5267760 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:20.106455 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0efd03-9b3c-4dfa-8bbe-b57ce5267760 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:20.107022 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0efd03-9b3c-4dfa-8bbe-b57ce5267760 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:20.108853 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 435/873] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:20.115187 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1dde9-938f-4bd6-8804-d2277c728fc7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:20.115562 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1dde9-938f-4bd6-8804-d2277c728fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:20.115957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1dde9-938f-4bd6-8804-d2277c728fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:20.135797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-95e1dde9-938f-4bd6-8804-d2277c728fc7 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:20.137585 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-95e1dde9-938f-4bd6-8804-d2277c728fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:20.147464 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:20.187405 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0efd03-9b3c-4dfa-8bbe-b57ce5267760 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:20.216668 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 439/874] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:20:20.306477 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0efd03-9b3c-4dfa-8bbe-b57ce5267760 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:20.326728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:20.341122 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7a9f8-24b0-4669-91ed-d208904eceac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:20.341714 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7a9f8-24b0-4669-91ed-d208904eceac None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:20.342006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7a9f8-24b0-4669-91ed-d208904eceac None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:20.342272 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7a9f8-24b0-4669-91ed-d208904eceac None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:20.342905 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7a9f8-24b0-4669-91ed-d208904eceac None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:20.344247 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7a9f8-24b0-4669-91ed-d208904eceac None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:20.417097 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 436/875] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 14:20:20 2022] POST /identity/v3/services => generated 251 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:20:20.490760 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1dde9-938f-4bd6-8804-d2277c728fc7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:20.548451 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32a5e3-341a-43c8-9fcf-09e6d7b94537 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:20.548821 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32a5e3-341a-43c8-9fcf-09e6d7b94537 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:20.548994 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32a5e3-341a-43c8-9fcf-09e6d7b94537 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:20.551903 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 437/876] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:20.556471 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e3968-d82f-424a-a3ed-6317f1800d61 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:20.556748 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e3968-d82f-424a-a3ed-6317f1800d61 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:20.557022 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e3968-d82f-424a-a3ed-6317f1800d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:20.576965 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-1e3e3968-d82f-424a-a3ed-6317f1800d61 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:20.578211 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1e3e3968-d82f-424a-a3ed-6317f1800d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:20.602437 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1dde9-938f-4bd6-8804-d2277c728fc7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:20.657225 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8219f23-ead6-4351-bcf8-669aeb50a3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:20.658141 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8219f23-ead6-4351-bcf8-669aeb50a3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:20.658417 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8219f23-ead6-4351-bcf8-669aeb50a3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:20.659076 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8219f23-ead6-4351-bcf8-669aeb50a3c2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:20.659933 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8219f23-ead6-4351-bcf8-669aeb50a3c2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:20.661305 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8219f23-ead6-4351-bcf8-669aeb50a3c2 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:20.664262 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 438/877] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:20 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:20:20.673073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-d8219f23-ead6-4351-bcf8-669aeb50a3c2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 14:20:20.673073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:20.673073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:20:20.673073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:20:20.673073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:20:20.673073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:20:20.673073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:20:20.673073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:20.673073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 14:20:20.673073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:20.673073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:20:20.673073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:20.673073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:20.673073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:20.673073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:20.673073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:20.673073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:20.674138 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:20.674138 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:20.674138 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:20.674138 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:20.674138 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:20.674138 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:20.674138 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:20:20.674138 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:20:20.674138 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:20:20.674138 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:20:20.674138 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:20.674138 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:20.674138 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:20.674138 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:20.674138 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:20.674138 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:20.674978 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:20.674978 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:20.674978 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:20.674978 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:20.674978 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:20.674978 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:20.674978 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:20.674978 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:20.674978 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:20.674978 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:20.674978 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:20:20.674978 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:20.674978 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 14:20:20.674978 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:20.674978 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 440/878] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 14:20:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:20.682308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e3968-d82f-424a-a3ed-6317f1800d61 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:20.787289 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e3968-d82f-424a-a3ed-6317f1800d61 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:20.797859 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:20.823525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a962e7-dc9a-4dd5-bee5-242ef9af6043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:20.825006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a962e7-dc9a-4dd5-bee5-242ef9af6043 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:20.825489 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a962e7-dc9a-4dd5-bee5-242ef9af6043 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:20.825960 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a962e7-dc9a-4dd5-bee5-242ef9af6043 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:20.829362 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a962e7-dc9a-4dd5-bee5-242ef9af6043 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:20.829362 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a962e7-dc9a-4dd5-bee5-242ef9af6043 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:20.829362 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a962e7-dc9a-4dd5-bee5-242ef9af6043 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:20.833765 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 439/879] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Aug 24 14:20:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:20.839526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8219f23-ead6-4351-bcf8-669aeb50a3c2 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:20.850086 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:20.945936 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8219f23-ead6-4351-bcf8-669aeb50a3c2 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:20.963819 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a962e7-dc9a-4dd5-bee5-242ef9af6043 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:20.984247 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f63b5-22e4-4008-8c91-35de381651b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:20.984852 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f63b5-22e4-4008-8c91-35de381651b8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:20.985137 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f63b5-22e4-4008-8c91-35de381651b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:20.985412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f63b5-22e4-4008-8c91-35de381651b8 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:20.986282 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f63b5-22e4-4008-8c91-35de381651b8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:20.986482 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f63b5-22e4-4008-8c91-35de381651b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:20.987962 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f63b5-22e4-4008-8c91-35de381651b8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:20.993333 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 441/880] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Aug 24 14:20:20 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:21.052125 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4090181-516b-4571-8eb7-1ffad4433041 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:21.052460 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4090181-516b-4571-8eb7-1ffad4433041 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:21.052746 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4090181-516b-4571-8eb7-1ffad4433041 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:21.054519 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 442/881] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:21.064468 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb6df8-2e51-43b3-8d4a-7e32690af977 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:21.066389 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb6df8-2e51-43b3-8d4a-7e32690af977 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:21.067381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb6df8-2e51-43b3-8d4a-7e32690af977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:21.084915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a962e7-dc9a-4dd5-bee5-242ef9af6043 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:21.093074 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-beeb6df8-2e51-43b3-8d4a-7e32690af977 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:21.095145 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-beeb6df8-2e51-43b3-8d4a-7e32690af977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:21.129426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e58e9c-d301-4537-9621-cb7122929dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:21.130063 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e58e9c-d301-4537-9621-cb7122929dd9 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:21.130336 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e58e9c-d301-4537-9621-cb7122929dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:21.130608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e58e9c-d301-4537-9621-cb7122929dd9 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:21.131297 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e58e9c-d301-4537-9621-cb7122929dd9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:21.132669 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e58e9c-d301-4537-9621-cb7122929dd9 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:21.183339 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:21.189204 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 443/882] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:21 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:20:21.232494 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 440/883] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 14:20:20 2022] POST /identity/v3/services => generated 269 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:20:21.482281 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb6df8-2e51-43b3-8d4a-7e32690af977 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:21.591852 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb6df8-2e51-43b3-8d4a-7e32690af977 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:21.633426 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b2bf2-e689-4167-b17c-421d9c8e2c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:21.634467 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b2bf2-e689-4167-b17c-421d9c8e2c2d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:21.634960 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b2bf2-e689-4167-b17c-421d9c8e2c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:21.635481 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b2bf2-e689-4167-b17c-421d9c8e2c2d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:21.646483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b2bf2-e689-4167-b17c-421d9c8e2c2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:20:21.651377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-343b2bf2-e689-4167-b17c-421d9c8e2c2d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 14:20:21.651377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:21.651377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:21.651377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:21.651377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:21.651377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:21.651377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:21.651377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:21.651377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:21.651377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:21.651377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:21.651377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:21.651377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:20:21.651377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:20:21.651377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:20:21.651377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:20:21.653018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:20:21.653018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:20:21.653018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:20:21.653018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:20:21.653018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:21.653018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:21.653018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:21.653018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:21.653018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:21.653018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:21.653018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:21.653018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:21.653018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:21.653018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:21.653018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:21.653018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:21.653913 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:21.653913 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:21.653913 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:21.653913 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:21.653913 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:20:21.653913 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:20:21.653913 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:20:21.653913 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:20:21.653913 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:20:21.653913 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:20:21.653913 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 14:20:21.653913 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:21.656608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 444/884] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Aug 24 14:20:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:21.662739 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e58e9c-d301-4537-9621-cb7122929dd9 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:21.698105 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:21.773203 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e58e9c-d301-4537-9621-cb7122929dd9 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:21.809541 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cec8c3-bfa6-4f9e-83c7-ed111a47e0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:21.810510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cec8c3-bfa6-4f9e-83c7-ed111a47e0df None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:21.810999 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cec8c3-bfa6-4f9e-83c7-ed111a47e0df None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:21.811479 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cec8c3-bfa6-4f9e-83c7-ed111a47e0df None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:21.812350 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cec8c3-bfa6-4f9e-83c7-ed111a47e0df None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:21.812884 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cec8c3-bfa6-4f9e-83c7-ed111a47e0df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:21.814466 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cec8c3-bfa6-4f9e-83c7-ed111a47e0df None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:21.823675 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 441/885] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Aug 24 14:20:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:21.830665 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b2bf2-e689-4167-b17c-421d9c8e2c2d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:21.890880 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:21.940547 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b2bf2-e689-4167-b17c-421d9c8e2c2d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:21.977425 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e523a8-3768-4c57-a0d6-428742b59a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:21.978423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e523a8-3768-4c57-a0d6-428742b59a69 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:21.978912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e523a8-3768-4c57-a0d6-428742b59a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:21.979412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e523a8-3768-4c57-a0d6-428742b59a69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:21.995590 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e523a8-3768-4c57-a0d6-428742b59a69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:21.997545 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e523a8-3768-4c57-a0d6-428742b59a69 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:22.015369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-c5e523a8-3768-4c57-a0d6-428742b59a69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:22.015369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:22.015369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:22.015369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:22.015369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:22.015369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:22.015369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:22.015369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:22.015369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:22.015369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:22.015369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:22.015369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:22.015369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:22.015369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:22.015369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:22.015369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:22.016371 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:22.016371 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:22.016371 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:22.016371 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:22.016371 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:22.016371 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:22.016371 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:22.016371 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:22.016371 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:22.016371 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:22.016371 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:22.016371 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:22.016371 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:22.016371 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:22.016371 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:22.016371 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:22.016371 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:22.017256 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:22.017256 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:22.017256 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:22.017256 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 445/886] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:22.024103 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cec8c3-bfa6-4f9e-83c7-ed111a47e0df None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:22.126272 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:22.133666 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cec8c3-bfa6-4f9e-83c7-ed111a47e0df None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:22.171503 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8235de-76a7-4547-9f1e-3d909b1eee47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:22.172557 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8235de-76a7-4547-9f1e-3d909b1eee47 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:22.173115 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8235de-76a7-4547-9f1e-3d909b1eee47 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:22.173592 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8235de-76a7-4547-9f1e-3d909b1eee47 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:22.174460 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8235de-76a7-4547-9f1e-3d909b1eee47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:22.174981 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8235de-76a7-4547-9f1e-3d909b1eee47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:22.176553 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8235de-76a7-4547-9f1e-3d909b1eee47 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:22.191155 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 442/887] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:22.199375 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e523a8-3768-4c57-a0d6-428742b59a69 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:22.314369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e523a8-3768-4c57-a0d6-428742b59a69 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:22.321638 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:22.349968 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fcc7c-8eba-4d24-b86e-a13bbfb79d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:22.350599 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fcc7c-8eba-4d24-b86e-a13bbfb79d06 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:22.350878 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fcc7c-8eba-4d24-b86e-a13bbfb79d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:22.351150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fcc7c-8eba-4d24-b86e-a13bbfb79d06 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:22.359743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91fcc7c-8eba-4d24-b86e-a13bbfb79d06 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:22.361240 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91fcc7c-8eba-4d24-b86e-a13bbfb79d06 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:22.374231 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-b91fcc7c-8eba-4d24-b86e-a13bbfb79d06 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 14:20:22.374231 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:22.374231 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:22.374231 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:22.374231 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:22.374231 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:22.374231 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:22.374231 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:22.374231 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:22.374231 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:22.374231 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:22.374231 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:22.374231 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:20:22.374231 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:20:22.374231 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:20:22.374231 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:20:22.375218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:22.375218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:22.375218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:20:22.375218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:22.375218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:20:22.375218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:22.375218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:22.375218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:22.375218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:22.375218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:22.375218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:22.375218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:22.375218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:22.375218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:22.375218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:22.375218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:22.375218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:22.375218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:22.376283 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:22.376283 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:22.376283 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:20:22.376283 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:20:22.376283 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:20:22.376283 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:20:22.376283 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:20:22.376283 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:20:22.376283 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 14:20:22.376283 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:22.376283 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 446/888] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Aug 24 14:20:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:22.381859 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8235de-76a7-4547-9f1e-3d909b1eee47 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:22.450079 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838faf48-1986-4948-83b9-f3dd5a9eeeb4 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:22.450268 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838faf48-1986-4948-83b9-f3dd5a9eeeb4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:22.450542 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838faf48-1986-4948-83b9-f3dd5a9eeeb4 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:22.452165 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 447/889] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:20:22.458930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efec35c-4f99-4b0b-85a0-1a4bea8d3c41 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:22.459368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efec35c-4f99-4b0b-85a0-1a4bea8d3c41 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:22.459804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efec35c-4f99-4b0b-85a0-1a4bea8d3c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:22.487755 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-7efec35c-4f99-4b0b-85a0-1a4bea8d3c41 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:22.489767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7efec35c-4f99-4b0b-85a0-1a4bea8d3c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:22.492147 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8235de-76a7-4547-9f1e-3d909b1eee47 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:22.531311 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a45d0-4522-4d0d-8c8a-b7fe5bee63a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:22.532139 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a45d0-4522-4d0d-8c8a-b7fe5bee63a8 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:22.532420 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a45d0-4522-4d0d-8c8a-b7fe5bee63a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:22.532784 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a45d0-4522-4d0d-8c8a-b7fe5bee63a8 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:22.533524 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a45d0-4522-4d0d-8c8a-b7fe5bee63a8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:22.533867 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a45d0-4522-4d0d-8c8a-b7fe5bee63a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:22.535492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a45d0-4522-4d0d-8c8a-b7fe5bee63a8 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:22.559231 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 443/890] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Aug 24 14:20:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:22.561421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a45d0-4522-4d0d-8c8a-b7fe5bee63a8 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:22.577970 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:22.580602 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 448/891] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:22 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:20:22.673703 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a45d0-4522-4d0d-8c8a-b7fe5bee63a8 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:22.709078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552ffea-e91e-4e7c-a745-1eadd7eb55ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:22.709603 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552ffea-e91e-4e7c-a745-1eadd7eb55ba None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:22.709949 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552ffea-e91e-4e7c-a745-1eadd7eb55ba None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:22.710225 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552ffea-e91e-4e7c-a745-1eadd7eb55ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:22.783042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3552ffea-e91e-4e7c-a745-1eadd7eb55ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:22.784497 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3552ffea-e91e-4e7c-a745-1eadd7eb55ba None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:22.798976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:22.871042 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efec35c-4f99-4b0b-85a0-1a4bea8d3c41 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:22.890563 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 444/892] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:20:22 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:20:22.896280 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552ffea-e91e-4e7c-a745-1eadd7eb55ba None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:22.970008 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:22.976546 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efec35c-4f99-4b0b-85a0-1a4bea8d3c41 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:23.005463 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552ffea-e91e-4e7c-a745-1eadd7eb55ba None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:23.012883 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340056ab-f0a0-4857-a7ce-5c240ff89eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:23.013842 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340056ab-f0a0-4857-a7ce-5c240ff89eee None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:23.014350 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340056ab-f0a0-4857-a7ce-5c240ff89eee None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:23.014829 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340056ab-f0a0-4857-a7ce-5c240ff89eee None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:23.015614 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340056ab-f0a0-4857-a7ce-5c240ff89eee None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:23.017182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340056ab-f0a0-4857-a7ce-5c240ff89eee None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:23.021327 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:23.027573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-340056ab-f0a0-4857-a7ce-5c240ff89eee None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 14:20:23.027573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:23.027573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:20:23.027573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:20:23.027573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:20:23.027573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:20:23.027573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:20:23.027573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:23.027573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 14:20:23.027573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:23.027573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:20:23.027573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:23.027573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:23.027573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:23.027573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:23.027573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:23.027573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:23.028548 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:23.028548 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:23.028548 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:23.028548 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:23.028548 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:23.028548 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:23.028548 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:20:23.028548 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:20:23.028548 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:20:23.028548 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:20:23.028548 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:23.028548 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:23.028548 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:23.028548 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:23.028548 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:23.028548 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:23.029388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:23.029388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:23.029388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:23.029388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:23.029388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:23.029388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:23.029388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:23.029388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:23.029388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:23.029388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:23.029388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:20:23.029388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:23.029388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 14:20:23.029388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:23.032377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 449/893] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 14:20:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:23.037612 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340056ab-f0a0-4857-a7ce-5c240ff89eee None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:23.045738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea06d34-24cb-45a3-9db1-c2d9ef1cfd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:23.046458 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea06d34-24cb-45a3-9db1-c2d9ef1cfd38 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:23.046744 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea06d34-24cb-45a3-9db1-c2d9ef1cfd38 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:23.047026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea06d34-24cb-45a3-9db1-c2d9ef1cfd38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:23.058595 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea06d34-24cb-45a3-9db1-c2d9ef1cfd38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:23.060148 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea06d34-24cb-45a3-9db1-c2d9ef1cfd38 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:23.078005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-5ea06d34-24cb-45a3-9db1-c2d9ef1cfd38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:23.078005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:23.078005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:23.078005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:23.078005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:23.078005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:23.078005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:23.078005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:23.078005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:23.078005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:23.078005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:23.078005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:23.078005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:23.078005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:23.078005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:23.078005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:23.078982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:23.078982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:23.078982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:23.078982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:23.078982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:23.078982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:23.078982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:23.078982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:23.078982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:23.078982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:23.078982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:23.078982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:23.078982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:23.078982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:23.078982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:23.078982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:23.078982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:23.080556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:23.080556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:23.080556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:23.084018 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 445/894] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:23.085547 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea06d34-24cb-45a3-9db1-c2d9ef1cfd38 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:23.153209 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340056ab-f0a0-4857-a7ce-5c240ff89eee None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:23.191568 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d7d6b-5786-4b25-bf10-b3f278a1594b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:23.192267 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d7d6b-5786-4b25-bf10-b3f278a1594b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:23.192543 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d7d6b-5786-4b25-bf10-b3f278a1594b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:23.192831 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d7d6b-5786-4b25-bf10-b3f278a1594b None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:23.193437 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d7d6b-5786-4b25-bf10-b3f278a1594b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:23.193735 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d7d6b-5786-4b25-bf10-b3f278a1594b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:23.195097 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea06d34-24cb-45a3-9db1-c2d9ef1cfd38 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:23.195196 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d7d6b-5786-4b25-bf10-b3f278a1594b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:23.204456 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 450/895] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 14:20:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:23.204456 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b54dc3-5ce2-4b4c-8909-dd5a02bca676 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:23.204456 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b54dc3-5ce2-4b4c-8909-dd5a02bca676 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:23.204456 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b54dc3-5ce2-4b4c-8909-dd5a02bca676 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:23.204456 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 451/896] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:23.205767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b54dc3-5ce2-4b4c-8909-dd5a02bca676 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:23.231763 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:23.234070 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5d9fc-8f0b-421f-81f0-8c0462d28763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:23.234671 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5d9fc-8f0b-421f-81f0-8c0462d28763 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:23.234949 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5d9fc-8f0b-421f-81f0-8c0462d28763 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:23.235301 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5d9fc-8f0b-421f-81f0-8c0462d28763 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:23.235944 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5d9fc-8f0b-421f-81f0-8c0462d28763 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:23.236241 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5d9fc-8f0b-421f-81f0-8c0462d28763 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:23.237589 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5d9fc-8f0b-421f-81f0-8c0462d28763 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:23.249087 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 446/897] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:23.250289 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e968a16-88c7-470d-8a48-905645ea12a8 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:23.250598 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e968a16-88c7-470d-8a48-905645ea12a8 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:23.250922 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e968a16-88c7-470d-8a48-905645ea12a8 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:23.254458 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 447/898] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:23.254458 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83302746-abe2-4731-bd65-4e3dccc8b71c None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:23.254458 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83302746-abe2-4731-bd65-4e3dccc8b71c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:23.254458 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83302746-abe2-4731-bd65-4e3dccc8b71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:23.273200 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-83302746-abe2-4731-bd65-4e3dccc8b71c None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:23.274557 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-83302746-abe2-4731-bd65-4e3dccc8b71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:23.292071 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:23.314948 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b54dc3-5ce2-4b4c-8909-dd5a02bca676 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:23.344830 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 448/899] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:23 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:20:23.345663 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83302746-abe2-4731-bd65-4e3dccc8b71c None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:23.349640 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cf15a-7cb4-4770-892f-d7801a952215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:23.350270 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cf15a-7cb4-4770-892f-d7801a952215 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:23.350547 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cf15a-7cb4-4770-892f-d7801a952215 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:23.350816 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cf15a-7cb4-4770-892f-d7801a952215 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:23.351439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cf15a-7cb4-4770-892f-d7801a952215 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:23.351741 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cf15a-7cb4-4770-892f-d7801a952215 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:23.353097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cf15a-7cb4-4770-892f-d7801a952215 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:23.359082 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 452/900] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 14:20:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:23.359909 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9f20b-1d9e-466f-a41d-aaaf4332f456 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:23.360192 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9f20b-1d9e-466f-a41d-aaaf4332f456 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:23.360463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9f20b-1d9e-466f-a41d-aaaf4332f456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:23.379561 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-38b9f20b-1d9e-466f-a41d-aaaf4332f456 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:23.380753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-38b9f20b-1d9e-466f-a41d-aaaf4332f456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:23.451937 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 453/901] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:23 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:20:23.452988 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9f20b-1d9e-466f-a41d-aaaf4332f456 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:23.467876 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83302746-abe2-4731-bd65-4e3dccc8b71c None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:23.486625 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:23.509914 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e1097-ffd9-4e7c-b2f4-92e35e35990c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:23.510731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e1097-ffd9-4e7c-b2f4-92e35e35990c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:23.511208 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e1097-ffd9-4e7c-b2f4-92e35e35990c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:23.512224 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e1097-ffd9-4e7c-b2f4-92e35e35990c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:23.520859 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e1097-ffd9-4e7c-b2f4-92e35e35990c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:23.523330 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e1097-ffd9-4e7c-b2f4-92e35e35990c None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:23.537939 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-095e1097-ffd9-4e7c-b2f4-92e35e35990c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:23.537939 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:23.537939 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:23.537939 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:23.537939 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:23.537939 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:23.537939 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:23.537939 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:23.537939 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:23.537939 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:23.537939 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:23.537939 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:23.537939 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:20:23.537939 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:20:23.537939 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:20:23.538896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:20:23.538896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:23.538896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:23.538896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:23.538896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:23.538896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:23.538896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:23.538896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:23.538896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:23.538896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:23.538896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:23.538896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:23.538896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:23.538896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:23.538896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:23.538896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:23.538896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:23.539817 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:20:23.539817 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:20:23.539817 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:20:23.539817 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:20:23.539817 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:20:23.539817 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:20:23.539817 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:23.539817 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:23.539817 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 449/902] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:20:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:23.546803 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e1097-ffd9-4e7c-b2f4-92e35e35990c None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:23.562941 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:23.583994 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9f20b-1d9e-466f-a41d-aaaf4332f456 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:23.621099 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecede4-29ca-40d8-8bbf-9a5f1e9aad1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:23.621975 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecede4-29ca-40d8-8bbf-9a5f1e9aad1d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:23.622260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecede4-29ca-40d8-8bbf-9a5f1e9aad1d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:23.622533 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecede4-29ca-40d8-8bbf-9a5f1e9aad1d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:23.623248 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ecede4-29ca-40d8-8bbf-9a5f1e9aad1d None admin] RBAC: Adding query filter params (interface=public, service_id=696a244f21fd45a386a96e7ac7a8c71a, region_id=RegionOne) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:23.623559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ecede4-29ca-40d8-8bbf-9a5f1e9aad1d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:23.624934 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ecede4-29ca-40d8-8bbf-9a5f1e9aad1d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:23.633047 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 454/903] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Aug 24 14:20:23 2022] GET /identity/v3/endpoints?service_id=696a244f21fd45a386a96e7ac7a8c71a&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:23.633893 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecede4-29ca-40d8-8bbf-9a5f1e9aad1d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:23.655742 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e1097-ffd9-4e7c-b2f4-92e35e35990c None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:23.693153 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1871280-d9ff-41f4-a70e-d9f2d0c8b244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:23.693781 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1871280-d9ff-41f4-a70e-d9f2d0c8b244 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:23.694057 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1871280-d9ff-41f4-a70e-d9f2d0c8b244 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:23.694335 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1871280-d9ff-41f4-a70e-d9f2d0c8b244 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:23.695097 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1871280-d9ff-41f4-a70e-d9f2d0c8b244 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:23.695400 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1871280-d9ff-41f4-a70e-d9f2d0c8b244 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:23.696815 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1871280-d9ff-41f4-a70e-d9f2d0c8b244 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:23.714064 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 450/904] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:20:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:23.715366 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1871280-d9ff-41f4-a70e-d9f2d0c8b244 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:23.724587 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:23.743859 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecede4-29ca-40d8-8bbf-9a5f1e9aad1d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:23.779364 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb04bd9-beb8-4062-b094-000123ce88b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:23.779967 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb04bd9-beb8-4062-b094-000123ce88b2 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:23.780249 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb04bd9-beb8-4062-b094-000123ce88b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:23.780524 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb04bd9-beb8-4062-b094-000123ce88b2 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:23.781160 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb04bd9-beb8-4062-b094-000123ce88b2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:23.782541 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb04bd9-beb8-4062-b094-000123ce88b2 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:23.796827 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:23.821039 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1871280-d9ff-41f4-a70e-d9f2d0c8b244 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:23.853502 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993af069-27cd-4cfc-8832-119ce37b3483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:23.854114 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993af069-27cd-4cfc-8832-119ce37b3483 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:23.854392 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993af069-27cd-4cfc-8832-119ce37b3483 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:23.854659 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993af069-27cd-4cfc-8832-119ce37b3483 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:23.856013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993af069-27cd-4cfc-8832-119ce37b3483 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:23.857416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993af069-27cd-4cfc-8832-119ce37b3483 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:23.857525 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 455/905] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 14:20:23 2022] POST /identity/v3/services => generated 241 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:20:23.858318 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb04bd9-beb8-4062-b094-000123ce88b2 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:23.864327 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 451/906] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Aug 24 14:20:23 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:20:23.865496 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993af069-27cd-4cfc-8832-119ce37b3483 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:24.000960 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb04bd9-beb8-4062-b094-000123ce88b2 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:24.041121 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993af069-27cd-4cfc-8832-119ce37b3483 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:24.047505 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f495a90-9414-4062-9dd5-0d24f6ffed82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:24.048224 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f495a90-9414-4062-9dd5-0d24f6ffed82 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:24.048398 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f495a90-9414-4062-9dd5-0d24f6ffed82 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:24.048675 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f495a90-9414-4062-9dd5-0d24f6ffed82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:24.049410 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f495a90-9414-4062-9dd5-0d24f6ffed82 None admin] RBAC: Adding query filter params (role.id=89526ad5407b4974a7368c7aa6411cf8, scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e, user.id=477ab357d285415e8c0c82d414d242ba) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:24.049720 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f495a90-9414-4062-9dd5-0d24f6ffed82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:24.051218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f495a90-9414-4062-9dd5-0d24f6ffed82 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:24.057250 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 456/907] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:20:23 2022] GET /identity/v3/role_assignments?user.id=477ab357d285415e8c0c82d414d242ba&scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e&role.id=89526ad5407b4974a7368c7aa6411cf8 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:24.094954 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5fcd6-8fcf-41bf-a418-1f86a504416c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:24.095924 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5fcd6-8fcf-41bf-a418-1f86a504416c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:24.096386 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5fcd6-8fcf-41bf-a418-1f86a504416c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:24.096924 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5fcd6-8fcf-41bf-a418-1f86a504416c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:24.097776 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc5fcd6-8fcf-41bf-a418-1f86a504416c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:24.099384 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc5fcd6-8fcf-41bf-a418-1f86a504416c None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:24.109549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-1bc5fcd6-8fcf-41bf-a418-1f86a504416c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 14:20:24.109549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:24.109549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:20:24.109549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:20:24.109549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:20:24.109549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:20:24.109549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:20:24.109549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:24.109549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 14:20:24.109549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:24.109549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:20:24.109549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:24.109549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:24.109549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:24.109549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:24.109549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:24.110628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:24.110628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:24.110628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:24.110628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:24.110628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:24.110628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:24.110628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:24.110628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:20:24.110628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:20:24.110628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:20:24.110628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:20:24.110628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:24.110628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:24.110628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:24.110628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:24.110628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:24.110628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:24.111530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:24.111530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:24.111530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:24.111530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:24.111530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:24.111530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:24.111530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:24.111530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:24.111530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:24.111530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:24.111530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:20:24.111530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:24.111530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 14:20:24.111530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:24.114184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 452/908] 10.222.0.65 () {56 vars in 1132 bytes} [Wed Aug 24 14:20:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:24.123036 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f495a90-9414-4062-9dd5-0d24f6ffed82 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:24.126031 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:24.241256 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f495a90-9414-4062-9dd5-0d24f6ffed82 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:24.279165 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ac2f9-951f-454c-a8d3-f03511f717f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:24.279774 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ac2f9-951f-454c-a8d3-f03511f717f6 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:24.280047 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ac2f9-951f-454c-a8d3-f03511f717f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:24.280312 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ac2f9-951f-454c-a8d3-f03511f717f6 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:24.280930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ac2f9-951f-454c-a8d3-f03511f717f6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:24.281226 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ac2f9-951f-454c-a8d3-f03511f717f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:24.282701 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ac2f9-951f-454c-a8d3-f03511f717f6 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:24.292300 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 457/909] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 14:20:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:24.293938 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5fcd6-8fcf-41bf-a418-1f86a504416c None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:24.298057 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:24.399823 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5fcd6-8fcf-41bf-a418-1f86a504416c None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:24.434937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799888d5-2fac-46a1-bf9e-fd330c49064b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:24.435544 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799888d5-2fac-46a1-bf9e-fd330c49064b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:24.435825 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799888d5-2fac-46a1-bf9e-fd330c49064b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:24.436094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799888d5-2fac-46a1-bf9e-fd330c49064b None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:24.436723 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799888d5-2fac-46a1-bf9e-fd330c49064b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:24.437020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799888d5-2fac-46a1-bf9e-fd330c49064b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:24.438418 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799888d5-2fac-46a1-bf9e-fd330c49064b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:24.443791 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 453/910] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 14:20:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:24.450853 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ac2f9-951f-454c-a8d3-f03511f717f6 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:24.520968 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:24.558749 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ac2f9-951f-454c-a8d3-f03511f717f6 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:24.593871 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133d80d-b8bd-4dd4-a677-94a959ae8a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:24.594553 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133d80d-b8bd-4dd4-a677-94a959ae8a71 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:24.594839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133d80d-b8bd-4dd4-a677-94a959ae8a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:24.595110 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133d80d-b8bd-4dd4-a677-94a959ae8a71 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:24.595806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133d80d-b8bd-4dd4-a677-94a959ae8a71 None admin] RBAC: Adding query filter params (interface=public, service_id=098e18877dd84283b15819c49b2a94dd, region_id=RegionOne) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:24.596112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133d80d-b8bd-4dd4-a677-94a959ae8a71 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:24.597468 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133d80d-b8bd-4dd4-a677-94a959ae8a71 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:24.608097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 458/911] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Aug 24 14:20:24 2022] GET /identity/v3/endpoints?service_id=098e18877dd84283b15819c49b2a94dd&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:24.609515 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799888d5-2fac-46a1-bf9e-fd330c49064b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:24.675796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:24.714758 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799888d5-2fac-46a1-bf9e-fd330c49064b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:24.748857 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba5e8f-b70f-4204-b00f-b7e3d89ee5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:24.749839 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba5e8f-b70f-4204-b00f-b7e3d89ee5c9 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:24.750350 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba5e8f-b70f-4204-b00f-b7e3d89ee5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:24.750823 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba5e8f-b70f-4204-b00f-b7e3d89ee5c9 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:24.751623 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba5e8f-b70f-4204-b00f-b7e3d89ee5c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:24.753546 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba5e8f-b70f-4204-b00f-b7e3d89ee5c9 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:24.760241 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 454/912] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Aug 24 14:20:24 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:20:25.838677 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2953801-5d0e-482e-a84c-9f0db37aa66d None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:25.839256 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2953801-5d0e-482e-a84c-9f0db37aa66d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:25.839256 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2953801-5d0e-482e-a84c-9f0db37aa66d None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:25.840931 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 459/913] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:25.846503 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22391cd-0e3c-48a3-9430-668cfb6e0ba4 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:25.846969 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22391cd-0e3c-48a3-9430-668cfb6e0ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:25.847048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22391cd-0e3c-48a3-9430-668cfb6e0ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:25.866730 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-c22391cd-0e3c-48a3-9430-668cfb6e0ba4 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:25.867963 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c22391cd-0e3c-48a3-9430-668cfb6e0ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:25.919295 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fae91-3f4b-493a-9c3f-d6844bf6c1c4 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:25.919631 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fae91-3f4b-493a-9c3f-d6844bf6c1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:25.920288 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fae91-3f4b-493a-9c3f-d6844bf6c1c4 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:25.922198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 460/914] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:25.930693 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe9a00-52ff-4740-a3e0-48ca2fdb24c7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:25.931094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe9a00-52ff-4740-a3e0-48ca2fdb24c7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:25.931471 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe9a00-52ff-4740-a3e0-48ca2fdb24c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:25.947530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 455/915] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:20:25.951521 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-6bbe9a00-52ff-4740-a3e0-48ca2fdb24c7 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:25.952747 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6bbe9a00-52ff-4740-a3e0-48ca2fdb24c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:26.027193 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 461/916] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:20:26.070833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8ddef-e862-4a0d-ab2b-9ef646e79d10 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:26.071474 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8ddef-e862-4a0d-ab2b-9ef646e79d10 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:26.071951 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8ddef-e862-4a0d-ab2b-9ef646e79d10 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:26.073954 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 456/917] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:26.079258 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fec12-8309-47d3-9d12-ef55be05e7a0 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:26.079552 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fec12-8309-47d3-9d12-ef55be05e7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:26.079829 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fec12-8309-47d3-9d12-ef55be05e7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:26.098307 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c40fec12-8309-47d3-9d12-ef55be05e7a0 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:26.099420 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c40fec12-8309-47d3-9d12-ef55be05e7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:26.158903 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:26.171733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 462/918] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:20:26.231162 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8ddef-e862-4a0d-ab2b-9ef646e79d10 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:26.297473 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:26.299107 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fec12-8309-47d3-9d12-ef55be05e7a0 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:26.355125 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8ddef-e862-4a0d-ab2b-9ef646e79d10 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:26.403316 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505653c9-a61a-47bd-88f3-c68479f66025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:26.403953 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505653c9-a61a-47bd-88f3-c68479f66025 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:26.404235 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505653c9-a61a-47bd-88f3-c68479f66025 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:26.404503 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505653c9-a61a-47bd-88f3-c68479f66025 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:26.405090 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505653c9-a61a-47bd-88f3-c68479f66025 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:26.406499 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505653c9-a61a-47bd-88f3-c68479f66025 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:26.414958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fec12-8309-47d3-9d12-ef55be05e7a0 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:26.415751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-505653c9-a61a-47bd-88f3-c68479f66025 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 14:20:26.415751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:26.415751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:20:26.415751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:20:26.415751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:20:26.415751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:20:26.415751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:20:26.415751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:26.415751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 14:20:26.415751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:26.415751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:20:26.415751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:26.415751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:26.415751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:26.415751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:26.415751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:26.415751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:26.416690 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:26.416690 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:26.416690 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:26.416690 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:26.416690 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:26.416690 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:26.416690 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:20:26.416690 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:20:26.416690 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:20:26.416690 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:20:26.416690 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:26.416690 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:26.416690 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:26.416690 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:26.416690 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:26.416690 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:26.417609 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:26.417609 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:26.417609 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:26.417609 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:26.417609 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:26.417609 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:26.417609 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:26.417609 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:26.417609 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:26.417609 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:26.417609 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:20:26.417609 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:26.417609 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 14:20:26.417609 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:26.417609 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 457/919] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 14:20:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:26.425825 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505653c9-a61a-47bd-88f3-c68479f66025 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:26.462775 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f17151-b5ad-4b6c-89b6-c565d79d8923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:26.463770 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f17151-b5ad-4b6c-89b6-c565d79d8923 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:26.464059 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f17151-b5ad-4b6c-89b6-c565d79d8923 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:26.464869 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f17151-b5ad-4b6c-89b6-c565d79d8923 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:26.465471 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f17151-b5ad-4b6c-89b6-c565d79d8923 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:26.467713 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f17151-b5ad-4b6c-89b6-c565d79d8923 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:26.479675 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-c6f17151-b5ad-4b6c-89b6-c565d79d8923 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 14:20:26.479675 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:26.479675 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:20:26.479675 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:20:26.479675 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:20:26.479675 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:20:26.479675 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:20:26.479675 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:26.479675 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 14:20:26.479675 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:26.479675 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:20:26.479675 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:26.479675 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:26.479675 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:26.479675 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:26.479675 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:26.479675 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:26.480704 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:26.480704 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:26.480704 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:26.480704 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:26.480704 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:26.480704 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:26.480704 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:20:26.480704 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:20:26.480704 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:20:26.480704 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:20:26.480704 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:26.480704 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:26.480704 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:26.480704 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:26.480704 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:26.480704 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:26.481528 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:26.481528 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:26.481528 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:26.481528 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:26.481528 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:26.481528 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:26.481528 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:26.481528 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:26.481528 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:26.481528 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:26.481528 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:20:26.481528 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:26.481528 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 14:20:26.481528 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:26.481528 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 463/920] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 14:20:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:20:26.483661 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f17151-b5ad-4b6c-89b6-c565d79d8923 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:26.540232 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:26.545860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505653c9-a61a-47bd-88f3-c68479f66025 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:26.571345 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:26.582557 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610475a-dc2a-4e7b-ad3c-8e4244f76555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:26.583158 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610475a-dc2a-4e7b-ad3c-8e4244f76555 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:26.583439 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610475a-dc2a-4e7b-ad3c-8e4244f76555 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:26.583711 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610475a-dc2a-4e7b-ad3c-8e4244f76555 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:26.584340 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610475a-dc2a-4e7b-ad3c-8e4244f76555 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:26.584636 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610475a-dc2a-4e7b-ad3c-8e4244f76555 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:26.586011 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610475a-dc2a-4e7b-ad3c-8e4244f76555 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:26.595556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 458/921] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Aug 24 14:20:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:26.595556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610475a-dc2a-4e7b-ad3c-8e4244f76555 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:26.598291 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f17151-b5ad-4b6c-89b6-c565d79d8923 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:26.635795 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87507e7a-e27d-4275-bb11-366092a8ea31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:26.637296 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87507e7a-e27d-4275-bb11-366092a8ea31 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:26.637907 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87507e7a-e27d-4275-bb11-366092a8ea31 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:26.638247 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87507e7a-e27d-4275-bb11-366092a8ea31 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:26.649459 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87507e7a-e27d-4275-bb11-366092a8ea31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:20:26.655223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-87507e7a-e27d-4275-bb11-366092a8ea31 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 14:20:26.655223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:26.655223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:26.655223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:26.655223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:26.655223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:26.655223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:26.655223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:26.655223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:26.655223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:26.655223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:26.655223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:26.655223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:20:26.655223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:20:26.655223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:20:26.655223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:20:26.656184 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:20:26.656184 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:20:26.656184 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:20:26.656184 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:20:26.656184 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:26.656184 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:26.656184 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:26.656184 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:26.656184 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:26.656184 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:26.656184 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:26.656184 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:26.656184 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:26.656184 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:26.656184 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:26.656184 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:26.657035 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:26.657035 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:26.657035 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:26.657035 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:26.657035 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:20:26.657035 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:20:26.657035 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:20:26.657035 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:20:26.657035 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:20:26.657035 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:20:26.657035 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 14:20:26.657035 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:26.657035 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 464/922] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Aug 24 14:20:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:26.658239 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87507e7a-e27d-4275-bb11-366092a8ea31 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:26.703032 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610475a-dc2a-4e7b-ad3c-8e4244f76555 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:26.736556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f299b2-0bc2-4b58-bb75-7c01824cade3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:26.737153 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f299b2-0bc2-4b58-bb75-7c01824cade3 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:26.737428 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f299b2-0bc2-4b58-bb75-7c01824cade3 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:26.737692 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f299b2-0bc2-4b58-bb75-7c01824cade3 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:26.738339 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f299b2-0bc2-4b58-bb75-7c01824cade3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:26.738633 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f299b2-0bc2-4b58-bb75-7c01824cade3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:26.739973 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f299b2-0bc2-4b58-bb75-7c01824cade3 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:26.749557 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 459/923] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 14:20:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:26.749557 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f299b2-0bc2-4b58-bb75-7c01824cade3 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:26.766823 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87507e7a-e27d-4275-bb11-366092a8ea31 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:26.780172 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:26.797533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:26.800688 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a84a6-a8ce-4616-a57d-82a4704bb5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:26.801293 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a84a6-a8ce-4616-a57d-82a4704bb5ab None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:26.801568 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a84a6-a8ce-4616-a57d-82a4704bb5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:26.801875 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a84a6-a8ce-4616-a57d-82a4704bb5ab None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:26.802508 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a84a6-a8ce-4616-a57d-82a4704bb5ab None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:26.802810 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a84a6-a8ce-4616-a57d-82a4704bb5ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:26.804168 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a84a6-a8ce-4616-a57d-82a4704bb5ab None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:26.809578 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 465/924] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Aug 24 14:20:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:26.810755 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac48fb-a3c9-4b36-b790-2a26db607e2f None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:26.811040 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac48fb-a3c9-4b36-b790-2a26db607e2f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:26.811325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac48fb-a3c9-4b36-b790-2a26db607e2f None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:26.812515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 466/925] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:26.814691 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac48fb-a3c9-4b36-b790-2a26db607e2f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:26.844285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f299b2-0bc2-4b58-bb75-7c01824cade3 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:26.880347 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b39afb-b220-46fa-ab4c-d58618c3ee1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:26.880943 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b39afb-b220-46fa-ab4c-d58618c3ee1d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:26.881215 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b39afb-b220-46fa-ab4c-d58618c3ee1d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:26.881479 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b39afb-b220-46fa-ab4c-d58618c3ee1d None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:26.882180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b39afb-b220-46fa-ab4c-d58618c3ee1d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:26.882583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b39afb-b220-46fa-ab4c-d58618c3ee1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:26.883933 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b39afb-b220-46fa-ab4c-d58618c3ee1d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:26.891806 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 460/926] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Aug 24 14:20:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:26.892541 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b39afb-b220-46fa-ab4c-d58618c3ee1d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:26.920181 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac48fb-a3c9-4b36-b790-2a26db607e2f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:26.953333 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ab8ba-adc3-4a40-a10c-f6d24548e7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:26.953963 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ab8ba-adc3-4a40-a10c-f6d24548e7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:26.954240 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ab8ba-adc3-4a40-a10c-f6d24548e7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:26.954511 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ab8ba-adc3-4a40-a10c-f6d24548e7d3 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:26.955136 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ab8ba-adc3-4a40-a10c-f6d24548e7d3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:26.955434 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ab8ba-adc3-4a40-a10c-f6d24548e7d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:26.956788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ab8ba-adc3-4a40-a10c-f6d24548e7d3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:26.961430 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 467/927] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 14:20:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:26.962580 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b6ef3-d9ae-4adc-9baf-5f5238bc2c33 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:26.962861 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b6ef3-d9ae-4adc-9baf-5f5238bc2c33 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:26.963130 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b6ef3-d9ae-4adc-9baf-5f5238bc2c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:26.981240 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-531b6ef3-d9ae-4adc-9baf-5f5238bc2c33 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:26.982458 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-531b6ef3-d9ae-4adc-9baf-5f5238bc2c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:26.991647 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b39afb-b220-46fa-ab4c-d58618c3ee1d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:27.005216 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:27.017553 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:27.024350 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0c4c3-840d-4d1e-bb3c-e642661fdebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:27.024949 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0c4c3-840d-4d1e-bb3c-e642661fdebf None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:27.025225 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0c4c3-840d-4d1e-bb3c-e642661fdebf None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:27.025496 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0c4c3-840d-4d1e-bb3c-e642661fdebf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:27.026224 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0c4c3-840d-4d1e-bb3c-e642661fdebf None admin] RBAC: Adding query filter params (interface=public, service_id=17bd118f1df64d59979e28f989a4d026, region_id=RegionOne) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:27.026538 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0c4c3-840d-4d1e-bb3c-e642661fdebf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:27.028410 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0c4c3-840d-4d1e-bb3c-e642661fdebf None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:27.033267 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 461/928] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Aug 24 14:20:26 2022] GET /identity/v3/endpoints?service_id=17bd118f1df64d59979e28f989a4d026&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:27.034061 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0c4c3-840d-4d1e-bb3c-e642661fdebf None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:27.052036 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 468/929] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:20:27.052848 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b6ef3-d9ae-4adc-9baf-5f5238bc2c33 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:27.153821 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0c4c3-840d-4d1e-bb3c-e642661fdebf None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:27.155952 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b6ef3-d9ae-4adc-9baf-5f5238bc2c33 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:27.193013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7b8df-cd16-4f2c-acf0-c067003c1974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:27.193504 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a223ba-198f-41d8-9244-b622966e8f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:27.193625 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7b8df-cd16-4f2c-acf0-c067003c1974 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:27.193940 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7b8df-cd16-4f2c-acf0-c067003c1974 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:27.194134 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a223ba-198f-41d8-9244-b622966e8f7b None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:27.194247 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7b8df-cd16-4f2c-acf0-c067003c1974 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:27.194403 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a223ba-198f-41d8-9244-b622966e8f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:27.194673 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a223ba-198f-41d8-9244-b622966e8f7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:27.195501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a223ba-198f-41d8-9244-b622966e8f7b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:27.197332 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a223ba-198f-41d8-9244-b622966e8f7b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:27.206044 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7b8df-cd16-4f2c-acf0-c067003c1974 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:27.207602 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7b8df-cd16-4f2c-acf0-c067003c1974 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:27.222488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-33b7b8df-cd16-4f2c-acf0-c067003c1974 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:27.222488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:27.222488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:27.222488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:27.222488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:27.222488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:27.222488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:27.222488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:27.222488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:27.222488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:27.222488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:27.222488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:27.222488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:27.222488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:27.222488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:27.222488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:27.223614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:27.223614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:27.223614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:27.223614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:27.223614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:27.223614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:27.223614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:27.223614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:27.223614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:27.223614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:27.223614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:27.223614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:27.223614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:27.223614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:27.223614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:27.223614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:27.223614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:27.224489 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:27.224489 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:27.224489 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:27.224489 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 462/930] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:27.224489 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7b8df-cd16-4f2c-acf0-c067003c1974 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:27.263039 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:27.281899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 469/931] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:20:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:20:27.281899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a223ba-198f-41d8-9244-b622966e8f7b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:27.319714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:27.355864 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7b8df-cd16-4f2c-acf0-c067003c1974 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:27.399928 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30961c6d-da58-418f-ab0b-0ff12e2a3023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:27.400539 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30961c6d-da58-418f-ab0b-0ff12e2a3023 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:27.400813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30961c6d-da58-418f-ab0b-0ff12e2a3023 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:27.401072 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30961c6d-da58-418f-ab0b-0ff12e2a3023 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:27.402358 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30961c6d-da58-418f-ab0b-0ff12e2a3023 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:27.404287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30961c6d-da58-418f-ab0b-0ff12e2a3023 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:27.405914 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a223ba-198f-41d8-9244-b622966e8f7b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:27.421794 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 463/932] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Aug 24 14:20:27 2022] GET /identity/v3/services => generated 1497 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:20:27.421794 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30961c6d-da58-418f-ab0b-0ff12e2a3023 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:27.459448 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77b156-803e-4965-8d3a-b1c477b3a6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:27.460067 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77b156-803e-4965-8d3a-b1c477b3a6d3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:27.460346 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77b156-803e-4965-8d3a-b1c477b3a6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:27.460621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77b156-803e-4965-8d3a-b1c477b3a6d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:27.461280 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77b156-803e-4965-8d3a-b1c477b3a6d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:27.462238 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77b156-803e-4965-8d3a-b1c477b3a6d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:27.464018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77b156-803e-4965-8d3a-b1c477b3a6d3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:27.478467 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 470/933] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:27.484594 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77b156-803e-4965-8d3a-b1c477b3a6d3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:27.561534 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:27.573295 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30961c6d-da58-418f-ab0b-0ff12e2a3023 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:27.612916 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:27.622856 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549f07c-bf93-4ee3-9566-f3be97dc3377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:27.623496 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549f07c-bf93-4ee3-9566-f3be97dc3377 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:27.623787 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549f07c-bf93-4ee3-9566-f3be97dc3377 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:27.624048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549f07c-bf93-4ee3-9566-f3be97dc3377 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:27.625902 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1549f07c-bf93-4ee3-9566-f3be97dc3377 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:27.626149 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1549f07c-bf93-4ee3-9566-f3be97dc3377 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:27.632736 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77b156-803e-4965-8d3a-b1c477b3a6d3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:27.637199 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-1549f07c-bf93-4ee3-9566-f3be97dc3377 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 14:20:27.637199 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:27.637199 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:20:27.637199 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:20:27.637199 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:20:27.637199 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:20:27.637199 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:20:27.637199 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:27.637199 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 14:20:27.637199 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:27.637199 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:20:27.637199 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:27.637199 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:27.637199 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:27.637199 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:27.637199 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:27.638385 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:27.638385 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:27.638385 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:27.638385 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:27.638385 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:27.638385 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:27.638385 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:27.638385 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:20:27.638385 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:20:27.638385 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:20:27.638385 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:20:27.638385 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:27.638385 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:27.638385 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:27.638385 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:27.638385 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:27.638385 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:27.639285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:27.639285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:27.639285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:27.639285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:27.639285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:27.639285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:27.639285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:27.639285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:27.639285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:27.639285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:27.639285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:20:27.639285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:27.639285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 14:20:27.639285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:27.643437 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 464/934] 10.222.0.65 () {56 vars in 1132 bytes} [Wed Aug 24 14:20:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:27.645135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549f07c-bf93-4ee3-9566-f3be97dc3377 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:27.673538 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5c0da-3d20-492c-98aa-f46538520aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:27.674112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5c0da-3d20-492c-98aa-f46538520aae None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:27.674452 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5c0da-3d20-492c-98aa-f46538520aae None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:27.674729 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5c0da-3d20-492c-98aa-f46538520aae None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:27.682640 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c5c0da-3d20-492c-98aa-f46538520aae None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:27.685155 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c5c0da-3d20-492c-98aa-f46538520aae None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:27.696633 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-c8c5c0da-3d20-492c-98aa-f46538520aae None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 14:20:27.696633 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:27.696633 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:27.696633 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:27.696633 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:27.696633 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:27.696633 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:27.696633 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:27.696633 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:27.696633 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:27.696633 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:27.696633 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:27.696633 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:20:27.696633 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:20:27.696633 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:20:27.696633 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:20:27.697658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:27.697658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:27.697658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:20:27.697658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:27.697658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:20:27.697658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:27.697658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:27.697658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:27.697658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:27.697658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:27.697658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:27.697658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:27.697658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:27.697658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:27.697658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:27.697658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:27.697658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:27.697658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:27.699315 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:27.699315 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:27.699315 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:20:27.699315 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:20:27.699315 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:20:27.699315 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:20:27.699315 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:20:27.699315 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:20:27.699315 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 14:20:27.699315 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:27.699315 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 471/935] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Aug 24 14:20:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:27.704682 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5c0da-3d20-492c-98aa-f46538520aae None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:27.782023 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549f07c-bf93-4ee3-9566-f3be97dc3377 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:27.820100 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b8895-43ad-4313-adf9-5cb988b7ed83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:27.821172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b8895-43ad-4313-adf9-5cb988b7ed83 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:27.821697 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b8895-43ad-4313-adf9-5cb988b7ed83 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:27.822207 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b8895-43ad-4313-adf9-5cb988b7ed83 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:27.823140 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b8895-43ad-4313-adf9-5cb988b7ed83 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:27.823777 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b8895-43ad-4313-adf9-5cb988b7ed83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:27.825463 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b8895-43ad-4313-adf9-5cb988b7ed83 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:27.829058 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5c0da-3d20-492c-98aa-f46538520aae None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:27.837076 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 465/936] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 14:20:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:27.838679 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b8895-43ad-4313-adf9-5cb988b7ed83 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:27.861775 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:27.864310 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9326b00-966c-4093-85d2-2d928410815e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:27.864905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9326b00-966c-4093-85d2-2d928410815e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:27.865181 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9326b00-966c-4093-85d2-2d928410815e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:27.865453 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9326b00-966c-4093-85d2-2d928410815e None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:27.866240 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9326b00-966c-4093-85d2-2d928410815e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:27.866547 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9326b00-966c-4093-85d2-2d928410815e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:27.867973 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9326b00-966c-4093-85d2-2d928410815e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:27.892665 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 472/937] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Aug 24 14:20:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:27.893591 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9326b00-966c-4093-85d2-2d928410815e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:27.905445 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:27.956858 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b8895-43ad-4313-adf9-5cb988b7ed83 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:27.991391 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b258e-d086-4356-96b0-7c49134edf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:27.992043 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b258e-d086-4356-96b0-7c49134edf07 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:27.992321 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b258e-d086-4356-96b0-7c49134edf07 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:27.992728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b258e-d086-4356-96b0-7c49134edf07 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:27.993320 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b258e-d086-4356-96b0-7c49134edf07 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:27.993627 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b258e-d086-4356-96b0-7c49134edf07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:27.995011 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b258e-d086-4356-96b0-7c49134edf07 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:28.001795 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 466/938] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 14:20:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:28.007947 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b258e-d086-4356-96b0-7c49134edf07 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:28.036264 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9326b00-966c-4093-85d2-2d928410815e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:28.082616 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349d8dd-c548-48ae-acec-9bbf6f49cefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:28.083387 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349d8dd-c548-48ae-acec-9bbf6f49cefd None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:28.083880 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349d8dd-c548-48ae-acec-9bbf6f49cefd None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:28.084364 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349d8dd-c548-48ae-acec-9bbf6f49cefd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:28.099423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349d8dd-c548-48ae-acec-9bbf6f49cefd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:28.100976 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349d8dd-c548-48ae-acec-9bbf6f49cefd None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:28.112336 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:28.122228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-9349d8dd-c548-48ae-acec-9bbf6f49cefd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:28.122228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:28.122228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:28.122228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:28.122228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:28.122228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:28.122228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:28.122228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:28.122228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:28.122228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:28.122228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:28.122228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:28.122228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:28.122228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:28.122228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:28.122228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:28.124509 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:28.124509 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:28.124509 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:28.124509 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:28.124509 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:28.124509 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:28.124509 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:28.124509 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:28.124509 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:28.124509 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:28.124509 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:28.124509 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:28.124509 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:28.124509 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:28.124509 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:28.124509 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:28.124509 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:28.125543 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:28.125543 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:28.125543 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:28.125543 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 473/939] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:28.130589 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349d8dd-c548-48ae-acec-9bbf6f49cefd None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:28.139766 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b258e-d086-4356-96b0-7c49134edf07 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:28.178034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062e060-b304-4c6f-9f8d-2fc400bac3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:28.178635 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062e060-b304-4c6f-9f8d-2fc400bac3c5 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:28.178913 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062e060-b304-4c6f-9f8d-2fc400bac3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:28.179231 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062e060-b304-4c6f-9f8d-2fc400bac3c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:28.179980 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062e060-b304-4c6f-9f8d-2fc400bac3c5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:28.181626 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062e060-b304-4c6f-9f8d-2fc400bac3c5 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:28.210064 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:28.251212 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349d8dd-c548-48ae-acec-9bbf6f49cefd None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:28.293997 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 467/940] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:20:28 2022] POST /identity/v3/endpoints => generated 347 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:20:28.308784 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df4de9-9419-4078-8024-20c82fae3d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:28.309618 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df4de9-9419-4078-8024-20c82fae3d70 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:28.310067 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df4de9-9419-4078-8024-20c82fae3d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:28.310464 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df4de9-9419-4078-8024-20c82fae3d70 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:28.311297 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df4de9-9419-4078-8024-20c82fae3d70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:28.311747 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df4de9-9419-4078-8024-20c82fae3d70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:28.313339 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df4de9-9419-4078-8024-20c82fae3d70 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:28.328860 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 474/941] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:28.334517 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062e060-b304-4c6f-9f8d-2fc400bac3c5 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:28.454283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062e060-b304-4c6f-9f8d-2fc400bac3c5 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:28.494624 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0dae0-c711-40a4-97cf-7aefe3d75b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:28.495233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0dae0-c711-40a4-97cf-7aefe3d75b72 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:28.495599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0dae0-c711-40a4-97cf-7aefe3d75b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:28.495875 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0dae0-c711-40a4-97cf-7aefe3d75b72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:28.503388 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0dae0-c711-40a4-97cf-7aefe3d75b72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:28.504834 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0dae0-c711-40a4-97cf-7aefe3d75b72 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:28.506771 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:28.516947 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-8fa0dae0-c711-40a4-97cf-7aefe3d75b72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:28.516947 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:28.516947 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:28.516947 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:28.516947 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:28.516947 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:28.516947 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:28.516947 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:28.516947 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:28.516947 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:28.516947 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:28.516947 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:28.516947 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:20:28.516947 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:20:28.516947 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:20:28.521510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:20:28.521510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:28.521510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:28.521510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:28.521510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:28.521510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:28.521510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:28.521510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:28.521510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:28.521510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:28.521510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:28.521510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:28.521510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:28.521510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:28.521510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:28.521510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:28.521510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:28.522444 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:20:28.522444 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:20:28.522444 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:20:28.522444 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:20:28.522444 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:20:28.522444 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:20:28.522444 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:28.522444 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:28.522444 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 468/942] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:20:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:20:28.524549 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df4de9-9419-4078-8024-20c82fae3d70 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:28.633604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df4de9-9419-4078-8024-20c82fae3d70 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:28.649282 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:28.673558 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec250b-aa70-4538-a68d-92d0b3256cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:28.674520 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec250b-aa70-4538-a68d-92d0b3256cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:28.675061 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec250b-aa70-4538-a68d-92d0b3256cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:28.675545 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec250b-aa70-4538-a68d-92d0b3256cc6 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:28.676494 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec250b-aa70-4538-a68d-92d0b3256cc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:28.677000 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec250b-aa70-4538-a68d-92d0b3256cc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:28.678736 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec250b-aa70-4538-a68d-92d0b3256cc6 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:28.691220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 475/943] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:20:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:28.697996 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0dae0-c711-40a4-97cf-7aefe3d75b72 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:28.807586 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0dae0-c711-40a4-97cf-7aefe3d75b72 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:28.845175 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac2c5d-b382-4c02-bc7e-0f2b24840576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:28.846275 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac2c5d-b382-4c02-bc7e-0f2b24840576 None admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:28.846758 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac2c5d-b382-4c02-bc7e-0f2b24840576 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:28.847250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac2c5d-b382-4c02-bc7e-0f2b24840576 None admin] PATH_INFO: `/v3/projects/34cce205e8ee4ae9b09bb89bc4bb081e/users/477ab357d285415e8c0c82d414d242ba/roles/89526ad5407b4974a7368c7aa6411cf8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:28.849651 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac2c5d-b382-4c02-bc7e-0f2b24840576 None admin] RBAC: Authorizing `identity:create_grant(project_id=34cce205e8ee4ae9b09bb89bc4bb081e, user_id=477ab357d285415e8c0c82d414d242ba, role_id=89526ad5407b4974a7368c7aa6411cf8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:28.851324 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac2c5d-b382-4c02-bc7e-0f2b24840576 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:28.925891 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 469/944] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 14:20:28 2022] PUT /identity/v3/projects/34cce205e8ee4ae9b09bb89bc4bb081e/users/477ab357d285415e8c0c82d414d242ba/roles/89526ad5407b4974a7368c7aa6411cf8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:20:29.360041 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe7ef7-db83-410f-8f92-515c77e3a841 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:29.360625 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe7ef7-db83-410f-8f92-515c77e3a841 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:29.360625 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe7ef7-db83-410f-8f92-515c77e3a841 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:29.362215 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 476/945] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:29.367491 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f99a6-cedc-4272-a488-9be6c002409c None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:29.367934 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f99a6-cedc-4272-a488-9be6c002409c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:29.368149 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f99a6-cedc-4272-a488-9be6c002409c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:29.388313 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-db8f99a6-cedc-4272-a488-9be6c002409c None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:29.389525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-db8f99a6-cedc-4272-a488-9be6c002409c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:29.438846 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01586c0f-d0b0-4f15-961a-de4493cbfcbf None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:29.445083 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01586c0f-d0b0-4f15-961a-de4493cbfcbf None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:29.445083 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01586c0f-d0b0-4f15-961a-de4493cbfcbf None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:29.445083 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 477/946] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:29.446074 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ae00b-e616-4947-9afa-a4db0e1fad9a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:29.446353 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ae00b-e616-4947-9afa-a4db0e1fad9a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:29.446719 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ae00b-e616-4947-9afa-a4db0e1fad9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:29.451786 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:29.466527 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c88ae00b-e616-4947-9afa-a4db0e1fad9a None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:29.467728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c88ae00b-e616-4947-9afa-a4db0e1fad9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:29.471447 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 470/947] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:20:29.546299 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 478/948] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:20:29.747317 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f99a6-cedc-4272-a488-9be6c002409c None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:29.818235 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ae00b-e616-4947-9afa-a4db0e1fad9a None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:29.860436 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f99a6-cedc-4272-a488-9be6c002409c None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:29.907750 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af49c5-63cf-4380-a094-3d9fdc27feed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:29.908370 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af49c5-63cf-4380-a094-3d9fdc27feed None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:29.908654 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af49c5-63cf-4380-a094-3d9fdc27feed None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:29.908932 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af49c5-63cf-4380-a094-3d9fdc27feed None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:29.909578 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af49c5-63cf-4380-a094-3d9fdc27feed None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:29.911871 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af49c5-63cf-4380-a094-3d9fdc27feed None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:29.915726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: WARNING keystone.server.flask.common [None req-e6af49c5-63cf-4380-a094-3d9fdc27feed None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 14:20:29.923054 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ae00b-e616-4947-9afa-a4db0e1fad9a None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:29.926516 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:29.959247 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178382db-e2cf-45e0-b130-840ef29e93c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:29.959864 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178382db-e2cf-45e0-b130-840ef29e93c0 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:29.960142 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178382db-e2cf-45e0-b130-840ef29e93c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:29.960407 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178382db-e2cf-45e0-b130-840ef29e93c0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:29.960983 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178382db-e2cf-45e0-b130-840ef29e93c0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:29.962390 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178382db-e2cf-45e0-b130-840ef29e93c0 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:29.967163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.sql.core [None req-e6af49c5-63cf-4380-a094-3d9fdc27feed None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 14:20:29.967163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 14:20:29.967163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [parameters: {'id': 'ccf169e594fa4bc78c546d5548c1fead', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 14:20:29.967163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81742) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 14:20:29.973530 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-178382db-e2cf-45e0-b130-840ef29e93c0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 14:20:29.973530 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:29.973530 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:20:29.973530 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:20:29.973530 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:20:29.973530 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:20:29.973530 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:20:29.973530 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:29.973530 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 14:20:29.973530 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:29.973530 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:20:29.973530 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:29.973530 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:29.973530 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:29.973530 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:29.973530 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:29.973530 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:29.978150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:29.978150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:29.978150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:29.978150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:29.978150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:29.978150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:29.978150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:20:29.978150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:20:29.978150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:20:29.978150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:20:29.978150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:29.978150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:29.978150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:29.978150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:29.978150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:29.978150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:29.979060 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:29.979060 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:29.979060 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:29.979060 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:29.979060 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:29.979060 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:29.979060 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:29.979060 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:29.979060 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:29.979060 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:29.979060 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:20:29.979060 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:29.979060 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 14:20:29.979060 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:29.981076 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 479/949] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 14:20:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:29.981868 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178382db-e2cf-45e0-b130-840ef29e93c0 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:29.989454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-e6af49c5-63cf-4380-a094-3d9fdc27feed None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ccf169e594fa4bc78c546d5548c1fead.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ccf169e594fa4bc78c546d5548c1fead. Aug 24 14:20:29.989454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:29.989454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 14:20:29.989454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 14:20:29.989454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 14:20:29.989454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 14:20:29.989454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 14:20:29.989454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 14:20:29.989454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 14:20:29.989454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application conn.query(q) Aug 24 14:20:29.989454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 14:20:29.989454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 14:20:29.989454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 14:20:29.990377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application result.read() Aug 24 14:20:29.990377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 14:20:29.990377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 14:20:29.990377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 14:20:29.990377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 14:20:29.990377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 14:20:29.990377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 14:20:29.990377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 14:20:29.990377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 14:20:29.990377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 14:20:29.990377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:29.990377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 14:20:29.990377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:29.990377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:29.990377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 14:20:29.990377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 14:20:29.990377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 14:20:29.990377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 14:20:29.991381 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 14:20:29.991381 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application next(self.gen) Aug 24 14:20:29.991381 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 14:20:29.991381 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application yield resource Aug 24 14:20:29.991381 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 14:20:29.991381 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application next(self.gen) Aug 24 14:20:29.991381 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 14:20:29.991381 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 14:20:29.991381 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 14:20:29.991381 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 14:20:29.991381 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 14:20:29.991381 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise self.value Aug 24 14:20:29.991381 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 14:20:29.991381 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 14:20:29.991381 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 14:20:29.991381 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application session.commit() Aug 24 14:20:29.991381 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 14:20:29.992367 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 14:20:29.992367 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 14:20:29.992367 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 14:20:29.992367 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 14:20:29.992367 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application self.session.flush() Aug 24 14:20:29.992367 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 14:20:29.992367 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 14:20:29.992367 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 14:20:29.992367 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 14:20:29.992367 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 14:20:29.992367 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application compat.raise_( Aug 24 14:20:29.992367 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 14:20:29.992367 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception Aug 24 14:20:29.992367 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 14:20:29.992367 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 14:20:29.992367 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 14:20:29.992367 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 14:20:29.993285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 14:20:29.993285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 14:20:29.993285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 14:20:29.993285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 14:20:29.993285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 14:20:29.993285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 14:20:29.993285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 14:20:29.993285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 14:20:29.993285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 14:20:29.993285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 14:20:29.993285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 14:20:29.993285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 14:20:29.993285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 14:20:29.993285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 14:20:29.993285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 14:20:29.998820 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 14:20:29.998820 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 14:20:29.998820 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception Aug 24 14:20:29.998820 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 14:20:29.998820 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 14:20:29.998820 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 14:20:29.998820 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 14:20:29.998820 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 14:20:29.998820 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 14:20:29.998820 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 14:20:29.998820 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application conn.query(q) Aug 24 14:20:29.998820 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 14:20:29.998820 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 14:20:29.998820 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 14:20:29.998820 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application result.read() Aug 24 14:20:29.998820 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 14:20:29.998820 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 14:20:29.999689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 14:20:29.999689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 14:20:29.999689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 14:20:29.999689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 14:20:29.999689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 14:20:29.999689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 14:20:29.999689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 14:20:29.999689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 14:20:29.999689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [parameters: {'id': 'ccf169e594fa4bc78c546d5548c1fead', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 14:20:29.999689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 14:20:29.999689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:29.999689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:20:29.999689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:29.999689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:29.999689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 14:20:30.000525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 14:20:30.000525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 14:20:30.000525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 14:20:30.000525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 14:20:30.000525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:30.000525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:20:30.000525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:30.000525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:30.000525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:30.000525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:30.000525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:30.000525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:30.000525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:30.000525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:30.000525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:30.000525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:30.000525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:30.001457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:30.001457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 14:20:30.001457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 14:20:30.001457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:30.001457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:30.001457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 14:20:30.001457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 14:20:30.001457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ccf169e594fa4bc78c546d5548c1fead. Aug 24 14:20:30.001457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:30.001457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 471/950] 10.222.0.65 () {60 vars in 1140 bytes} [Wed Aug 24 14:20:29 2022] POST /identity/v3/projects => generated 262 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:30.001457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af49c5-63cf-4380-a094-3d9fdc27feed None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:30.043453 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:30.102664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af49c5-63cf-4380-a094-3d9fdc27feed None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:30.109802 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178382db-e2cf-45e0-b130-840ef29e93c0 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:30.141631 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1b22f-c28b-4c7b-a4de-9f61b16c627f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:30.142311 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1b22f-c28b-4c7b-a4de-9f61b16c627f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:30.142591 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1b22f-c28b-4c7b-a4de-9f61b16c627f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:30.142868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1b22f-c28b-4c7b-a4de-9f61b16c627f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:30.150138 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1b22f-c28b-4c7b-a4de-9f61b16c627f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:30.152484 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8e4fb-d80d-4a54-8e4a-501016a06b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:30.152764 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1b22f-c28b-4c7b-a4de-9f61b16c627f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:30.153692 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8e4fb-d80d-4a54-8e4a-501016a06b7d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:30.154457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8e4fb-d80d-4a54-8e4a-501016a06b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:30.154901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8e4fb-d80d-4a54-8e4a-501016a06b7d None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:30.155822 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8e4fb-d80d-4a54-8e4a-501016a06b7d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:30.156454 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8e4fb-d80d-4a54-8e4a-501016a06b7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:30.158170 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8e4fb-d80d-4a54-8e4a-501016a06b7d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:30.168905 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-75e1b22f-c28b-4c7b-a4de-9f61b16c627f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:30.168905 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:30.168905 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:30.168905 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:30.168905 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:30.168905 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:30.168905 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:30.168905 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:30.168905 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:30.168905 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:30.168905 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:30.168905 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:30.168905 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:20:30.168905 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:20:30.168905 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:20:30.169926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:20:30.169926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:30.169926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:30.169926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:30.169926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:30.169926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:30.169926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:30.169926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:30.169926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:30.169926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:30.169926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:30.169926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:30.169926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:30.169926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:30.169926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:30.169926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:30.169926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:30.170868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:20:30.170868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:20:30.170868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:20:30.170868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:20:30.170868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:20:30.170868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:20:30.170868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:30.170868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:30.170868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 472/951] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:20:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:20:30.171899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 480/952] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Aug 24 14:20:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:30.172842 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1b22f-c28b-4c7b-a4de-9f61b16c627f None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:30.173220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8e4fb-d80d-4a54-8e4a-501016a06b7d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:30.209426 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:30.282691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1b22f-c28b-4c7b-a4de-9f61b16c627f None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:30.285053 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:30.289086 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8e4fb-d80d-4a54-8e4a-501016a06b7d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:30.317861 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10a2d3-3d88-4f1a-810e-31c657126f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:30.318658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10a2d3-3d88-4f1a-810e-31c657126f99 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:30.318791 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10a2d3-3d88-4f1a-810e-31c657126f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:30.319007 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10a2d3-3d88-4f1a-810e-31c657126f99 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:30.319722 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10a2d3-3d88-4f1a-810e-31c657126f99 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:30.319940 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10a2d3-3d88-4f1a-810e-31c657126f99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:30.321411 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10a2d3-3d88-4f1a-810e-31c657126f99 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:30.328361 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e9aaf-a1a4-4518-81c5-70c588437ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:30.329239 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e9aaf-a1a4-4518-81c5-70c588437ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:30.329682 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e9aaf-a1a4-4518-81c5-70c588437ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:30.330136 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e9aaf-a1a4-4518-81c5-70c588437ff5 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:30.335159 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 473/953] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Aug 24 14:20:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:30.335796 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e9aaf-a1a4-4518-81c5-70c588437ff5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:30.336219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10a2d3-3d88-4f1a-810e-31c657126f99 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:30.336427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e9aaf-a1a4-4518-81c5-70c588437ff5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:30.338233 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e9aaf-a1a4-4518-81c5-70c588437ff5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:30.358661 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 481/954] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 14:20:30 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:30.372234 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13316c9f-790b-4ac1-8420-95889f6f6ddb None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:30.372861 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13316c9f-790b-4ac1-8420-95889f6f6ddb None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:30.372861 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13316c9f-790b-4ac1-8420-95889f6f6ddb None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:30.374527 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 482/955] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:30.380924 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78975da8-b61a-46dc-b804-973544edbbb8 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:30.381301 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78975da8-b61a-46dc-b804-973544edbbb8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:30.381501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78975da8-b61a-46dc-b804-973544edbbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:30.405495 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-78975da8-b61a-46dc-b804-973544edbbb8 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:30.407306 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-78975da8-b61a-46dc-b804-973544edbbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:30.472718 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10a2d3-3d88-4f1a-810e-31c657126f99 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:30.506920 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 483/956] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:20:30.525878 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e582a-6755-4fe8-9a63-01add1e55da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:30.527700 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e582a-6755-4fe8-9a63-01add1e55da2 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:30.528344 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e582a-6755-4fe8-9a63-01add1e55da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:30.528835 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e582a-6755-4fe8-9a63-01add1e55da2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:30.529738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e582a-6755-4fe8-9a63-01add1e55da2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:30.531379 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e582a-6755-4fe8-9a63-01add1e55da2 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:30.616516 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 474/957] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:20:30 2022] POST /identity/v3/endpoints => generated 349 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:20:30.784433 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78975da8-b61a-46dc-b804-973544edbbb8 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:30.811536 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:30.892501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78975da8-b61a-46dc-b804-973544edbbb8 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:30.935749 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86254e-5ba6-4559-848a-6b406a3a36ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:30.936777 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86254e-5ba6-4559-848a-6b406a3a36ad None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:30.937312 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86254e-5ba6-4559-848a-6b406a3a36ad None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:30.937833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86254e-5ba6-4559-848a-6b406a3a36ad None admin] PATH_INFO: `/v3/services/compute` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:30.938637 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86254e-5ba6-4559-848a-6b406a3a36ad None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:30.940211 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86254e-5ba6-4559-848a-6b406a3a36ad None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:30.949733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-7a86254e-5ba6-4559-848a-6b406a3a36ad None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 14:20:30.949733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:30.949733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:20:30.949733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:20:30.949733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:20:30.949733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:20:30.949733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:20:30.949733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:30.949733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 14:20:30.949733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:30.949733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:20:30.949733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:30.949733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:30.949733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:30.949733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:30.949733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:30.949733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:30.950904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:30.950904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:30.950904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:30.950904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:30.950904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:30.950904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:30.950904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:20:30.950904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:20:30.950904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:20:30.950904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:20:30.950904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:30.950904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:30.950904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:30.950904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:30.950904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:30.950904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:30.951753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:30.951753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:30.951753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:30.951753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:30.951753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:30.951753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:30.951753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:30.951753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:30.951753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:30.951753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:30.951753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:20:30.951753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:30.951753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 14:20:30.951753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:30.954513 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 484/958] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:20:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:30.960615 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e582a-6755-4fe8-9a63-01add1e55da2 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:30.983495 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31421b8c-8cf2-4a58-b431-4e7a545d41b4 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:30.983818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31421b8c-8cf2-4a58-b431-4e7a545d41b4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:30.984051 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31421b8c-8cf2-4a58-b431-4e7a545d41b4 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:30.985648 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 485/959] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:30.990671 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:30.990822 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f13b1c-c0c7-4449-a4a7-bfb2c8d52669 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:30.991008 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f13b1c-c0c7-4449-a4a7-bfb2c8d52669 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:30.991245 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f13b1c-c0c7-4449-a4a7-bfb2c8d52669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:31.010195 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a7f13b1c-c0c7-4449-a4a7-bfb2c8d52669 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:31.011908 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a7f13b1c-c0c7-4449-a4a7-bfb2c8d52669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:31.078528 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e582a-6755-4fe8-9a63-01add1e55da2 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:31.105902 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 486/960] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:20:31.121550 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df01d08-0a7a-414e-9674-00bebce649ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:31.122492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df01d08-0a7a-414e-9674-00bebce649ff None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:31.123094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df01d08-0a7a-414e-9674-00bebce649ff None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:31.123571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df01d08-0a7a-414e-9674-00bebce649ff None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:31.124460 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df01d08-0a7a-414e-9674-00bebce649ff None admin] RBAC: Adding query filter params (name=compute) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:31.124968 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df01d08-0a7a-414e-9674-00bebce649ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:31.126642 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df01d08-0a7a-414e-9674-00bebce649ff None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:31.132494 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 475/961] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 14:20:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:31.139064 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f13b1c-c0c7-4449-a4a7-bfb2c8d52669 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:31.156380 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:31.246106 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f13b1c-c0c7-4449-a4a7-bfb2c8d52669 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:31.284604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342b028-abd0-48cb-87fd-1a40f9017b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:31.285521 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342b028-abd0-48cb-87fd-1a40f9017b36 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:31.286046 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342b028-abd0-48cb-87fd-1a40f9017b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:31.286530 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342b028-abd0-48cb-87fd-1a40f9017b36 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:31.287361 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342b028-abd0-48cb-87fd-1a40f9017b36 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:31.287883 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342b028-abd0-48cb-87fd-1a40f9017b36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:31.289480 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342b028-abd0-48cb-87fd-1a40f9017b36 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:31.295007 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 487/962] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 14:20:31 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:31.389431 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df01d08-0a7a-414e-9674-00bebce649ff None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:31.485945 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:31.498755 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df01d08-0a7a-414e-9674-00bebce649ff None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:31.534400 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594add50-eb90-4d2c-a252-640dc1400b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:31.535031 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594add50-eb90-4d2c-a252-640dc1400b52 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:31.535311 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594add50-eb90-4d2c-a252-640dc1400b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:31.535588 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594add50-eb90-4d2c-a252-640dc1400b52 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:31.546574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594add50-eb90-4d2c-a252-640dc1400b52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:20:31.551307 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-594add50-eb90-4d2c-a252-640dc1400b52 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 14:20:31.551307 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:31.551307 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:31.551307 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:31.551307 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:31.551307 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:31.551307 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:31.551307 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:31.551307 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:31.551307 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:31.551307 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:31.551307 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:31.551307 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:20:31.551307 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:20:31.551307 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:20:31.551307 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:20:31.552233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:20:31.552233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:20:31.552233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:20:31.552233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:20:31.552233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:31.552233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:31.552233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:31.552233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:31.552233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:31.552233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:31.552233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:31.552233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:31.552233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:31.552233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:31.552233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:31.552233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:31.553112 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:31.553112 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:31.553112 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:31.553112 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:31.553112 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:20:31.553112 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:20:31.553112 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:20:31.553112 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:20:31.553112 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:20:31.553112 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:20:31.553112 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 14:20:31.553112 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:31.553112 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 476/963] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Aug 24 14:20:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:31.559323 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342b028-abd0-48cb-87fd-1a40f9017b36 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:31.644628 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:31.669881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342b028-abd0-48cb-87fd-1a40f9017b36 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:31.704913 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2da6a-ba6d-45cb-a680-1a75b66d43f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:31.705522 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2da6a-ba6d-45cb-a680-1a75b66d43f8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:31.705934 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2da6a-ba6d-45cb-a680-1a75b66d43f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:31.706215 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2da6a-ba6d-45cb-a680-1a75b66d43f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:31.706880 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2da6a-ba6d-45cb-a680-1a75b66d43f8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:31.707186 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2da6a-ba6d-45cb-a680-1a75b66d43f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:31.708561 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2da6a-ba6d-45cb-a680-1a75b66d43f8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:31.717736 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 488/964] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Aug 24 14:20:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:31.723317 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594add50-eb90-4d2c-a252-640dc1400b52 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:31.830874 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594add50-eb90-4d2c-a252-640dc1400b52 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:31.867348 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329c2ac-23f2-4e0d-91d3-3968db079e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:31.867980 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329c2ac-23f2-4e0d-91d3-3968db079e5e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:31.868259 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329c2ac-23f2-4e0d-91d3-3968db079e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:31.868535 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329c2ac-23f2-4e0d-91d3-3968db079e5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:31.879756 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329c2ac-23f2-4e0d-91d3-3968db079e5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:31.881194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329c2ac-23f2-4e0d-91d3-3968db079e5e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:31.890077 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:31.896406 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-6329c2ac-23f2-4e0d-91d3-3968db079e5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:31.896406 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:31.896406 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:31.896406 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:31.896406 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:31.896406 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:31.896406 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:31.896406 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:31.896406 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:31.896406 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:31.896406 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:31.896406 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:31.896406 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:31.896406 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:31.896406 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:31.896406 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:31.897356 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:31.897356 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:31.897356 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:31.897356 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:31.897356 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:31.897356 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:31.897356 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:31.897356 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:31.897356 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:31.897356 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:31.897356 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:31.897356 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:31.897356 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:31.897356 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:31.897356 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:31.897356 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:31.897356 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:31.898302 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:31.898302 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:31.898302 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:31.902112 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 477/965] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:31.907517 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2da6a-ba6d-45cb-a680-1a75b66d43f8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:32.009533 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2da6a-ba6d-45cb-a680-1a75b66d43f8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:32.044425 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4d825-4b19-475a-b8b6-7b7c58f47716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:32.045037 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4d825-4b19-475a-b8b6-7b7c58f47716 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:32.045320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4d825-4b19-475a-b8b6-7b7c58f47716 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:32.045595 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4d825-4b19-475a-b8b6-7b7c58f47716 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:32.046275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4d825-4b19-475a-b8b6-7b7c58f47716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:32.046581 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4d825-4b19-475a-b8b6-7b7c58f47716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:32.047952 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4d825-4b19-475a-b8b6-7b7c58f47716 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:32.055232 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:32.061218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 489/966] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:32.067522 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329c2ac-23f2-4e0d-91d3-3968db079e5e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:32.172974 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329c2ac-23f2-4e0d-91d3-3968db079e5e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:32.211654 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501dc0b0-32a3-4a63-abec-dee9aba7bdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:32.212293 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501dc0b0-32a3-4a63-abec-dee9aba7bdb3 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:32.212573 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501dc0b0-32a3-4a63-abec-dee9aba7bdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:32.212848 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501dc0b0-32a3-4a63-abec-dee9aba7bdb3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:32.223278 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501dc0b0-32a3-4a63-abec-dee9aba7bdb3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:32.224716 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501dc0b0-32a3-4a63-abec-dee9aba7bdb3 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:32.236883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-501dc0b0-32a3-4a63-abec-dee9aba7bdb3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 14:20:32.236883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:32.236883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:32.236883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:32.236883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:32.236883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:32.236883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:32.236883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:32.236883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:32.236883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:32.236883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:32.236883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:32.236883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:20:32.236883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:20:32.236883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:20:32.236883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:20:32.237906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:32.237906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:32.237906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:20:32.237906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:32.237906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:20:32.237906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:32.237906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:32.237906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:32.237906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:32.237906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:32.237906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:32.237906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:32.237906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:32.237906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:32.237906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:32.237906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:32.237906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:32.237906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:32.238858 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:32.238858 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:32.238858 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:20:32.238858 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:20:32.238858 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:20:32.238858 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:20:32.238858 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:20:32.238858 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:20:32.238858 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 14:20:32.238858 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:32.238858 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 478/967] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Aug 24 14:20:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:20:32.243800 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4d825-4b19-475a-b8b6-7b7c58f47716 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:32.349621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4d825-4b19-475a-b8b6-7b7c58f47716 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:32.385504 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45739882-a878-4ec3-ac90-1fe177bdd4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:32.386286 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45739882-a878-4ec3-ac90-1fe177bdd4e6 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:32.386649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45739882-a878-4ec3-ac90-1fe177bdd4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:32.386824 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45739882-a878-4ec3-ac90-1fe177bdd4e6 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:32.387555 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45739882-a878-4ec3-ac90-1fe177bdd4e6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:32.387856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45739882-a878-4ec3-ac90-1fe177bdd4e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:32.389277 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45739882-a878-4ec3-ac90-1fe177bdd4e6 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:32.407737 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 490/968] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Aug 24 14:20:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:32.413212 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501dc0b0-32a3-4a63-abec-dee9aba7bdb3 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:32.456768 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fdf34-7545-4e0c-a9ee-3a625e2534d2 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:32.456963 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fdf34-7545-4e0c-a9ee-3a625e2534d2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:32.457215 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fdf34-7545-4e0c-a9ee-3a625e2534d2 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:32.458895 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 491/969] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:32.465527 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79c5da-4e47-4c04-a631-5a681ba0ce52 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:32.466190 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79c5da-4e47-4c04-a631-5a681ba0ce52 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:32.466701 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79c5da-4e47-4c04-a631-5a681ba0ce52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:32.482637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:32.488273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4a79c5da-4e47-4c04-a631-5a681ba0ce52 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:32.489655 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4a79c5da-4e47-4c04-a631-5a681ba0ce52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:32.525149 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501dc0b0-32a3-4a63-abec-dee9aba7bdb3 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:32.550130 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:32.566774 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d86c7-a667-4331-90c3-bfb6ffb73c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:32.567707 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d86c7-a667-4331-90c3-bfb6ffb73c76 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:32.567872 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 492/970] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:20:32.568303 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d86c7-a667-4331-90c3-bfb6ffb73c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:32.569852 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d86c7-a667-4331-90c3-bfb6ffb73c76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:32.641256 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d86c7-a667-4331-90c3-bfb6ffb73c76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:32.643247 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d86c7-a667-4331-90c3-bfb6ffb73c76 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:32.678931 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39b150-a778-4f9f-b2ba-b0af542d5b2c None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:32.679261 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39b150-a778-4f9f-b2ba-b0af542d5b2c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:32.680226 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39b150-a778-4f9f-b2ba-b0af542d5b2c None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:32.681098 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 493/971] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:20:32.686703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bc675-3d68-433b-ae8f-a4410c209601 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:32.686988 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bc675-3d68-433b-ae8f-a4410c209601 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:32.687265 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bc675-3d68-433b-ae8f-a4410c209601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:32.705643 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-683bc675-3d68-433b-ae8f-a4410c209601 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:32.706949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-683bc675-3d68-433b-ae8f-a4410c209601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:32.708972 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:32.766934 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 479/972] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:20:32 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:20:32.774386 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d86c7-a667-4331-90c3-bfb6ffb73c76 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:32.785277 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 494/973] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:20:32.844227 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bc675-3d68-433b-ae8f-a4410c209601 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:32.879290 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d86c7-a667-4331-90c3-bfb6ffb73c76 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:32.916339 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f470ea-5856-4cb1-a414-6b69ceb803eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:32.918059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f470ea-5856-4cb1-a414-6b69ceb803eb None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:32.918488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f470ea-5856-4cb1-a414-6b69ceb803eb None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:32.918937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f470ea-5856-4cb1-a414-6b69ceb803eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:32.930557 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f470ea-5856-4cb1-a414-6b69ceb803eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:32.932246 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f470ea-5856-4cb1-a414-6b69ceb803eb None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:32.949863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-81f470ea-5856-4cb1-a414-6b69ceb803eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:32.949863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:32.949863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:32.949863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:32.949863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:32.949863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:32.949863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:32.949863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:32.949863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:32.949863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:32.949863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:32.949863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:32.949863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:32.949863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:32.949863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:32.949863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:32.951118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:32.951118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:32.951118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:32.951118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:32.951118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:32.951118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:32.951118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:32.951118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:32.951118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:32.951118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:32.951118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:32.951118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:32.951118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:32.951118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:32.951118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:32.951118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:32.951118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:32.952247 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:32.952247 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:32.952247 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:32.953718 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bc675-3d68-433b-ae8f-a4410c209601 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:32.954166 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 480/974] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:32.964712 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f470ea-5856-4cb1-a414-6b69ceb803eb None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:32.972306 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:32.980174 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:32.991549 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf6e44-d8d3-4738-a913-379926c7e3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:32.992287 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf6e44-d8d3-4738-a913-379926c7e3c0 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:32.992664 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf6e44-d8d3-4738-a913-379926c7e3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:32.993037 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf6e44-d8d3-4738-a913-379926c7e3c0 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:32.993789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf6e44-d8d3-4738-a913-379926c7e3c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:32.995458 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf6e44-d8d3-4738-a913-379926c7e3c0 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:32.998205 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: WARNING keystone.server.flask.common [None req-f2cf6e44-d8d3-4738-a913-379926c7e3c0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 14:20:33.045417 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.sql.core [None req-f2cf6e44-d8d3-4738-a913-379926c7e3c0 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 14:20:33.045417 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 14:20:33.045417 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [parameters: {'user_id': 'b1941d44d4fa4b349540e5f7e3abf64e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 14:20:33.045417 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81741) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 14:20:33.055432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-f2cf6e44-d8d3-4738-a913-379926c7e3c0 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 14:20:33.055432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:33.055432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 14:20:33.055432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 14:20:33.055432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 14:20:33.055432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 14:20:33.055432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 14:20:33.055432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 14:20:33.055432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 14:20:33.055432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application conn.query(q) Aug 24 14:20:33.055432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 14:20:33.055432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 14:20:33.055432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 14:20:33.055432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application result.read() Aug 24 14:20:33.055432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 14:20:33.056309 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 14:20:33.056309 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 14:20:33.056309 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 14:20:33.056309 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 14:20:33.056309 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 14:20:33.056309 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 14:20:33.056309 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 14:20:33.056309 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 14:20:33.056309 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:33.056309 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 14:20:33.056309 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:33.056309 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:33.056309 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 14:20:33.056309 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 14:20:33.056309 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 14:20:33.056309 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 14:20:33.056309 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 14:20:33.056309 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application next(self.gen) Aug 24 14:20:33.057410 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 14:20:33.057410 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application yield resource Aug 24 14:20:33.057410 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 14:20:33.057410 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application next(self.gen) Aug 24 14:20:33.057410 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 14:20:33.057410 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 14:20:33.057410 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 14:20:33.057410 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 14:20:33.057410 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 14:20:33.057410 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise self.value Aug 24 14:20:33.057410 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 14:20:33.057410 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 14:20:33.057410 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 14:20:33.057410 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application session.commit() Aug 24 14:20:33.057410 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 14:20:33.057410 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 14:20:33.057410 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 14:20:33.059699 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 14:20:33.059699 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 14:20:33.059699 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self.session.flush() Aug 24 14:20:33.059699 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 14:20:33.059699 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 14:20:33.059699 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 14:20:33.059699 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 14:20:33.059699 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 14:20:33.059699 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application compat.raise_( Aug 24 14:20:33.059699 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 14:20:33.059699 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception Aug 24 14:20:33.059699 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 14:20:33.059699 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 14:20:33.059699 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 14:20:33.059699 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 14:20:33.059699 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 14:20:33.059699 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 14:20:33.061014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 14:20:33.061014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 14:20:33.061014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 14:20:33.061014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 14:20:33.061014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 14:20:33.061014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 14:20:33.061014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 14:20:33.061014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 14:20:33.061014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 14:20:33.061014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 14:20:33.061014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 14:20:33.061014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 14:20:33.061014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 14:20:33.061014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 14:20:33.061014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 14:20:33.061014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception Aug 24 14:20:33.066020 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 14:20:33.066020 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 14:20:33.066020 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 14:20:33.066020 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 14:20:33.066020 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 14:20:33.066020 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 14:20:33.066020 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 14:20:33.066020 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application conn.query(q) Aug 24 14:20:33.066020 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 14:20:33.066020 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 14:20:33.066020 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 14:20:33.066020 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application result.read() Aug 24 14:20:33.066020 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 14:20:33.066020 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 14:20:33.066020 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 14:20:33.066020 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 14:20:33.067220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 14:20:33.067220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 14:20:33.067220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 14:20:33.067220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 14:20:33.067220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 14:20:33.067220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 14:20:33.067220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b1941d44d4fa4b349540e5f7e3abf64e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 14:20:33.067220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 14:20:33.067220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:33.067220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:20:33.067220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:33.067220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:33.067220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:33.067220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:33.067220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:33.068066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:33.068066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:33.068066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:33.068066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:33.068066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:33.068066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:33.068066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:33.068066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 14:20:33.068066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 14:20:33.068066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:33.068066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:33.068066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:20:33.068066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:33.068066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:20:33.068066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:33.068066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 14:20:33.068066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 14:20:33.069016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 14:20:33.069016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 14:20:33.069016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 14:20:33.069016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 14:20:33.069016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 14:20:33.069016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:33.069016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 495/975] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Aug 24 14:20:32 2022] POST /identity/v3/users => generated 160 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:20:33.069016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf6e44-d8d3-4738-a913-379926c7e3c0 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:33.074542 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f470ea-5856-4cb1-a414-6b69ceb803eb None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:33.111064 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16f56b-b82d-48f2-9472-4d416b8df2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:33.111671 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16f56b-b82d-48f2-9472-4d416b8df2fb None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:33.111955 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16f56b-b82d-48f2-9472-4d416b8df2fb None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:33.112311 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16f56b-b82d-48f2-9472-4d416b8df2fb None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:33.112968 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16f56b-b82d-48f2-9472-4d416b8df2fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:33.113275 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16f56b-b82d-48f2-9472-4d416b8df2fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:33.114702 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16f56b-b82d-48f2-9472-4d416b8df2fb None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:33.128747 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 481/976] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:33.133889 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16f56b-b82d-48f2-9472-4d416b8df2fb None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:33.176175 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf6e44-d8d3-4738-a913-379926c7e3c0 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:33.211576 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:33.213591 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35b20c-1076-406e-b34b-51475d6890d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:33.214839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35b20c-1076-406e-b34b-51475d6890d2 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:33.215166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35b20c-1076-406e-b34b-51475d6890d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:33.215384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35b20c-1076-406e-b34b-51475d6890d2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:33.226551 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35b20c-1076-406e-b34b-51475d6890d2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:33.228196 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35b20c-1076-406e-b34b-51475d6890d2 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:33.240439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-ef35b20c-1076-406e-b34b-51475d6890d2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 14:20:33.240439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:33.240439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:33.240439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:33.240439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:33.240439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:33.240439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:33.240439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:33.240439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:33.240439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:33.240439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:33.240439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:33.240439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:20:33.240439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:20:33.240439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:20:33.240439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:20:33.241434 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:33.241434 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:33.241434 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:20:33.241434 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:33.241434 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:20:33.241434 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:33.241434 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:33.241434 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:33.241434 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:33.241434 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:33.241434 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:33.241434 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:33.241434 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:33.241434 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:33.241434 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:33.241434 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:33.241434 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:33.241434 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:33.242459 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:33.242459 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:33.242459 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:20:33.242459 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:20:33.242459 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:20:33.242459 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:20:33.242459 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:20:33.242459 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:20:33.242459 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 14:20:33.242459 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:33.242459 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 496/977] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:20:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:33.242459 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35b20c-1076-406e-b34b-51475d6890d2 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:33.249202 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16f56b-b82d-48f2-9472-4d416b8df2fb None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:33.286442 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:33.298056 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901ca3a-dd08-4e48-abfb-03c17816e475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:33.298690 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901ca3a-dd08-4e48-abfb-03c17816e475 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:33.298970 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901ca3a-dd08-4e48-abfb-03c17816e475 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:33.299607 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901ca3a-dd08-4e48-abfb-03c17816e475 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:33.299824 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901ca3a-dd08-4e48-abfb-03c17816e475 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:33.301192 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901ca3a-dd08-4e48-abfb-03c17816e475 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:33.310300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-9901ca3a-dd08-4e48-abfb-03c17816e475 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 14:20:33.310300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:33.310300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:20:33.310300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:20:33.310300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:20:33.310300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:20:33.310300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:20:33.310300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:33.310300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 14:20:33.310300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:33.310300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:20:33.310300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:33.310300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:33.310300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:33.310300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:33.310300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:33.310300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:33.317142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:33.317142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:33.317142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:33.317142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:33.317142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:33.317142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:33.317142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:20:33.317142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:20:33.317142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:20:33.317142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:20:33.317142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:33.317142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:33.317142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:33.317142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:33.317142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:33.317142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:33.318721 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:33.318721 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:33.318721 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:33.318721 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:33.318721 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:33.318721 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:33.318721 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:33.318721 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:33.318721 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:33.318721 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:33.318721 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:20:33.318721 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:33.318721 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 14:20:33.318721 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:33.318721 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 482/978] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 14:20:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:33.319658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901ca3a-dd08-4e48-abfb-03c17816e475 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:33.350721 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35b20c-1076-406e-b34b-51475d6890d2 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:33.385277 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc26b0b-1c0c-49cb-8b3a-683ae974bf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:33.386610 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc26b0b-1c0c-49cb-8b3a-683ae974bf59 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:33.386895 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc26b0b-1c0c-49cb-8b3a-683ae974bf59 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:33.387168 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc26b0b-1c0c-49cb-8b3a-683ae974bf59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:33.393824 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc26b0b-1c0c-49cb-8b3a-683ae974bf59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:33.395280 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc26b0b-1c0c-49cb-8b3a-683ae974bf59 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:33.407029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-0dc26b0b-1c0c-49cb-8b3a-683ae974bf59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:33.407029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:33.407029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:33.407029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:33.407029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:33.407029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:33.407029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:33.407029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:33.407029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:33.407029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:33.407029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:33.407029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:33.407029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:20:33.407029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:20:33.407029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:20:33.407999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:20:33.407999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:33.407999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:33.407999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:33.407999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:33.407999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:33.407999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:33.407999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:33.407999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:33.407999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:33.407999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:33.407999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:33.407999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:33.407999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:33.407999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:33.407999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:33.407999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:33.408912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:20:33.408912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:20:33.408912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:20:33.408912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:20:33.408912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:20:33.408912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:20:33.408912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:33.408912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:33.408912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 497/979] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:20:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:33.408912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc26b0b-1c0c-49cb-8b3a-683ae974bf59 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:33.423584 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901ca3a-dd08-4e48-abfb-03c17816e475 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:33.457708 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02575c-1a21-4172-ab03-6265f031b8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:33.458338 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02575c-1a21-4172-ab03-6265f031b8f2 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:33.458616 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02575c-1a21-4172-ab03-6265f031b8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:33.458890 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02575c-1a21-4172-ab03-6265f031b8f2 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:33.459588 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02575c-1a21-4172-ab03-6265f031b8f2 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:33.459886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02575c-1a21-4172-ab03-6265f031b8f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:33.461301 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02575c-1a21-4172-ab03-6265f031b8f2 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:33.479344 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:33.496314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 483/980] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 14:20:33 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:33.500521 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9645f-79fe-4037-884d-1604909dbebf None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:33.500521 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9645f-79fe-4037-884d-1604909dbebf None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:33.500521 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9645f-79fe-4037-884d-1604909dbebf None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:33.500521 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 484/981] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:33.500521 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9645f-79fe-4037-884d-1604909dbebf None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:33.508037 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:33.513195 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc26b0b-1c0c-49cb-8b3a-683ae974bf59 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:33.555048 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406cb33-0184-46ff-9953-2be110670048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:33.555737 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406cb33-0184-46ff-9953-2be110670048 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:33.556019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406cb33-0184-46ff-9953-2be110670048 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:33.556293 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406cb33-0184-46ff-9953-2be110670048 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:33.556992 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406cb33-0184-46ff-9953-2be110670048 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:33.557300 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406cb33-0184-46ff-9953-2be110670048 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:33.558798 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406cb33-0184-46ff-9953-2be110670048 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:33.567223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 498/982] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Aug 24 14:20:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:33.568585 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35612ff-c7af-4749-9528-1e403b4fd159 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:33.569166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35612ff-c7af-4749-9528-1e403b4fd159 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:33.569166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35612ff-c7af-4749-9528-1e403b4fd159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:33.590113 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a35612ff-c7af-4749-9528-1e403b4fd159 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:33.591727 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a35612ff-c7af-4749-9528-1e403b4fd159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:33.626811 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9645f-79fe-4037-884d-1604909dbebf None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:33.669668 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047b8d2-743c-4fd4-bdce-8b4f6937df20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:33.670334 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047b8d2-743c-4fd4-bdce-8b4f6937df20 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:33.670618 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047b8d2-743c-4fd4-bdce-8b4f6937df20 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:33.670887 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047b8d2-743c-4fd4-bdce-8b4f6937df20 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:33.671415 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 499/983] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:20:33.671589 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047b8d2-743c-4fd4-bdce-8b4f6937df20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:33.671896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047b8d2-743c-4fd4-bdce-8b4f6937df20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:33.672119 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35612ff-c7af-4749-9528-1e403b4fd159 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:33.673354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047b8d2-743c-4fd4-bdce-8b4f6937df20 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:33.695847 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 485/984] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:20:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:33.695847 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047b8d2-743c-4fd4-bdce-8b4f6937df20 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:33.771387 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:33.791108 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:33.801160 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35612ff-c7af-4749-9528-1e403b4fd159 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:33.825314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047b8d2-743c-4fd4-bdce-8b4f6937df20 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:33.836331 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8ca77-4209-41a5-8ae3-ca18a1ed23d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:33.836939 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8ca77-4209-41a5-8ae3-ca18a1ed23d3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:33.837215 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8ca77-4209-41a5-8ae3-ca18a1ed23d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:33.837483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8ca77-4209-41a5-8ae3-ca18a1ed23d3 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:33.838139 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8ca77-4209-41a5-8ae3-ca18a1ed23d3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:33.838444 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8ca77-4209-41a5-8ae3-ca18a1ed23d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:33.840588 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8ca77-4209-41a5-8ae3-ca18a1ed23d3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:33.846273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 500/985] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Aug 24 14:20:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:33.851971 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8ca77-4209-41a5-8ae3-ca18a1ed23d3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:33.863703 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29bdb9-492b-4a10-9257-44395fbca708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:33.864302 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29bdb9-492b-4a10-9257-44395fbca708 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:33.864578 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29bdb9-492b-4a10-9257-44395fbca708 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:33.864846 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29bdb9-492b-4a10-9257-44395fbca708 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:33.865562 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29bdb9-492b-4a10-9257-44395fbca708 None admin] RBAC: Adding query filter params (role.id=89526ad5407b4974a7368c7aa6411cf8, scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e, user.id=477ab357d285415e8c0c82d414d242ba) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:33.865914 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29bdb9-492b-4a10-9257-44395fbca708 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:33.867323 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29bdb9-492b-4a10-9257-44395fbca708 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:33.881775 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 486/986] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:20:33 2022] GET /identity/v3/role_assignments?user.id=477ab357d285415e8c0c82d414d242ba&scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e&role.id=89526ad5407b4974a7368c7aa6411cf8 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:33.954289 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29bdb9-492b-4a10-9257-44395fbca708 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:33.974921 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8ca77-4209-41a5-8ae3-ca18a1ed23d3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:34.016966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c83a70-d4b5-474e-a502-79c9a37c723c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:34.017566 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c83a70-d4b5-474e-a502-79c9a37c723c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:34.017873 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c83a70-d4b5-474e-a502-79c9a37c723c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:34.018148 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c83a70-d4b5-474e-a502-79c9a37c723c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:34.018863 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c83a70-d4b5-474e-a502-79c9a37c723c None admin] RBAC: Adding query filter params (interface=admin, service_id=17bd118f1df64d59979e28f989a4d026, region_id=RegionOne) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:34.019167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c83a70-d4b5-474e-a502-79c9a37c723c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:34.021376 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c83a70-d4b5-474e-a502-79c9a37c723c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:34.031541 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 501/987] 10.222.0.65 () {56 vars in 1249 bytes} [Wed Aug 24 14:20:33 2022] GET /identity/v3/endpoints?service_id=17bd118f1df64d59979e28f989a4d026&interface=admin®ion_id=RegionOne => generated 193 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:34.033534 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c83a70-d4b5-474e-a502-79c9a37c723c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:34.058743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:34.071700 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29bdb9-492b-4a10-9257-44395fbca708 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:34.092025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:34.114070 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9044b-5db0-4fb4-8bf9-3b497b83802e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:34.114680 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9044b-5db0-4fb4-8bf9-3b497b83802e None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:34.114960 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9044b-5db0-4fb4-8bf9-3b497b83802e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:34.115234 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9044b-5db0-4fb4-8bf9-3b497b83802e None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:34.115878 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9044b-5db0-4fb4-8bf9-3b497b83802e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:34.117244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9044b-5db0-4fb4-8bf9-3b497b83802e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:34.143258 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c83a70-d4b5-474e-a502-79c9a37c723c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:34.178126 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec02abb-f54d-49de-a91e-2b74c270dbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:34.178735 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec02abb-f54d-49de-a91e-2b74c270dbab None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:34.179028 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec02abb-f54d-49de-a91e-2b74c270dbab None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:34.179293 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec02abb-f54d-49de-a91e-2b74c270dbab None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:34.179900 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec02abb-f54d-49de-a91e-2b74c270dbab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:34.181265 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec02abb-f54d-49de-a91e-2b74c270dbab None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:34.183556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 487/988] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 14:20:33 2022] POST /identity/v3/services => generated 242 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:20:34.190479 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 502/989] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Aug 24 14:20:34 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:20:35.832607 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5c5ac-7cd8-4ce4-8471-019c5f3e227e None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:35.833131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5c5ac-7cd8-4ce4-8471-019c5f3e227e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:35.833131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5c5ac-7cd8-4ce4-8471-019c5f3e227e None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:35.834548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 488/990] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:35.840032 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abe812-bf39-482a-b886-86b193d183f7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:35.840412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abe812-bf39-482a-b886-86b193d183f7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:35.840572 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abe812-bf39-482a-b886-86b193d183f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:35.859301 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-28abe812-bf39-482a-b886-86b193d183f7 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:35.860584 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-28abe812-bf39-482a-b886-86b193d183f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:35.938794 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 503/991] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:35 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:20:36.111118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df990c92-b36a-4e73-b2b2-10010bf88394 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:36.111306 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df990c92-b36a-4e73-b2b2-10010bf88394 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:36.111580 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df990c92-b36a-4e73-b2b2-10010bf88394 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:36.113089 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 489/992] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:36.113705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f87c4-043f-4752-901f-ea84625b0ad3 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:36.114022 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f87c4-043f-4752-901f-ea84625b0ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:36.114301 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f87c4-043f-4752-901f-ea84625b0ad3 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:36.115742 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 504/993] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:20:36.117875 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4f6dd-8c2f-48a5-8e47-bb9874ad52fb None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:36.118165 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4f6dd-8c2f-48a5-8e47-bb9874ad52fb None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:36.118444 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4f6dd-8c2f-48a5-8e47-bb9874ad52fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:36.122856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59123d70-c3b8-40ae-8254-de000ab11cdd None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:36.123140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59123d70-c3b8-40ae-8254-de000ab11cdd None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:36.123414 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59123d70-c3b8-40ae-8254-de000ab11cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:36.139638 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a2b4f6dd-8c2f-48a5-8e47-bb9874ad52fb None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:36.141176 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a2b4f6dd-8c2f-48a5-8e47-bb9874ad52fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:36.142326 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-59123d70-c3b8-40ae-8254-de000ab11cdd None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:36.143500 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-59123d70-c3b8-40ae-8254-de000ab11cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:36.147045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:36.212452 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 505/994] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:36 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:20:36.217793 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 490/995] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:36 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:20:36.219324 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59123d70-c3b8-40ae-8254-de000ab11cdd None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:36.331934 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59123d70-c3b8-40ae-8254-de000ab11cdd None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:36.365984 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983d99a-3906-4584-b777-738ece648a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:36.366532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983d99a-3906-4584-b777-738ece648a2a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:36.366804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983d99a-3906-4584-b777-738ece648a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:36.367068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983d99a-3906-4584-b777-738ece648a2a None admin] PATH_INFO: `/v3/services/image` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:36.367642 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983d99a-3906-4584-b777-738ece648a2a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:36.368994 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983d99a-3906-4584-b777-738ece648a2a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:36.378753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-b983d99a-3906-4584-b777-738ece648a2a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 14:20:36.378753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:36.378753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:20:36.378753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:20:36.378753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:20:36.378753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:20:36.378753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:20:36.378753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:36.378753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 14:20:36.378753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:36.378753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:20:36.378753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:36.378753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:36.378753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:36.378753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:36.378753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:36.378753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:36.379714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:36.379714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:36.379714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:36.379714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:36.379714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:36.379714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:36.379714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:20:36.379714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:20:36.379714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:20:36.379714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:20:36.379714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:36.379714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:36.379714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:36.379714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:36.379714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:36.379714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:36.380678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:36.380678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:36.380678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:36.380678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:36.380678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:36.380678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:36.380678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:36.380678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:36.380678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:36.380678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:36.380678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:20:36.380678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:36.380678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 14:20:36.380678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:36.384598 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 506/996] 10.222.0.65 () {56 vars in 1105 bytes} [Wed Aug 24 14:20:36 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:20:36.386520 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4f6dd-8c2f-48a5-8e47-bb9874ad52fb None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:36.488221 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983d99a-3906-4584-b777-738ece648a2a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:36.488706 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4f6dd-8c2f-48a5-8e47-bb9874ad52fb None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:36.492004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:36.540728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:36.570829 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73e7f0-e00e-48d4-afb7-575333528313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:36.571436 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73e7f0-e00e-48d4-afb7-575333528313 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:36.571709 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73e7f0-e00e-48d4-afb7-575333528313 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:36.572019 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73e7f0-e00e-48d4-afb7-575333528313 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:36.572648 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73e7f0-e00e-48d4-afb7-575333528313 None admin] RBAC: Adding query filter params (name=image) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:36.572946 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73e7f0-e00e-48d4-afb7-575333528313 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:36.575012 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73e7f0-e00e-48d4-afb7-575333528313 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:36.596975 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983d99a-3906-4584-b777-738ece648a2a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:36.629535 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018caf9-fa4e-4899-a3da-d32ebebb3afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:36.629910 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 491/997] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:36.630121 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018caf9-fa4e-4899-a3da-d32ebebb3afc None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:36.630400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018caf9-fa4e-4899-a3da-d32ebebb3afc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:36.630673 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018caf9-fa4e-4899-a3da-d32ebebb3afc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:36.630769 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73e7f0-e00e-48d4-afb7-575333528313 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:36.631255 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018caf9-fa4e-4899-a3da-d32ebebb3afc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:36.632619 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018caf9-fa4e-4899-a3da-d32ebebb3afc None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:36.642910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-3018caf9-fa4e-4899-a3da-d32ebebb3afc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 14:20:36.642910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:36.642910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:20:36.642910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:20:36.642910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:20:36.642910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:20:36.642910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:20:36.642910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:36.642910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 14:20:36.642910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:36.642910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:20:36.642910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:36.642910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:36.642910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:36.642910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:36.642910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:36.642910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:36.643999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:36.643999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:36.643999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:36.643999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:36.643999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:36.643999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:36.643999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:20:36.643999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:20:36.643999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:20:36.643999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:20:36.643999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:36.643999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:36.643999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:36.643999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:36.643999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:36.643999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:36.644862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:36.644862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:36.644862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:36.644862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:36.644862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:36.644862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:36.644862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:36.644862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:36.644862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:36.644862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:36.644862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:20:36.644862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:36.644862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 14:20:36.644862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:36.644862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 507/998] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 14:20:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:20:36.645672 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018caf9-fa4e-4899-a3da-d32ebebb3afc None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:36.711357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:36.733084 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73e7f0-e00e-48d4-afb7-575333528313 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:36.744371 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018caf9-fa4e-4899-a3da-d32ebebb3afc None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:36.768247 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c61f75-f838-4fc3-afea-642241399ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:36.768869 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c61f75-f838-4fc3-afea-642241399ef1 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:36.769146 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c61f75-f838-4fc3-afea-642241399ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:36.769418 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c61f75-f838-4fc3-afea-642241399ef1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:36.770027 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c61f75-f838-4fc3-afea-642241399ef1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:36.771380 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c61f75-f838-4fc3-afea-642241399ef1 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:36.779091 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829a42f-bdac-41d6-a1e3-aa76d9d7608a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:36.779690 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829a42f-bdac-41d6-a1e3-aa76d9d7608a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:36.779968 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829a42f-bdac-41d6-a1e3-aa76d9d7608a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:36.780068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-20c61f75-f838-4fc3-afea-642241399ef1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 14:20:36.780068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:36.780068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:20:36.780068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:20:36.780068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:20:36.780068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:20:36.780068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:20:36.780068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:36.780068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 14:20:36.780068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:36.780068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:20:36.780068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:36.780068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:36.780068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:36.780068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:36.780068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:36.780068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:36.781285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:36.781285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:36.781285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:36.781285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:36.781285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:36.781285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:36.781285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:20:36.781285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:20:36.781285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:20:36.781285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:20:36.781285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:36.781285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:36.781285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:36.781285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:36.781285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:36.781285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:36.782157 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:36.782157 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:36.782157 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:36.782157 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:36.782157 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:36.782157 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:36.782157 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:36.782157 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:36.782157 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:36.782157 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:36.782157 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:20:36.782157 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:36.782157 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 14:20:36.782157 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:36.782921 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829a42f-bdac-41d6-a1e3-aa76d9d7608a None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:36.782921 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829a42f-bdac-41d6-a1e3-aa76d9d7608a None admin] RBAC: Adding query filter params (type=image) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:36.782921 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829a42f-bdac-41d6-a1e3-aa76d9d7608a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:36.783183 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 492/999] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:20:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:36.783183 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c61f75-f838-4fc3-afea-642241399ef1 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:36.783312 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829a42f-bdac-41d6-a1e3-aa76d9d7608a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:36.793405 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 508/1000] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:36 2022] GET /identity/v3/services?type=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:36.793405 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829a42f-bdac-41d6-a1e3-aa76d9d7608a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:36.836338 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:36.902061 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829a42f-bdac-41d6-a1e3-aa76d9d7608a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:36.911902 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c61f75-f838-4fc3-afea-642241399ef1 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:36.934201 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:36.941030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e25c96-75ee-4276-9f74-5edf7c5f3618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:36.944325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e25c96-75ee-4276-9f74-5edf7c5f3618 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:36.944325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e25c96-75ee-4276-9f74-5edf7c5f3618 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:36.944325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e25c96-75ee-4276-9f74-5edf7c5f3618 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:36.944325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e25c96-75ee-4276-9f74-5edf7c5f3618 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:36.944325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e25c96-75ee-4276-9f74-5edf7c5f3618 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:36.944700 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e25c96-75ee-4276-9f74-5edf7c5f3618 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:36.952208 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 509/1001] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 14:20:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:36.956270 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebaabff-182f-4964-8a1a-bfe7a30bc393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:36.957108 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebaabff-182f-4964-8a1a-bfe7a30bc393 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:36.957218 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebaabff-182f-4964-8a1a-bfe7a30bc393 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:36.957414 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebaabff-182f-4964-8a1a-bfe7a30bc393 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:36.958028 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e25c96-75ee-4276-9f74-5edf7c5f3618 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:36.958176 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebaabff-182f-4964-8a1a-bfe7a30bc393 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:36.958360 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebaabff-182f-4964-8a1a-bfe7a30bc393 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:36.959731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebaabff-182f-4964-8a1a-bfe7a30bc393 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:36.966748 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 493/1002] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Aug 24 14:20:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:36.973534 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebaabff-182f-4964-8a1a-bfe7a30bc393 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:37.070768 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e25c96-75ee-4276-9f74-5edf7c5f3618 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:37.080258 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:37.083739 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebaabff-182f-4964-8a1a-bfe7a30bc393 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:37.104102 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ff26b-389e-4ca1-96fa-ac2f4ef52f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:37.105382 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ff26b-389e-4ca1-96fa-ac2f4ef52f47 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:37.105860 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ff26b-389e-4ca1-96fa-ac2f4ef52f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:37.106135 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ff26b-389e-4ca1-96fa-ac2f4ef52f47 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:37.106764 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ff26b-389e-4ca1-96fa-ac2f4ef52f47 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:37.107060 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ff26b-389e-4ca1-96fa-ac2f4ef52f47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:37.108411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ff26b-389e-4ca1-96fa-ac2f4ef52f47 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:37.113878 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 510/1003] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 14:20:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:37.119490 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ff26b-389e-4ca1-96fa-ac2f4ef52f47 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:37.125999 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e87fa0-d7f0-4507-a4d4-36a8a9e611b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:37.126650 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e87fa0-d7f0-4507-a4d4-36a8a9e611b8 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:37.126929 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e87fa0-d7f0-4507-a4d4-36a8a9e611b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:37.127543 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e87fa0-d7f0-4507-a4d4-36a8a9e611b8 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:37.128214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e87fa0-d7f0-4507-a4d4-36a8a9e611b8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:37.128502 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e87fa0-d7f0-4507-a4d4-36a8a9e611b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:37.129891 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e87fa0-d7f0-4507-a4d4-36a8a9e611b8 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:37.141102 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 494/1004] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Aug 24 14:20:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:37.142423 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e87fa0-d7f0-4507-a4d4-36a8a9e611b8 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:37.181167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:37.224303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ff26b-389e-4ca1-96fa-ac2f4ef52f47 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:37.253435 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e87fa0-d7f0-4507-a4d4-36a8a9e611b8 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:37.265532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e747a5-16b3-4599-944f-bae890044482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:37.266199 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e747a5-16b3-4599-944f-bae890044482 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:37.266481 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e747a5-16b3-4599-944f-bae890044482 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:37.266758 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e747a5-16b3-4599-944f-bae890044482 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:37.267473 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e747a5-16b3-4599-944f-bae890044482 None admin] RBAC: Adding query filter params (interface=public, service_id=208bb88349e64617a9983e10b6bd1b7a, region_id=RegionOne) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:37.267788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e747a5-16b3-4599-944f-bae890044482 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:37.269158 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e747a5-16b3-4599-944f-bae890044482 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:37.274524 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 511/1005] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Aug 24 14:20:37 2022] GET /identity/v3/endpoints?service_id=208bb88349e64617a9983e10b6bd1b7a&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:37.280855 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e747a5-16b3-4599-944f-bae890044482 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:37.303972 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8de2f-94bf-4923-b179-9a3874a5334b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:37.304561 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8de2f-94bf-4923-b179-9a3874a5334b None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:37.304838 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8de2f-94bf-4923-b179-9a3874a5334b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:37.305108 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8de2f-94bf-4923-b179-9a3874a5334b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:37.305773 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8de2f-94bf-4923-b179-9a3874a5334b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:37.307138 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8de2f-94bf-4923-b179-9a3874a5334b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:37.384138 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e747a5-16b3-4599-944f-bae890044482 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:37.395414 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 495/1006] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:20:37 2022] POST /identity/v3/endpoints => generated 325 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:20:37.412575 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:37.431851 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c515496-e211-457b-8d20-58cb9efe3d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:37.432427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c515496-e211-457b-8d20-58cb9efe3d76 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:37.433275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c515496-e211-457b-8d20-58cb9efe3d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:37.433541 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c515496-e211-457b-8d20-58cb9efe3d76 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:37.434442 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c515496-e211-457b-8d20-58cb9efe3d76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:37.435843 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c515496-e211-457b-8d20-58cb9efe3d76 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:37.450056 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 512/1007] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Aug 24 14:20:37 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:20:38.723963 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaf952-0cc1-4c7f-8eae-2a97cff544a3 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:38.724483 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaf952-0cc1-4c7f-8eae-2a97cff544a3 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:38.724483 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaf952-0cc1-4c7f-8eae-2a97cff544a3 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:38.725917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 496/1008] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:38.731956 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea10c4-f512-4b90-8b77-666f92e0569a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:38.732385 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea10c4-f512-4b90-8b77-666f92e0569a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:38.732580 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea10c4-f512-4b90-8b77-666f92e0569a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:38.751061 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-0fea10c4-f512-4b90-8b77-666f92e0569a None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:38.752517 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0fea10c4-f512-4b90-8b77-666f92e0569a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:38.821850 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 513/1009] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:38 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:20:39.095322 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaf952-0cc1-4c7f-8eae-2a97cff544a3 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:39.122442 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:39.205102 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaf952-0cc1-4c7f-8eae-2a97cff544a3 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:39.239584 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf845001-d10f-4a0e-800b-40edd89a7258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:39.240243 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf845001-d10f-4a0e-800b-40edd89a7258 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:39.240523 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf845001-d10f-4a0e-800b-40edd89a7258 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:39.240790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf845001-d10f-4a0e-800b-40edd89a7258 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:39.241437 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf845001-d10f-4a0e-800b-40edd89a7258 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:39.242831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf845001-d10f-4a0e-800b-40edd89a7258 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:39.309676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 497/1010] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 14:20:39 2022] POST /identity/v3/services => generated 242 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:20:39.322670 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64de22-a3cd-49c9-b37a-df67d14d1f29 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:39.323582 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64de22-a3cd-49c9-b37a-df67d14d1f29 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:39.324065 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64de22-a3cd-49c9-b37a-df67d14d1f29 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:39.325814 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 514/1011] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:39.331967 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b8199-9916-4b14-8fb6-655c635c259d None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:39.332303 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b8199-9916-4b14-8fb6-655c635c259d None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:39.332583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b8199-9916-4b14-8fb6-655c635c259d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:39.352782 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ec1b8199-9916-4b14-8fb6-655c635c259d None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:39.354008 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ec1b8199-9916-4b14-8fb6-655c635c259d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:39.397252 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03cce4-69fe-4c80-a37c-8550073ac4cc None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:39.397623 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03cce4-69fe-4c80-a37c-8550073ac4cc None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:39.397861 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03cce4-69fe-4c80-a37c-8550073ac4cc None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:39.399268 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 515/1012] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:20:39.406180 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2d6a9-6343-4363-ae2b-96e5b8cf0346 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:39.406558 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2d6a9-6343-4363-ae2b-96e5b8cf0346 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:39.406756 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2d6a9-6343-4363-ae2b-96e5b8cf0346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:39.424873 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-3eb2d6a9-6343-4363-ae2b-96e5b8cf0346 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:39.426141 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3eb2d6a9-6343-4363-ae2b-96e5b8cf0346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:39.436986 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 498/1013] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:39 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:20:39.503879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 516/1014] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:39 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:20:39.702603 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b8199-9916-4b14-8fb6-655c635c259d None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:39.715022 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:39.777793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2d6a9-6343-4363-ae2b-96e5b8cf0346 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:39.804529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b8199-9916-4b14-8fb6-655c635c259d None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:39.827308 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:39.842547 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7dc03-6462-4ce0-b728-ccd28748030d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:39.843173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7dc03-6462-4ce0-b728-ccd28748030d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:39.843455 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7dc03-6462-4ce0-b728-ccd28748030d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:39.843785 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7dc03-6462-4ce0-b728-ccd28748030d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:39.844970 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7dc03-6462-4ce0-b728-ccd28748030d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:39.846424 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7dc03-6462-4ce0-b728-ccd28748030d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:39.848302 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 499/1015] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:39.853646 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7dc03-6462-4ce0-b728-ccd28748030d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:39.884474 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2d6a9-6343-4363-ae2b-96e5b8cf0346 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:39.919833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb0f2f-a15b-4bcc-b4d0-8a99639f91d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:39.920605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb0f2f-a15b-4bcc-b4d0-8a99639f91d5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:39.920884 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb0f2f-a15b-4bcc-b4d0-8a99639f91d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:39.921152 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb0f2f-a15b-4bcc-b4d0-8a99639f91d5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:39.921899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb0f2f-a15b-4bcc-b4d0-8a99639f91d5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:39.923258 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb0f2f-a15b-4bcc-b4d0-8a99639f91d5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:39.932094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-bfeb0f2f-a15b-4bcc-b4d0-8a99639f91d5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 14:20:39.932094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:39.932094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:20:39.932094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:20:39.932094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:20:39.932094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:20:39.932094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:20:39.932094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:39.932094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 14:20:39.932094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:39.932094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:20:39.932094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:39.932094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:39.932094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:39.932094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:39.932094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:39.932094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:39.933706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:39.933706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:39.933706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:39.933706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:39.933706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:39.933706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:39.933706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:20:39.933706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:20:39.933706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:20:39.933706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:20:39.933706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:39.933706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:39.933706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:39.933706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:39.933706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:39.933706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:39.934600 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:39.934600 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:39.934600 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:39.934600 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:39.934600 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:39.934600 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:39.934600 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:39.934600 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:39.934600 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:39.934600 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:39.934600 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:20:39.934600 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:39.934600 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 14:20:39.934600 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:39.935344 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:39.935418 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 517/1016] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:20:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:20:39.940776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb0f2f-a15b-4bcc-b4d0-8a99639f91d5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:39.963257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7dc03-6462-4ce0-b728-ccd28748030d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:40.000699 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333167f8-f999-4ff6-b6fa-6e8539ecfea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:40.001310 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333167f8-f999-4ff6-b6fa-6e8539ecfea1 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:40.001594 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333167f8-f999-4ff6-b6fa-6e8539ecfea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:40.001910 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333167f8-f999-4ff6-b6fa-6e8539ecfea1 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:40.002812 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333167f8-f999-4ff6-b6fa-6e8539ecfea1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:40.004237 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333167f8-f999-4ff6-b6fa-6e8539ecfea1 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:40.046019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb0f2f-a15b-4bcc-b4d0-8a99639f91d5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:40.054574 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:40.069784 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 500/1017] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 14:20:39 2022] POST /identity/v3/projects => generated 311 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:20:40.080985 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06fa8a-beb6-4746-add5-a2520a0a7c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:40.081615 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06fa8a-beb6-4746-add5-a2520a0a7c0d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:40.082104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06fa8a-beb6-4746-add5-a2520a0a7c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:40.082455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06fa8a-beb6-4746-add5-a2520a0a7c0d None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:40.083095 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06fa8a-beb6-4746-add5-a2520a0a7c0d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:40.083891 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06fa8a-beb6-4746-add5-a2520a0a7c0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:40.086019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06fa8a-beb6-4746-add5-a2520a0a7c0d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:40.092258 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 518/1018] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 14:20:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:40.098288 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333167f8-f999-4ff6-b6fa-6e8539ecfea1 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:40.209502 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333167f8-f999-4ff6-b6fa-6e8539ecfea1 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:40.239659 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:40.247181 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120038dc-845a-45d0-9c7d-64dcd450e2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:40.247849 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120038dc-845a-45d0-9c7d-64dcd450e2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:40.248133 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120038dc-845a-45d0-9c7d-64dcd450e2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:40.251861 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120038dc-845a-45d0-9c7d-64dcd450e2c0 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:40.251861 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120038dc-845a-45d0-9c7d-64dcd450e2c0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:40.251861 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120038dc-845a-45d0-9c7d-64dcd450e2c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:40.251861 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120038dc-845a-45d0-9c7d-64dcd450e2c0 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:40.256697 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 501/1019] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 14:20:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:40.263313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06fa8a-beb6-4746-add5-a2520a0a7c0d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:40.373505 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06fa8a-beb6-4746-add5-a2520a0a7c0d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:40.408906 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1124b4-51a5-4ecd-8271-0d95d697689c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:40.409513 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1124b4-51a5-4ecd-8271-0d95d697689c None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:40.409820 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1124b4-51a5-4ecd-8271-0d95d697689c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:40.410098 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1124b4-51a5-4ecd-8271-0d95d697689c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:40.410770 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1124b4-51a5-4ecd-8271-0d95d697689c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:40.412130 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1124b4-51a5-4ecd-8271-0d95d697689c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:40.480806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 519/1020] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:20:40 2022] POST /identity/v3/endpoints => generated 334 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:20:41.265345 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a163290-d1ac-4252-b690-47cc47798361 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:41.265829 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a163290-d1ac-4252-b690-47cc47798361 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:41.265929 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a163290-d1ac-4252-b690-47cc47798361 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:41.267389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 502/1021] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:41.272883 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264293ed-efb3-48f5-bd65-12b8e1433ac0 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:41.273295 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264293ed-efb3-48f5-bd65-12b8e1433ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:41.273437 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264293ed-efb3-48f5-bd65-12b8e1433ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:41.292971 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-264293ed-efb3-48f5-bd65-12b8e1433ac0 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:41.294185 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-264293ed-efb3-48f5-bd65-12b8e1433ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:41.316628 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:41.366319 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 520/1022] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:20:41.631809 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a163290-d1ac-4252-b690-47cc47798361 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:41.738252 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a163290-d1ac-4252-b690-47cc47798361 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:41.772298 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb71e71-d383-4579-961a-2a728ad01658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:41.772920 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb71e71-d383-4579-961a-2a728ad01658 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:41.773199 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb71e71-d383-4579-961a-2a728ad01658 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:41.773469 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb71e71-d383-4579-961a-2a728ad01658 None admin] PATH_INFO: `/v3/services/image` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:41.774076 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb71e71-d383-4579-961a-2a728ad01658 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:41.775431 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb71e71-d383-4579-961a-2a728ad01658 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:41.784240 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-2bb71e71-d383-4579-961a-2a728ad01658 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 14:20:41.784240 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:41.784240 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:20:41.784240 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:20:41.784240 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:20:41.784240 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:20:41.784240 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:20:41.784240 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:41.784240 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 14:20:41.784240 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:41.784240 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:20:41.784240 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:41.784240 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:41.784240 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:41.784240 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:41.784240 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:41.784240 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:41.785233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:41.785233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:41.785233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:41.785233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:41.785233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:41.785233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:41.785233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:20:41.785233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:20:41.785233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:20:41.785233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:20:41.785233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:41.785233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:41.785233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:41.785233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:41.785233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:41.785233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:41.786583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:41.786583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:41.786583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:41.786583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:41.786583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:41.786583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:41.786583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:41.786583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:41.786583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:41.786583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:41.786583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:20:41.786583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:41.786583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 14:20:41.786583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:41.790073 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 503/1023] 10.222.0.65 () {56 vars in 1105 bytes} [Wed Aug 24 14:20:41 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:41.791252 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264293ed-efb3-48f5-bd65-12b8e1433ac0 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:41.891932 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264293ed-efb3-48f5-bd65-12b8e1433ac0 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:41.925852 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58a644-ae57-40c7-8f84-14cea8be37b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:41.926459 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58a644-ae57-40c7-8f84-14cea8be37b5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:41.926735 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58a644-ae57-40c7-8f84-14cea8be37b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:41.927004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58a644-ae57-40c7-8f84-14cea8be37b5 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:41.927736 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58a644-ae57-40c7-8f84-14cea8be37b5 None admin] RBAC: Adding query filter params (name=image) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:41.928045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58a644-ae57-40c7-8f84-14cea8be37b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:41.929398 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58a644-ae57-40c7-8f84-14cea8be37b5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:41.939616 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 521/1024] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:41.940650 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb71e71-d383-4579-961a-2a728ad01658 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:42.001040 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:42.043188 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb71e71-d383-4579-961a-2a728ad01658 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:42.047931 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3642417-0d5c-49ba-94e7-179ec3e8a9bc None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:42.048214 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3642417-0d5c-49ba-94e7-179ec3e8a9bc None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:42.048490 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3642417-0d5c-49ba-94e7-179ec3e8a9bc None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:42.053793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 522/1025] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:20:42.055024 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9eb10-da5e-4dfe-9db0-cd8d314324f6 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:42.055304 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9eb10-da5e-4dfe-9db0-cd8d314324f6 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:42.055576 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9eb10-da5e-4dfe-9db0-cd8d314324f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:42.074337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-30c9eb10-da5e-4dfe-9db0-cd8d314324f6 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:42.075533 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-30c9eb10-da5e-4dfe-9db0-cd8d314324f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:42.083805 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1f89f-862d-435d-b252-644e0ce0095a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:42.084400 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1f89f-862d-435d-b252-644e0ce0095a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:42.084676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1f89f-862d-435d-b252-644e0ce0095a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:42.084942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1f89f-862d-435d-b252-644e0ce0095a None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:42.085568 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1f89f-862d-435d-b252-644e0ce0095a None admin] RBAC: Adding query filter params (type=image) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:42.085896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1f89f-862d-435d-b252-644e0ce0095a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:42.087254 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1f89f-862d-435d-b252-644e0ce0095a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:42.089482 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:42.093197 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 504/1026] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:42.098640 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1f89f-862d-435d-b252-644e0ce0095a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:42.157733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 523/1027] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:20:42.207764 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1f89f-862d-435d-b252-644e0ce0095a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:42.231038 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:42.242845 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eddde80-34b7-4bea-aa40-75701cb4093d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:42.244316 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddde80-34b7-4bea-aa40-75701cb4093d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:42.244316 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddde80-34b7-4bea-aa40-75701cb4093d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:42.244316 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddde80-34b7-4bea-aa40-75701cb4093d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:42.245202 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eddde80-34b7-4bea-aa40-75701cb4093d None admin] RBAC: Adding query filter params (interface=public, service_id=909529161167425bb12f537534a27564, region_id=RegionOne) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:42.245470 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eddde80-34b7-4bea-aa40-75701cb4093d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:42.246859 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eddde80-34b7-4bea-aa40-75701cb4093d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:42.256515 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 505/1028] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Aug 24 14:20:42 2022] GET /identity/v3/endpoints?service_id=909529161167425bb12f537534a27564&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:42.258427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9eb10-da5e-4dfe-9db0-cd8d314324f6 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:42.361518 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9eb10-da5e-4dfe-9db0-cd8d314324f6 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:42.396316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74afc9e4-34ac-438a-a063-4d9f82a4c969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:42.396926 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afc9e4-34ac-438a-a063-4d9f82a4c969 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:42.397206 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afc9e4-34ac-438a-a063-4d9f82a4c969 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:42.397477 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afc9e4-34ac-438a-a063-4d9f82a4c969 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:42.398113 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74afc9e4-34ac-438a-a063-4d9f82a4c969 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:42.399477 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74afc9e4-34ac-438a-a063-4d9f82a4c969 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:42.406229 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 524/1029] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Aug 24 14:20:42 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:20:42.430749 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eddde80-34b7-4bea-aa40-75701cb4093d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:42.507785 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d67240-e6a0-4219-9a31-800bb751e9ba None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:42.508060 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d67240-e6a0-4219-9a31-800bb751e9ba None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:42.508333 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d67240-e6a0-4219-9a31-800bb751e9ba None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:42.509879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 525/1030] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:42.515465 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12aa12-0125-4086-80b2-b5a0254be26a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:42.515793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12aa12-0125-4086-80b2-b5a0254be26a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:42.516017 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12aa12-0125-4086-80b2-b5a0254be26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:42.535250 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4a12aa12-0125-4086-80b2-b5a0254be26a None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:42.536483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4a12aa12-0125-4086-80b2-b5a0254be26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:42.544423 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eddde80-34b7-4bea-aa40-75701cb4093d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:42.545360 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:42.590018 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9da4e8-9ae4-4796-8528-4819e29cdd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:42.590942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9da4e8-9ae4-4796-8528-4819e29cdd45 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:42.591373 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9da4e8-9ae4-4796-8528-4819e29cdd45 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:42.591903 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9da4e8-9ae4-4796-8528-4819e29cdd45 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:42.593309 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9da4e8-9ae4-4796-8528-4819e29cdd45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:42.595035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9da4e8-9ae4-4796-8528-4819e29cdd45 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:42.597275 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 506/1031] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:42.602411 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9da4e8-9ae4-4796-8528-4819e29cdd45 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:42.616844 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 526/1032] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:20:42.660464 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:42.705286 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9da4e8-9ae4-4796-8528-4819e29cdd45 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:42.739990 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e103a-4e23-4228-a0b0-25ffa9460bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:42.740591 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e103a-4e23-4228-a0b0-25ffa9460bfc None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:42.740871 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e103a-4e23-4228-a0b0-25ffa9460bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:42.741143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e103a-4e23-4228-a0b0-25ffa9460bfc None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:42.741790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e103a-4e23-4228-a0b0-25ffa9460bfc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:42.743218 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e103a-4e23-4228-a0b0-25ffa9460bfc None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:42.885899 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 507/1033] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 14:20:42 2022] POST /identity/v3/users => generated 285 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:20:42.887503 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12aa12-0125-4086-80b2-b5a0254be26a None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:42.997960 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12aa12-0125-4086-80b2-b5a0254be26a None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:43.035482 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e817622-4150-4e24-872c-54890c94f9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:43.036110 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e817622-4150-4e24-872c-54890c94f9e7 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:43.036407 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e817622-4150-4e24-872c-54890c94f9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:43.036679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e817622-4150-4e24-872c-54890c94f9e7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:43.048249 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e817622-4150-4e24-872c-54890c94f9e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:20:43.053010 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-2e817622-4150-4e24-872c-54890c94f9e7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 14:20:43.053010 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:43.053010 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:43.053010 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:43.053010 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:43.053010 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:43.053010 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:43.053010 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:43.053010 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:43.053010 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:43.053010 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:43.053010 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:43.053010 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:20:43.053010 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:20:43.053010 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:20:43.053010 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:20:43.053993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:20:43.053993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:20:43.053993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:20:43.053993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:20:43.053993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:43.053993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:43.053993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:43.053993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:43.053993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:43.053993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:43.053993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:43.053993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:43.053993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:43.053993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:43.053993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:43.053993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:43.054873 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:43.054873 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:43.054873 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:43.054873 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:43.054873 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:20:43.054873 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:20:43.054873 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:20:43.054873 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:20:43.054873 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:20:43.054873 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:20:43.054873 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 14:20:43.054873 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:43.054873 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 527/1034] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Aug 24 14:20:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:43.060338 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e103a-4e23-4228-a0b0-25ffa9460bfc None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:43.170587 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e103a-4e23-4228-a0b0-25ffa9460bfc None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:43.181083 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:43.204610 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0854f1b-3291-4420-b09f-6dce3035fb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:43.205215 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0854f1b-3291-4420-b09f-6dce3035fb32 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:43.205494 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0854f1b-3291-4420-b09f-6dce3035fb32 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:43.205780 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0854f1b-3291-4420-b09f-6dce3035fb32 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:43.206451 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0854f1b-3291-4420-b09f-6dce3035fb32 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:43.206751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0854f1b-3291-4420-b09f-6dce3035fb32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:43.208120 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0854f1b-3291-4420-b09f-6dce3035fb32 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:43.218373 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 508/1035] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Aug 24 14:20:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:43.224191 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e817622-4150-4e24-872c-54890c94f9e7 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:43.227995 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:43.336326 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e817622-4150-4e24-872c-54890c94f9e7 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:43.371531 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236f6fd-7c76-438b-8e8b-88b8bcd62cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:43.372155 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236f6fd-7c76-438b-8e8b-88b8bcd62cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:43.372428 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236f6fd-7c76-438b-8e8b-88b8bcd62cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:43.372702 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236f6fd-7c76-438b-8e8b-88b8bcd62cd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:43.383552 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236f6fd-7c76-438b-8e8b-88b8bcd62cd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:43.385011 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236f6fd-7c76-438b-8e8b-88b8bcd62cd6 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:43.400230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-5236f6fd-7c76-438b-8e8b-88b8bcd62cd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:43.400230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:43.400230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:43.400230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:43.400230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:43.400230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:43.400230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:43.400230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:43.400230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:43.400230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:43.400230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:43.400230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:43.400230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:43.400230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:43.400230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:43.400230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:43.402018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:43.402018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:43.402018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:43.402018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:43.402018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:43.402018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:43.402018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:43.402018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:43.402018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:43.402018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:43.402018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:43.402018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:43.402018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:43.402018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:43.402018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:43.402018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:43.402018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:43.402960 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:43.402960 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:43.402960 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:43.405808 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 528/1036] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:43.408024 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0854f1b-3291-4420-b09f-6dce3035fb32 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:43.517444 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0854f1b-3291-4420-b09f-6dce3035fb32 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:43.551503 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429fec1-0c56-4429-aeb8-8f06430c59e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:43.552172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429fec1-0c56-4429-aeb8-8f06430c59e4 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:43.552457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429fec1-0c56-4429-aeb8-8f06430c59e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:43.552731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429fec1-0c56-4429-aeb8-8f06430c59e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:43.553374 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429fec1-0c56-4429-aeb8-8f06430c59e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:43.553677 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429fec1-0c56-4429-aeb8-8f06430c59e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:43.555088 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429fec1-0c56-4429-aeb8-8f06430c59e4 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:43.571420 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 509/1037] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:43.573660 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236f6fd-7c76-438b-8e8b-88b8bcd62cd6 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:43.629277 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:43.674124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236f6fd-7c76-438b-8e8b-88b8bcd62cd6 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:43.707166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadf0a0-1b4d-4681-b601-74d38e096f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:43.707781 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadf0a0-1b4d-4681-b601-74d38e096f7f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:43.708058 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadf0a0-1b4d-4681-b601-74d38e096f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:43.708327 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadf0a0-1b4d-4681-b601-74d38e096f7f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:43.715632 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fadf0a0-1b4d-4681-b601-74d38e096f7f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:43.717041 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fadf0a0-1b4d-4681-b601-74d38e096f7f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:43.727801 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-6fadf0a0-1b4d-4681-b601-74d38e096f7f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:20:43.727801 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:43.727801 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:43.727801 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:43.727801 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:43.727801 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:43.727801 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:43.727801 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:43.727801 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:43.727801 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:43.727801 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:43.727801 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:43.727801 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:20:43.727801 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:20:43.727801 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:20:43.727801 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:20:43.728749 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:43.728749 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:43.728749 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:20:43.728749 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:43.728749 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:20:43.728749 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:43.728749 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:43.728749 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:43.728749 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:43.728749 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:43.728749 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:43.728749 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:43.728749 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:43.728749 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:43.728749 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:43.728749 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:43.728749 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:43.728749 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:43.730439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:43.730439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:43.730439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:20:43.730439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:20:43.730439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:20:43.730439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:20:43.730439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:20:43.730439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:20:43.730439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:20:43.730439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:43.735426 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 529/1038] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Aug 24 14:20:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:43.735544 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429fec1-0c56-4429-aeb8-8f06430c59e4 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:43.769262 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:43.839028 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429fec1-0c56-4429-aeb8-8f06430c59e4 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:43.871943 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f60b7-2df1-42fc-89fe-540dfa477518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:43.872546 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f60b7-2df1-42fc-89fe-540dfa477518 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:43.872821 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f60b7-2df1-42fc-89fe-540dfa477518 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:43.873090 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f60b7-2df1-42fc-89fe-540dfa477518 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:43.873916 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f60b7-2df1-42fc-89fe-540dfa477518 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:43.874136 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f60b7-2df1-42fc-89fe-540dfa477518 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:43.875548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f60b7-2df1-42fc-89fe-540dfa477518 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:43.898250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 510/1039] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Aug 24 14:20:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:43.899679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadf0a0-1b4d-4681-b601-74d38e096f7f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:43.999703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadf0a0-1b4d-4681-b601-74d38e096f7f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:44.014223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:44.034585 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b496ddf-abf9-4754-b930-6333b5791092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:44.035271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b496ddf-abf9-4754-b930-6333b5791092 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:44.035655 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b496ddf-abf9-4754-b930-6333b5791092 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:44.036026 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b496ddf-abf9-4754-b930-6333b5791092 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:44.105227 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b496ddf-abf9-4754-b930-6333b5791092 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:44.106855 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b496ddf-abf9-4754-b930-6333b5791092 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:44.210411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 530/1040] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:20:43 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 14:20:44.211823 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f60b7-2df1-42fc-89fe-540dfa477518 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:44.310017 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:44.320570 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f60b7-2df1-42fc-89fe-540dfa477518 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:44.345800 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4d68f-13df-489d-aed0-6bf752ecab84 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:44.345800 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4d68f-13df-489d-aed0-6bf752ecab84 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:44.346094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4d68f-13df-489d-aed0-6bf752ecab84 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:44.347551 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 531/1041] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:20:44.352932 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aa1ba-bbbb-4342-9267-d936f38857b6 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:44.353212 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aa1ba-bbbb-4342-9267-d936f38857b6 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:44.353483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aa1ba-bbbb-4342-9267-d936f38857b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:44.356951 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccef32e-9218-41d5-a8dc-4a25e7c5519f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:44.357687 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccef32e-9218-41d5-a8dc-4a25e7c5519f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:44.358056 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccef32e-9218-41d5-a8dc-4a25e7c5519f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:44.358337 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccef32e-9218-41d5-a8dc-4a25e7c5519f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:44.370114 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccef32e-9218-41d5-a8dc-4a25e7c5519f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:44.371558 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccef32e-9218-41d5-a8dc-4a25e7c5519f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:44.374406 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-be0aa1ba-bbbb-4342-9267-d936f38857b6 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:44.375596 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-be0aa1ba-bbbb-4342-9267-d936f38857b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:44.386505 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-7ccef32e-9218-41d5-a8dc-4a25e7c5519f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:44.386505 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:44.386505 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:44.386505 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:44.386505 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:44.386505 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:44.386505 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:44.386505 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:44.386505 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:44.386505 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:44.386505 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:44.386505 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:44.386505 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:44.386505 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:44.386505 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:44.386505 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:44.387507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:44.387507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:44.387507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:44.387507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:44.387507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:44.387507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:44.387507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:44.387507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:44.387507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:44.387507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:44.387507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:44.387507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:44.387507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:44.387507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:44.387507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:44.387507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:44.387507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:44.388421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:44.388421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:44.388421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:44.388592 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:44.388663 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 511/1042] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:44.393204 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccef32e-9218-41d5-a8dc-4a25e7c5519f None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:44.451965 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 532/1043] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:20:44.503093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccef32e-9218-41d5-a8dc-4a25e7c5519f None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:44.537614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18476e03-97c9-4897-9758-c75ce4d85738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:44.538279 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18476e03-97c9-4897-9758-c75ce4d85738 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:44.538514 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18476e03-97c9-4897-9758-c75ce4d85738 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:44.538792 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18476e03-97c9-4897-9758-c75ce4d85738 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:44.539440 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18476e03-97c9-4897-9758-c75ce4d85738 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:44.539744 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18476e03-97c9-4897-9758-c75ce4d85738 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:44.541106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18476e03-97c9-4897-9758-c75ce4d85738 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:44.553841 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 512/1044] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:44.560154 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0aa1ba-bbbb-4342-9267-d936f38857b6 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:44.660297 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0aa1ba-bbbb-4342-9267-d936f38857b6 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:44.694376 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c16a4-7c4d-4533-a8a2-946a30f59ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:44.695005 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c16a4-7c4d-4533-a8a2-946a30f59ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:44.695285 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c16a4-7c4d-4533-a8a2-946a30f59ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:44.695613 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c16a4-7c4d-4533-a8a2-946a30f59ea9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:44.702344 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c16a4-7c4d-4533-a8a2-946a30f59ea9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:44.703792 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c16a4-7c4d-4533-a8a2-946a30f59ea9 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:44.714862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-285c16a4-7c4d-4533-a8a2-946a30f59ea9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:44.714862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:44.714862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:44.714862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:44.714862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:44.714862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:44.714862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:44.714862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:44.714862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:44.714862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:44.714862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:44.714862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:44.714862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:20:44.714862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:20:44.714862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:20:44.715780 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:20:44.715780 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:44.715780 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:44.715780 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:44.715780 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:44.715780 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:44.715780 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:44.715780 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:44.715780 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:44.715780 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:44.715780 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:44.715780 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:44.715780 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:44.715780 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:44.715780 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:44.715780 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:44.715780 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:44.716666 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:20:44.716666 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:20:44.716666 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:20:44.716666 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:20:44.716666 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:20:44.716666 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:20:44.716666 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:44.716666 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:44.718658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18476e03-97c9-4897-9758-c75ce4d85738 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:44.720744 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 533/1045] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:20:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:44.721424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c16a4-7c4d-4533-a8a2-946a30f59ea9 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:44.721866 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:44.725350 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:44.827106 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c16a4-7c4d-4533-a8a2-946a30f59ea9 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:44.848031 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18476e03-97c9-4897-9758-c75ce4d85738 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:44.861816 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3edf8b-347e-4832-bb78-008f7976adb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:44.862645 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3edf8b-347e-4832-bb78-008f7976adb4 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:44.863100 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3edf8b-347e-4832-bb78-008f7976adb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:44.863376 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3edf8b-347e-4832-bb78-008f7976adb4 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:44.864071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3edf8b-347e-4832-bb78-008f7976adb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:44.864399 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3edf8b-347e-4832-bb78-008f7976adb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:44.865819 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3edf8b-347e-4832-bb78-008f7976adb4 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:44.880451 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 534/1046] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:20:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:44.885938 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3866e8b-9210-4d6c-9f56-51b17e877549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:44.886288 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3edf8b-347e-4832-bb78-008f7976adb4 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:44.886750 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3866e8b-9210-4d6c-9f56-51b17e877549 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:44.887019 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3866e8b-9210-4d6c-9f56-51b17e877549 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:44.887402 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3866e8b-9210-4d6c-9f56-51b17e877549 None admin] PATH_INFO: `/v3/services/image` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:44.887984 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3866e8b-9210-4d6c-9f56-51b17e877549 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:44.889370 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3866e8b-9210-4d6c-9f56-51b17e877549 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:44.898194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-b3866e8b-9210-4d6c-9f56-51b17e877549 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 14:20:44.898194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:44.898194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:20:44.898194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:20:44.898194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:20:44.898194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:20:44.898194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:20:44.898194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:44.898194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 14:20:44.898194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:44.898194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:20:44.898194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:44.898194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:44.898194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:44.898194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:44.898194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:44.898194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:44.899397 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:44.899397 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:44.899397 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:44.899397 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:44.899397 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:44.899397 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:44.899397 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:20:44.899397 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:20:44.899397 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:20:44.899397 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:20:44.899397 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:44.899397 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:44.899397 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:44.899397 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:44.899397 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:44.899397 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:44.900248 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:44.900248 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:44.900248 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:44.900248 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:44.900248 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:44.900248 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:44.900248 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:44.900248 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:44.900248 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:44.900248 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:44.900248 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:20:44.900248 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:20:44.900248 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 14:20:44.900248 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:44.900248 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 513/1047] 10.222.0.65 () {56 vars in 1105 bytes} [Wed Aug 24 14:20:44 2022] GET /identity/v3/services/image => generated 86 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:44.905064 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3866e8b-9210-4d6c-9f56-51b17e877549 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:44.955471 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:44.972303 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:44.993737 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3edf8b-347e-4832-bb78-008f7976adb4 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:45.006863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3866e8b-9210-4d6c-9f56-51b17e877549 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:45.029529 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa34e95-e751-408f-b5b2-aa4e4b7cc128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:45.030169 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa34e95-e751-408f-b5b2-aa4e4b7cc128 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:45.030453 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa34e95-e751-408f-b5b2-aa4e4b7cc128 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:45.030724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa34e95-e751-408f-b5b2-aa4e4b7cc128 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:45.031455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa34e95-e751-408f-b5b2-aa4e4b7cc128 None admin] RBAC: Adding query filter params (role.id=89526ad5407b4974a7368c7aa6411cf8, scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e, user.id=8d099678d6454f7eb494892a69feaf62) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:45.031794 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa34e95-e751-408f-b5b2-aa4e4b7cc128 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:45.033231 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa34e95-e751-408f-b5b2-aa4e4b7cc128 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:45.038536 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 535/1048] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:20:44 2022] GET /identity/v3/role_assignments?user.id=8d099678d6454f7eb494892a69feaf62&scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e&role.id=89526ad5407b4974a7368c7aa6411cf8 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:45.040730 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98295e8a-05ba-463c-a4cf-9d168b44eeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:45.041366 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98295e8a-05ba-463c-a4cf-9d168b44eeb9 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:45.042434 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98295e8a-05ba-463c-a4cf-9d168b44eeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:45.042929 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98295e8a-05ba-463c-a4cf-9d168b44eeb9 None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:45.043522 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b198a-5ed5-499f-bc05-94bc4fe829d5 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:45.043638 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98295e8a-05ba-463c-a4cf-9d168b44eeb9 None admin] RBAC: Adding query filter params (name=image) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:45.043811 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b198a-5ed5-499f-bc05-94bc4fe829d5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:45.043908 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98295e8a-05ba-463c-a4cf-9d168b44eeb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:45.044065 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b198a-5ed5-499f-bc05-94bc4fe829d5 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:45.045291 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98295e8a-05ba-463c-a4cf-9d168b44eeb9 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:45.050184 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 536/1049] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:45.055826 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 514/1050] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:45.056034 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d56f5-d4a3-4278-9b54-08be7b54c5a5 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:45.056034 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d56f5-d4a3-4278-9b54-08be7b54c5a5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:45.056034 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d56f5-d4a3-4278-9b54-08be7b54c5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:45.057414 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98295e8a-05ba-463c-a4cf-9d168b44eeb9 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:45.072196 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-7b8d56f5-d4a3-4278-9b54-08be7b54c5a5 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:45.074218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7b8d56f5-d4a3-4278-9b54-08be7b54c5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:45.162019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 537/1051] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:20:45.186672 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98295e8a-05ba-463c-a4cf-9d168b44eeb9 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:45.217243 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:45.223263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797f53a-0e4e-4c57-ba03-f37dece6eb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:45.223975 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797f53a-0e4e-4c57-ba03-f37dece6eb7d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:45.224353 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797f53a-0e4e-4c57-ba03-f37dece6eb7d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:45.224725 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797f53a-0e4e-4c57-ba03-f37dece6eb7d None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:45.225474 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797f53a-0e4e-4c57-ba03-f37dece6eb7d None admin] RBAC: Adding query filter params (type=image) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:45.225909 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797f53a-0e4e-4c57-ba03-f37dece6eb7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:45.227352 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797f53a-0e4e-4c57-ba03-f37dece6eb7d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:45.237499 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 515/1052] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:45.238461 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d56f5-d4a3-4278-9b54-08be7b54c5a5 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:45.302357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:45.345270 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d56f5-d4a3-4278-9b54-08be7b54c5a5 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:45.380086 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18b0d0-39f1-4624-9519-60257646e3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:45.380825 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18b0d0-39f1-4624-9519-60257646e3be None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:45.381061 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18b0d0-39f1-4624-9519-60257646e3be None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:45.381276 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18b0d0-39f1-4624-9519-60257646e3be None admin] PATH_INFO: `/v3/endpoints` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:45.381992 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18b0d0-39f1-4624-9519-60257646e3be None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:45.383355 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18b0d0-39f1-4624-9519-60257646e3be None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:45.424900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797f53a-0e4e-4c57-ba03-f37dece6eb7d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:45.494067 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 538/1053] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:20:45 2022] POST /identity/v3/endpoints => generated 327 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:20:45.551315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797f53a-0e4e-4c57-ba03-f37dece6eb7d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:45.595143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dff54e-b733-49b9-b7cf-bc0682d7cb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:45.595776 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dff54e-b733-49b9-b7cf-bc0682d7cb43 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:45.596054 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dff54e-b733-49b9-b7cf-bc0682d7cb43 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:45.596323 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dff54e-b733-49b9-b7cf-bc0682d7cb43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:45.609122 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dff54e-b733-49b9-b7cf-bc0682d7cb43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:20:45.613860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-d5dff54e-b733-49b9-b7cf-bc0682d7cb43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:20:45.613860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:45.613860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:45.613860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:45.613860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:45.613860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:45.613860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:45.613860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:45.613860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:45.613860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:45.613860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:45.613860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:45.613860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:20:45.613860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:20:45.613860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:20:45.613860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:20:45.614886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:20:45.614886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:20:45.614886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:20:45.614886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:20:45.614886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:45.614886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:45.614886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:45.614886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:45.614886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:45.614886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:45.614886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:45.614886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:45.614886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:45.614886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:45.614886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:45.614886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:45.618779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:45.618779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:45.618779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:45.618779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:45.618779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:20:45.618779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:20:45.618779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:20:45.618779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:20:45.618779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:20:45.618779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:20:45.618779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:20:45.618779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:45.618779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 516/1054] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:20:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:20:45.622275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18b0d0-39f1-4624-9519-60257646e3be None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:45.731454 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18b0d0-39f1-4624-9519-60257646e3be None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:45.745928 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:45.768272 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d26345-b59d-4628-a037-63f7d0e7a52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:45.769083 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d26345-b59d-4628-a037-63f7d0e7a52e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:45.769442 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d26345-b59d-4628-a037-63f7d0e7a52e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:45.770106 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d26345-b59d-4628-a037-63f7d0e7a52e None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:45.771094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d26345-b59d-4628-a037-63f7d0e7a52e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:45.771900 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d26345-b59d-4628-a037-63f7d0e7a52e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:45.773562 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d26345-b59d-4628-a037-63f7d0e7a52e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:45.785833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 539/1055] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:20:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:45.789467 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dff54e-b733-49b9-b7cf-bc0682d7cb43 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:45.843849 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:45.896803 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dff54e-b733-49b9-b7cf-bc0682d7cb43 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:45.931411 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5a56a-f20c-4967-a855-c560d162b5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:45.932106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5a56a-f20c-4967-a855-c560d162b5e0 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:45.932382 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5a56a-f20c-4967-a855-c560d162b5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:45.932657 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5a56a-f20c-4967-a855-c560d162b5e0 None admin] PATH_INFO: `/v3/users/8d227930e3184d4ea9f1d98d006fb4fb` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:45.946190 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5a56a-f20c-4967-a855-c560d162b5e0 None admin] RBAC: Authorizing `identity:get_user(user_id=8d227930e3184d4ea9f1d98d006fb4fb)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:45.947666 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5a56a-f20c-4967-a855-c560d162b5e0 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:45.949539 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 517/1056] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:20:45 2022] GET /identity/v3/users/8d227930e3184d4ea9f1d98d006fb4fb => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:45.955151 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d26345-b59d-4628-a037-63f7d0e7a52e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:46.058595 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d26345-b59d-4628-a037-63f7d0e7a52e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:46.092969 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b76dae-9ed5-43a8-8bf6-4257c166d16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:46.093573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b76dae-9ed5-43a8-8bf6-4257c166d16b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:46.093884 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b76dae-9ed5-43a8-8bf6-4257c166d16b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:46.094157 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b76dae-9ed5-43a8-8bf6-4257c166d16b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:46.141008 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:46.164505 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b76dae-9ed5-43a8-8bf6-4257c166d16b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:46.166096 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b76dae-9ed5-43a8-8bf6-4257c166d16b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:46.272480 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 540/1057] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:20:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:20:46.278893 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5a56a-f20c-4967-a855-c560d162b5e0 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:46.378925 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5a56a-f20c-4967-a855-c560d162b5e0 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:46.389833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:46.415695 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6019e4f-4a29-4f6d-9c85-636908366eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:46.416727 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6019e4f-4a29-4f6d-9c85-636908366eac None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:46.417282 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6019e4f-4a29-4f6d-9c85-636908366eac None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:46.417708 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6019e4f-4a29-4f6d-9c85-636908366eac None admin] PATH_INFO: `/v3/projects/d2b909fda5e244cabd49830c888ced35` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:46.419010 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6019e4f-4a29-4f6d-9c85-636908366eac None admin] RBAC: Authorizing `identity:get_project(project_id=d2b909fda5e244cabd49830c888ced35)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:46.420565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6019e4f-4a29-4f6d-9c85-636908366eac None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:46.422888 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 518/1058] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:20:46 2022] GET /identity/v3/projects/d2b909fda5e244cabd49830c888ced35 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:46.428881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b76dae-9ed5-43a8-8bf6-4257c166d16b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:46.511224 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:46.534538 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b76dae-9ed5-43a8-8bf6-4257c166d16b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:46.569622 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049bb28-7568-4cc4-b987-44d5ce0e1608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:46.570252 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049bb28-7568-4cc4-b987-44d5ce0e1608 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:46.570527 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049bb28-7568-4cc4-b987-44d5ce0e1608 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:46.570795 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049bb28-7568-4cc4-b987-44d5ce0e1608 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:46.571580 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049bb28-7568-4cc4-b987-44d5ce0e1608 None admin] RBAC: Adding query filter params (role.id=b779073cee3c470ca4ad7a7b27d72c5e, scope.project.id=d2b909fda5e244cabd49830c888ced35, user.id=8d227930e3184d4ea9f1d98d006fb4fb) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:46.571892 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049bb28-7568-4cc4-b987-44d5ce0e1608 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:46.573864 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049bb28-7568-4cc4-b987-44d5ce0e1608 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:46.589803 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 541/1059] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:20:46 2022] GET /identity/v3/role_assignments?user.id=8d227930e3184d4ea9f1d98d006fb4fb&scope.project.id=d2b909fda5e244cabd49830c888ced35&role.id=b779073cee3c470ca4ad7a7b27d72c5e => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:46.966993 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96058ac4-b33b-4333-a7df-d16b0a5c10b4 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:46.967519 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96058ac4-b33b-4333-a7df-d16b0a5c10b4 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:46.967519 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96058ac4-b33b-4333-a7df-d16b0a5c10b4 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:46.968923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 519/1060] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:46.974090 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31c04f-c9be-471e-b2cc-d6db4a56a8ec None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:46.974371 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31c04f-c9be-471e-b2cc-d6db4a56a8ec None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:46.974641 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31c04f-c9be-471e-b2cc-d6db4a56a8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:46.992844 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-6d31c04f-c9be-471e-b2cc-d6db4a56a8ec None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:46.994044 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6d31c04f-c9be-471e-b2cc-d6db4a56a8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:47.064756 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 542/1061] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:20:47.334312 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96058ac4-b33b-4333-a7df-d16b0a5c10b4 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:47.422973 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fbc84-17ee-45c9-85ea-6ec2c248e0bd None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:47.423748 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fbc84-17ee-45c9-85ea-6ec2c248e0bd None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:47.424037 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fbc84-17ee-45c9-85ea-6ec2c248e0bd None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:47.425538 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 543/1062] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:47.430495 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb01938-61aa-4bfb-82f3-374361410f44 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:47.431049 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb01938-61aa-4bfb-82f3-374361410f44 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:47.431049 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb01938-61aa-4bfb-82f3-374361410f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:47.444367 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96058ac4-b33b-4333-a7df-d16b0a5c10b4 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:47.450163 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4fb01938-61aa-4bfb-82f3-374361410f44 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:47.451362 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4fb01938-61aa-4bfb-82f3-374361410f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:47.482900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ffcb8-d98f-4c18-aafe-25d41c89aa33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:47.483533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ffcb8-d98f-4c18-aafe-25d41c89aa33 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:47.484045 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ffcb8-d98f-4c18-aafe-25d41c89aa33 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:47.484154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ffcb8-d98f-4c18-aafe-25d41c89aa33 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:47.495179 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ffcb8-d98f-4c18-aafe-25d41c89aa33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:20:47.499737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-de1ffcb8-d98f-4c18-aafe-25d41c89aa33 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 14:20:47.499737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:47.499737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:47.499737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:47.499737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:47.499737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:47.499737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:47.499737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:47.499737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:47.499737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:47.499737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:47.499737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:47.499737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:20:47.499737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:20:47.499737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:20:47.499737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:20:47.500694 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:20:47.500694 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:20:47.500694 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:20:47.500694 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:20:47.500694 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:47.500694 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:47.500694 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:47.500694 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:47.500694 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:47.500694 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:47.500694 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:47.500694 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:47.500694 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:47.500694 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:47.500694 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:47.500694 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:47.501536 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:47.501536 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:47.501536 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:47.501536 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:47.501536 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:20:47.501536 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:20:47.501536 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:20:47.501536 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:20:47.501536 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:20:47.501536 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:20:47.501536 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 14:20:47.501536 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:47.501536 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 520/1063] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Aug 24 14:20:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:47.506794 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ffcb8-d98f-4c18-aafe-25d41c89aa33 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:47.525440 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:47.531490 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 544/1064] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:20:47.545680 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:47.611229 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ffcb8-d98f-4c18-aafe-25d41c89aa33 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:47.647581 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d057c-2bce-49a1-a5da-75d393905b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:47.648192 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d057c-2bce-49a1-a5da-75d393905b2c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:47.648473 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d057c-2bce-49a1-a5da-75d393905b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:47.648746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d057c-2bce-49a1-a5da-75d393905b2c None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:47.649416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d057c-2bce-49a1-a5da-75d393905b2c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:47.649720 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d057c-2bce-49a1-a5da-75d393905b2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:47.651779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d057c-2bce-49a1-a5da-75d393905b2c None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:47.660300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 521/1065] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Aug 24 14:20:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:47.665971 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb01938-61aa-4bfb-82f3-374361410f44 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:47.766177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb01938-61aa-4bfb-82f3-374361410f44 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:47.800345 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e497f-ed16-43d5-bcb6-0ead0c657c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:47.800961 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e497f-ed16-43d5-bcb6-0ead0c657c8b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:47.801230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e497f-ed16-43d5-bcb6-0ead0c657c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:47.801494 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e497f-ed16-43d5-bcb6-0ead0c657c8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:47.807889 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d057c-2bce-49a1-a5da-75d393905b2c None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:47.812371 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e497f-ed16-43d5-bcb6-0ead0c657c8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:47.813824 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e497f-ed16-43d5-bcb6-0ead0c657c8b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:47.828496 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-e72e497f-ed16-43d5-bcb6-0ead0c657c8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:47.828496 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:47.828496 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:47.828496 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:47.828496 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:47.828496 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:47.828496 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:47.828496 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:47.828496 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:47.828496 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:47.828496 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:47.828496 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:47.828496 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:47.828496 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:47.828496 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:47.828496 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:47.829559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:47.829559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:47.829559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:47.829559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:47.829559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:47.829559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:47.829559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:47.829559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:47.829559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:47.829559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:47.829559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:47.829559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:47.829559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:47.829559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:47.829559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:47.829559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:47.829559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:47.834957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:47.834957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:47.834957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:47.834957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 545/1066] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:47.837128 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e497f-ed16-43d5-bcb6-0ead0c657c8b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:47.892432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:47.912863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:47.917690 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d057c-2bce-49a1-a5da-75d393905b2c None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:47.943940 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e497f-ed16-43d5-bcb6-0ead0c657c8b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:47.954370 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39001f5-7f1d-470a-b490-91d3ae708412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:47.954972 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39001f5-7f1d-470a-b490-91d3ae708412 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:47.955245 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39001f5-7f1d-470a-b490-91d3ae708412 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:47.955513 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39001f5-7f1d-470a-b490-91d3ae708412 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:47.984603 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702db62-0758-41b0-8683-796b6d065e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:47.985345 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702db62-0758-41b0-8683-796b6d065e9f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:47.985620 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702db62-0758-41b0-8683-796b6d065e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:47.985939 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702db62-0758-41b0-8683-796b6d065e9f None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:47.986557 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702db62-0758-41b0-8683-796b6d065e9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:47.986855 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702db62-0758-41b0-8683-796b6d065e9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:47.988448 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702db62-0758-41b0-8683-796b6d065e9f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:48.006931 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 546/1067] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:48.008155 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702db62-0758-41b0-8683-796b6d065e9f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:48.031472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39001f5-7f1d-470a-b490-91d3ae708412 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:48.032933 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39001f5-7f1d-470a-b490-91d3ae708412 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:48.122096 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702db62-0758-41b0-8683-796b6d065e9f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:48.134663 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:48.138634 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:48.144320 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 522/1068] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:20:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 14:20:48.145199 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39001f5-7f1d-470a-b490-91d3ae708412 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:48.163800 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25e703-96cf-4e5a-816d-fdc196919185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:48.164437 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25e703-96cf-4e5a-816d-fdc196919185 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:48.164715 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25e703-96cf-4e5a-816d-fdc196919185 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:48.164988 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25e703-96cf-4e5a-816d-fdc196919185 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:48.174115 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25e703-96cf-4e5a-816d-fdc196919185 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:48.175547 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25e703-96cf-4e5a-816d-fdc196919185 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:48.189657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-4b25e703-96cf-4e5a-816d-fdc196919185 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:20:48.189657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:48.189657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:48.189657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:48.189657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:48.189657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:48.189657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:48.189657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:48.189657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:48.189657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:48.189657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:48.189657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:48.189657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:20:48.189657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:20:48.189657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:20:48.189657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:20:48.190818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:48.190818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:48.190818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:20:48.190818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:48.190818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:20:48.190818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:48.190818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:48.190818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:48.190818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:48.190818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:48.190818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:48.190818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:48.190818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:48.190818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:48.190818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:48.190818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:48.190818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:48.190818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:48.192343 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:48.192343 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:48.192343 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:20:48.192343 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:20:48.192343 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:20:48.192343 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:20:48.192343 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:20:48.192343 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:20:48.192343 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:20:48.192343 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:48.195560 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 547/1069] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Aug 24 14:20:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:20:48.201375 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25e703-96cf-4e5a-816d-fdc196919185 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:48.267082 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39001f5-7f1d-470a-b490-91d3ae708412 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:48.305865 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c825390-afd7-4d7c-94ae-028e99c45127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:48.306485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c825390-afd7-4d7c-94ae-028e99c45127 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:48.307173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c825390-afd7-4d7c-94ae-028e99c45127 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:48.307173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c825390-afd7-4d7c-94ae-028e99c45127 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:48.313543 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25e703-96cf-4e5a-816d-fdc196919185 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:48.318209 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c825390-afd7-4d7c-94ae-028e99c45127 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:48.319658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c825390-afd7-4d7c-94ae-028e99c45127 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:48.335532 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-4c825390-afd7-4d7c-94ae-028e99c45127 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:48.335532 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:48.335532 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:48.335532 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:48.335532 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:48.335532 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:48.335532 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:48.335532 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:48.335532 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:48.335532 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:48.335532 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:48.335532 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:48.335532 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:48.335532 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:48.335532 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:48.335532 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:48.337962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:48.337962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:48.337962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:48.337962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:48.337962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:48.337962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:48.337962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:48.337962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:48.337962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:48.337962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:48.337962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:48.337962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:48.337962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:48.337962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:48.337962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:48.337962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:48.337962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:48.339843 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:48.339843 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:48.339843 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:48.339843 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 523/1070] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:48.343418 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c825390-afd7-4d7c-94ae-028e99c45127 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:48.355477 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3ae24-83d3-4097-81e2-a43c101af481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:48.356090 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3ae24-83d3-4097-81e2-a43c101af481 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:48.356371 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3ae24-83d3-4097-81e2-a43c101af481 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:48.356644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3ae24-83d3-4097-81e2-a43c101af481 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:48.357379 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3ae24-83d3-4097-81e2-a43c101af481 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:48.357685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3ae24-83d3-4097-81e2-a43c101af481 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:48.359149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3ae24-83d3-4097-81e2-a43c101af481 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:48.382078 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 548/1071] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Aug 24 14:20:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:48.383270 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3ae24-83d3-4097-81e2-a43c101af481 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:48.399341 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:48.413621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:48.454454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c825390-afd7-4d7c-94ae-028e99c45127 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:48.487507 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3ae24-83d3-4097-81e2-a43c101af481 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:48.493187 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213ef59-cea5-419a-8aad-aa75fd891d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:48.493967 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213ef59-cea5-419a-8aad-aa75fd891d1e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:48.494249 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213ef59-cea5-419a-8aad-aa75fd891d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:48.494678 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213ef59-cea5-419a-8aad-aa75fd891d1e None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:48.495327 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c213ef59-cea5-419a-8aad-aa75fd891d1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:48.495630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c213ef59-cea5-419a-8aad-aa75fd891d1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:48.497413 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c213ef59-cea5-419a-8aad-aa75fd891d1e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:48.510721 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 524/1072] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:48.512242 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcff42-9191-438e-b4df-93478d499747 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:48.512528 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcff42-9191-438e-b4df-93478d499747 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:48.512805 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcff42-9191-438e-b4df-93478d499747 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:48.514103 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 525/1073] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:48.519937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ef35c-4f1a-4360-9520-9831e39ea6cc None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:48.520213 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ef35c-4f1a-4360-9520-9831e39ea6cc None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:48.520488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ef35c-4f1a-4360-9520-9831e39ea6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:48.540151 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-c98ef35c-4f1a-4360-9520-9831e39ea6cc None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:48.542107 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c98ef35c-4f1a-4360-9520-9831e39ea6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:48.542241 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc7d34-423e-4d74-ab91-6119ce7fd503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:48.542876 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc7d34-423e-4d74-ab91-6119ce7fd503 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:48.543155 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc7d34-423e-4d74-ab91-6119ce7fd503 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:48.543428 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc7d34-423e-4d74-ab91-6119ce7fd503 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:48.555318 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc7d34-423e-4d74-ab91-6119ce7fd503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:48.556896 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc7d34-423e-4d74-ab91-6119ce7fd503 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:48.574803 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-f5fc7d34-423e-4d74-ab91-6119ce7fd503 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:48.574803 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:48.574803 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:48.574803 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:48.574803 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:48.574803 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:48.574803 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:48.574803 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:48.574803 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:48.574803 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:48.574803 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:48.574803 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:48.574803 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:48.574803 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:48.574803 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:48.574803 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:48.575844 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:48.575844 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:48.575844 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:48.575844 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:48.575844 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:48.575844 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:48.575844 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:48.575844 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:48.575844 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:48.575844 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:48.575844 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:48.575844 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:48.575844 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:48.575844 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:48.575844 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:48.575844 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:48.575844 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:48.577209 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:48.577209 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:48.577209 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:48.577209 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 549/1074] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:48.581939 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc7d34-423e-4d74-ab91-6119ce7fd503 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:48.638091 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 526/1075] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:20:48.672203 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:48.691425 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc7d34-423e-4d74-ab91-6119ce7fd503 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:48.726171 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ab147-8f45-45e9-bbd6-d0f7d657ba33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:48.726777 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ab147-8f45-45e9-bbd6-d0f7d657ba33 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:48.727053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ab147-8f45-45e9-bbd6-d0f7d657ba33 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:48.727555 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ab147-8f45-45e9-bbd6-d0f7d657ba33 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:48.728436 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ab147-8f45-45e9-bbd6-d0f7d657ba33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:48.729537 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ab147-8f45-45e9-bbd6-d0f7d657ba33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:48.730944 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ab147-8f45-45e9-bbd6-d0f7d657ba33 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:48.743402 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 550/1076] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:48.749098 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ef35c-4f1a-4360-9520-9831e39ea6cc None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:48.794710 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:48.854797 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ef35c-4f1a-4360-9520-9831e39ea6cc None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:48.888231 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e283e-6ee8-4c9a-b423-94e5b1e64384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:48.889132 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e283e-6ee8-4c9a-b423-94e5b1e64384 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:48.889417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e283e-6ee8-4c9a-b423-94e5b1e64384 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:48.889686 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e283e-6ee8-4c9a-b423-94e5b1e64384 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:48.896121 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e283e-6ee8-4c9a-b423-94e5b1e64384 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:48.897556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e283e-6ee8-4c9a-b423-94e5b1e64384 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:48.902907 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ab147-8f45-45e9-bbd6-d0f7d657ba33 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:48.909132 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-e12e283e-6ee8-4c9a-b423-94e5b1e64384 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:48.909132 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:48.909132 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:48.909132 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:48.909132 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:48.909132 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:48.909132 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:48.909132 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:48.909132 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:48.909132 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:48.909132 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:48.909132 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:48.909132 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:20:48.909132 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:20:48.909132 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:20:48.910251 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:20:48.910251 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:48.910251 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:48.910251 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:48.910251 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:48.910251 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:48.910251 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:48.910251 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:48.910251 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:48.910251 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:48.910251 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:48.910251 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:48.910251 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:48.910251 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:48.910251 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:48.910251 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:48.910251 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:48.911564 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:20:48.911564 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:20:48.911564 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:20:48.911564 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:20:48.911564 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:20:48.911564 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:20:48.911564 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:48.911564 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:48.911564 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 527/1077] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:20:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:48.915801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e283e-6ee8-4c9a-b423-94e5b1e64384 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:49.003923 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ab147-8f45-45e9-bbd6-d0f7d657ba33 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:49.014239 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:49.017153 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e283e-6ee8-4c9a-b423-94e5b1e64384 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:49.037179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909b7a4-abea-451e-a326-a421cea9365d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:49.037829 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909b7a4-abea-451e-a326-a421cea9365d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:49.038112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909b7a4-abea-451e-a326-a421cea9365d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:49.038393 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909b7a4-abea-451e-a326-a421cea9365d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:49.049432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909b7a4-abea-451e-a326-a421cea9365d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:20:49.052176 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80f42b-e70b-43a0-9fcc-6a36735c1079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:49.052816 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80f42b-e70b-43a0-9fcc-6a36735c1079 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:49.053093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80f42b-e70b-43a0-9fcc-6a36735c1079 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:49.053358 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80f42b-e70b-43a0-9fcc-6a36735c1079 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:49.054100 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80f42b-e70b-43a0-9fcc-6a36735c1079 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:49.054204 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-6909b7a4-abea-451e-a326-a421cea9365d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:20:49.054204 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:49.054204 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:49.054204 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:49.054204 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:49.054204 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:49.054204 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:49.054204 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:49.054204 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:49.054204 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:49.054204 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:49.054204 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:49.054204 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:20:49.054204 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:20:49.054204 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:20:49.054204 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:20:49.055177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:20:49.055177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:20:49.055177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:20:49.055177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:20:49.055177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:49.055177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:49.055177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:49.055177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:49.055177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:49.055177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:49.055177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:49.055177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:49.055177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:49.055177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:49.055177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:49.055177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:49.056004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:49.056004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:49.056004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:49.056004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:49.056004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:20:49.056004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:20:49.056004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:20:49.056004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:20:49.056004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:20:49.056004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:20:49.056004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:20:49.056004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:49.056957 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80f42b-e70b-43a0-9fcc-6a36735c1079 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:49.057046 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 551/1078] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:20:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:20:49.057117 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80f42b-e70b-43a0-9fcc-6a36735c1079 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:49.061733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909b7a4-abea-451e-a326-a421cea9365d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:49.064446 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:49.067936 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 528/1079] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:20:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:49.074344 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80f42b-e70b-43a0-9fcc-6a36735c1079 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:49.167071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909b7a4-abea-451e-a326-a421cea9365d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:49.172064 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80f42b-e70b-43a0-9fcc-6a36735c1079 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:49.199857 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf3023-21ec-4ac9-9fbd-24b831b82e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:49.200671 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf3023-21ec-4ac9-9fbd-24b831b82e1e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:49.200948 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf3023-21ec-4ac9-9fbd-24b831b82e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:49.201219 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf3023-21ec-4ac9-9fbd-24b831b82e1e None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:49.201909 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf3023-21ec-4ac9-9fbd-24b831b82e1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:49.202214 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf3023-21ec-4ac9-9fbd-24b831b82e1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:49.203571 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf3023-21ec-4ac9-9fbd-24b831b82e1e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:49.205338 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b83f6-4ec0-4df6-8d9f-96e03efd9326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:49.206008 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b83f6-4ec0-4df6-8d9f-96e03efd9326 None admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:49.206283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b83f6-4ec0-4df6-8d9f-96e03efd9326 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:49.206552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b83f6-4ec0-4df6-8d9f-96e03efd9326 None admin] PATH_INFO: `/v3/projects/34cce205e8ee4ae9b09bb89bc4bb081e/users/8d099678d6454f7eb494892a69feaf62/roles/89526ad5407b4974a7368c7aa6411cf8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:49.208667 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b83f6-4ec0-4df6-8d9f-96e03efd9326 None admin] RBAC: Authorizing `identity:create_grant(project_id=34cce205e8ee4ae9b09bb89bc4bb081e, user_id=8d099678d6454f7eb494892a69feaf62, role_id=89526ad5407b4974a7368c7aa6411cf8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:49.210090 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b83f6-4ec0-4df6-8d9f-96e03efd9326 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:49.212047 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 552/1080] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:20:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:49.218301 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf3023-21ec-4ac9-9fbd-24b831b82e1e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:49.278768 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:49.284015 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 529/1081] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 14:20:49 2022] PUT /identity/v3/projects/34cce205e8ee4ae9b09bb89bc4bb081e/users/8d099678d6454f7eb494892a69feaf62/roles/89526ad5407b4974a7368c7aa6411cf8 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:20:49.319590 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf3023-21ec-4ac9-9fbd-24b831b82e1e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:49.360270 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea72e0-19ea-4aac-b7a9-d0404bc53eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:49.360908 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea72e0-19ea-4aac-b7a9-d0404bc53eea None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:49.361186 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea72e0-19ea-4aac-b7a9-d0404bc53eea None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:49.361458 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea72e0-19ea-4aac-b7a9-d0404bc53eea None admin] PATH_INFO: `/v3/users/8d227930e3184d4ea9f1d98d006fb4fb` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:49.362728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea72e0-19ea-4aac-b7a9-d0404bc53eea None admin] RBAC: Authorizing `identity:get_user(user_id=8d227930e3184d4ea9f1d98d006fb4fb)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:49.364177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea72e0-19ea-4aac-b7a9-d0404bc53eea None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:49.365988 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 553/1082] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:20:49 2022] GET /identity/v3/users/8d227930e3184d4ea9f1d98d006fb4fb => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:49.371853 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b83f6-4ec0-4df6-8d9f-96e03efd9326 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:49.396867 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:49.479519 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b83f6-4ec0-4df6-8d9f-96e03efd9326 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:49.525377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a8c6b-e141-4d05-9df1-e98d1ac1cfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:49.526597 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a8c6b-e141-4d05-9df1-e98d1ac1cfb8 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:49.526963 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a8c6b-e141-4d05-9df1-e98d1ac1cfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:49.527237 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a8c6b-e141-4d05-9df1-e98d1ac1cfb8 None admin] PATH_INFO: `/v3/projects/d2b909fda5e244cabd49830c888ced35` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:49.528349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a8c6b-e141-4d05-9df1-e98d1ac1cfb8 None admin] RBAC: Authorizing `identity:get_project(project_id=d2b909fda5e244cabd49830c888ced35)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:49.529782 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a8c6b-e141-4d05-9df1-e98d1ac1cfb8 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:49.531407 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 530/1083] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:20:49 2022] GET /identity/v3/projects/d2b909fda5e244cabd49830c888ced35 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:49.537568 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea72e0-19ea-4aac-b7a9-d0404bc53eea None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:49.635895 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea72e0-19ea-4aac-b7a9-d0404bc53eea None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:49.664590 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:49.670098 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067ff2b-f865-4473-a991-d9176ebb0efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:49.670756 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067ff2b-f865-4473-a991-d9176ebb0efa None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:49.671034 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067ff2b-f865-4473-a991-d9176ebb0efa None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:49.671306 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067ff2b-f865-4473-a991-d9176ebb0efa None admin] PATH_INFO: `/v3/projects/d2b909fda5e244cabd49830c888ced35/users/8d227930e3184d4ea9f1d98d006fb4fb/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:49.673244 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067ff2b-f865-4473-a991-d9176ebb0efa None admin] RBAC: Authorizing `identity:create_grant(project_id=d2b909fda5e244cabd49830c888ced35, user_id=8d227930e3184d4ea9f1d98d006fb4fb, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:49.674728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067ff2b-f865-4473-a991-d9176ebb0efa None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:49.765059 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 554/1084] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 14:20:49 2022] PUT /identity/v3/projects/d2b909fda5e244cabd49830c888ced35/users/8d227930e3184d4ea9f1d98d006fb4fb/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:20:51.183462 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282ea8f-a7a6-4383-a59f-f1cc377445b9 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:51.184032 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282ea8f-a7a6-4383-a59f-f1cc377445b9 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:51.184032 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282ea8f-a7a6-4383-a59f-f1cc377445b9 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:51.185410 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 531/1085] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:51.190743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048f2dd-0cda-4586-8f96-069d0c66d316 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:51.191144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048f2dd-0cda-4586-8f96-069d0c66d316 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:51.191290 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048f2dd-0cda-4586-8f96-069d0c66d316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:51.209711 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-9048f2dd-0cda-4586-8f96-069d0c66d316 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:51.210928 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9048f2dd-0cda-4586-8f96-069d0c66d316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:51.281084 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 555/1086] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:20:51.548973 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282ea8f-a7a6-4383-a59f-f1cc377445b9 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:51.636868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:51.643757 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256802a1-f274-4f84-9274-fcccef6cd9d6 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:51.644043 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256802a1-f274-4f84-9274-fcccef6cd9d6 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:51.644309 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256802a1-f274-4f84-9274-fcccef6cd9d6 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:51.645802 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 556/1087] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:51.650108 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282ea8f-a7a6-4383-a59f-f1cc377445b9 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:51.650748 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424b0f7-a4bf-477a-b4a0-a3141a5cdbed None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:51.651029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424b0f7-a4bf-477a-b4a0-a3141a5cdbed None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:51.651303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424b0f7-a4bf-477a-b4a0-a3141a5cdbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:51.669225 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-8424b0f7-a4bf-477a-b4a0-a3141a5cdbed None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:51.670430 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8424b0f7-a4bf-477a-b4a0-a3141a5cdbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:51.687093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df29058-14f7-4fd4-aae3-97c90d4ae72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:51.687716 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df29058-14f7-4fd4-aae3-97c90d4ae72c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:51.687998 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df29058-14f7-4fd4-aae3-97c90d4ae72c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:51.688274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df29058-14f7-4fd4-aae3-97c90d4ae72c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:51.698107 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df29058-14f7-4fd4-aae3-97c90d4ae72c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:20:51.702801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-2df29058-14f7-4fd4-aae3-97c90d4ae72c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 14:20:51.702801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:51.702801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:51.702801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:51.702801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:51.702801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:51.702801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:51.702801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:51.702801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:51.702801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:51.702801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:51.702801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:51.702801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:20:51.702801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:20:51.702801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:20:51.702801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:20:51.703935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:20:51.703935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:20:51.703935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:20:51.703935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:20:51.703935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:51.703935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:51.703935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:51.703935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:51.703935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:51.703935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:51.703935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:51.703935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:51.703935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:51.703935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:51.703935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:51.703935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:51.704806 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:51.704806 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:51.704806 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:51.704806 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:51.704806 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:20:51.704806 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:20:51.704806 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:20:51.704806 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:20:51.704806 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:20:51.704806 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:20:51.704806 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 14:20:51.704806 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:51.704806 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 532/1088] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Aug 24 14:20:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:51.709933 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df29058-14f7-4fd4-aae3-97c90d4ae72c None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:51.737495 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 557/1089] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:20:51.808472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df29058-14f7-4fd4-aae3-97c90d4ae72c None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:51.841324 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f60d6-0385-4f16-976d-4c8334d05d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:51.841950 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f60d6-0385-4f16-976d-4c8334d05d5a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:51.842233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f60d6-0385-4f16-976d-4c8334d05d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:51.842509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f60d6-0385-4f16-976d-4c8334d05d5a None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:51.843170 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f60d6-0385-4f16-976d-4c8334d05d5a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:51.843473 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f60d6-0385-4f16-976d-4c8334d05d5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:51.844828 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f60d6-0385-4f16-976d-4c8334d05d5a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:51.852745 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 533/1090] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Aug 24 14:20:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:51.859136 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424b0f7-a4bf-477a-b4a0-a3141a5cdbed None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:51.911026 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:51.956921 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424b0f7-a4bf-477a-b4a0-a3141a5cdbed None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:51.991444 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f5246-0b96-41b5-aa97-88c15bb3d9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:51.992063 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f5246-0b96-41b5-aa97-88c15bb3d9d1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:51.992339 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f5246-0b96-41b5-aa97-88c15bb3d9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:51.992608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f5246-0b96-41b5-aa97-88c15bb3d9d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:52.002655 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f5246-0b96-41b5-aa97-88c15bb3d9d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:52.004119 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f5246-0b96-41b5-aa97-88c15bb3d9d1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:52.005496 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f60d6-0385-4f16-976d-4c8334d05d5a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:52.018610 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:52.018755 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-ea9f5246-0b96-41b5-aa97-88c15bb3d9d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:52.018755 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:52.018755 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:52.018755 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:52.018755 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:52.018755 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:52.018755 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:52.018755 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:52.018755 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:52.018755 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:52.018755 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:52.018755 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:52.018755 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:52.018755 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:52.018755 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:52.018755 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:52.019797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:52.019797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:52.019797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:52.019797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:52.019797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:52.019797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:52.019797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:52.019797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:52.019797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:52.019797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:52.019797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:52.019797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:52.019797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:52.019797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:52.019797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:52.019797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:52.019797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:52.020926 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:52.020926 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:52.020926 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:52.020926 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 558/1091] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:52.026228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f5246-0b96-41b5-aa97-88c15bb3d9d1 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:52.108024 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f60d6-0385-4f16-976d-4c8334d05d5a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:52.125164 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f5246-0b96-41b5-aa97-88c15bb3d9d1 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:52.127714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:52.142159 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24a393-77e5-473b-ad42-e6f08d814296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:52.142775 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24a393-77e5-473b-ad42-e6f08d814296 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:52.143052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24a393-77e5-473b-ad42-e6f08d814296 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:52.143322 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24a393-77e5-473b-ad42-e6f08d814296 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:52.155113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24a393-77e5-473b-ad42-e6f08d814296 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:20:52.159751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-0d24a393-77e5-473b-ad42-e6f08d814296 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:20:52.159751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:52.159751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:52.159751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:52.159751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:52.159751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:52.159751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:52.159751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:52.159751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:52.159751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:52.159751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:52.159751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:52.159751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:20:52.159751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:20:52.159751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:20:52.159751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:20:52.160915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:20:52.160915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:20:52.160915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:20:52.160915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:20:52.160915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:52.160915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:52.160915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:52.160915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:52.160915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:52.160915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:52.160915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:52.160915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:52.160915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:52.160915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:52.160915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:52.160915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:52.162031 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:52.162031 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:52.162031 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:52.162031 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:52.162031 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:20:52.162031 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:20:52.162031 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:20:52.162031 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:20:52.162031 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:20:52.162031 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:20:52.162031 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:20:52.162031 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:52.162929 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2af085-c7b3-4b99-a610-30826e6b2903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:52.163033 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 534/1092] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:20:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:20:52.163117 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2af085-c7b3-4b99-a610-30826e6b2903 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:52.163117 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2af085-c7b3-4b99-a610-30826e6b2903 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:52.163117 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2af085-c7b3-4b99-a610-30826e6b2903 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:52.163349 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2af085-c7b3-4b99-a610-30826e6b2903 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:52.163486 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2af085-c7b3-4b99-a610-30826e6b2903 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:52.165332 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2af085-c7b3-4b99-a610-30826e6b2903 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:52.167008 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24a393-77e5-473b-ad42-e6f08d814296 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:52.177710 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 559/1093] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:52.183538 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2af085-c7b3-4b99-a610-30826e6b2903 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:52.235713 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:52.271000 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24a393-77e5-473b-ad42-e6f08d814296 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:52.288597 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2af085-c7b3-4b99-a610-30826e6b2903 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:52.307096 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bb0ae-77a8-45fb-a6da-472f0b70473e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:52.307694 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bb0ae-77a8-45fb-a6da-472f0b70473e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:52.307976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bb0ae-77a8-45fb-a6da-472f0b70473e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:52.308247 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bb0ae-77a8-45fb-a6da-472f0b70473e None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:52.308904 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bb0ae-77a8-45fb-a6da-472f0b70473e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:52.309205 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bb0ae-77a8-45fb-a6da-472f0b70473e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:52.310590 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bb0ae-77a8-45fb-a6da-472f0b70473e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:52.318479 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 535/1094] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:20:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:52.321658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa371417-87e2-4f29-8b93-e0a0acd7b934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:52.322803 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa371417-87e2-4f29-8b93-e0a0acd7b934 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:52.323085 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa371417-87e2-4f29-8b93-e0a0acd7b934 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:52.323354 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa371417-87e2-4f29-8b93-e0a0acd7b934 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:52.324886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bb0ae-77a8-45fb-a6da-472f0b70473e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:52.331105 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa371417-87e2-4f29-8b93-e0a0acd7b934 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:52.332543 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa371417-87e2-4f29-8b93-e0a0acd7b934 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:52.344095 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-aa371417-87e2-4f29-8b93-e0a0acd7b934 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:20:52.344095 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:52.344095 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:52.344095 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:52.344095 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:52.344095 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:52.344095 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:52.344095 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:52.344095 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:52.344095 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:52.344095 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:52.344095 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:52.344095 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:20:52.344095 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:20:52.344095 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:20:52.344095 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:20:52.345253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:52.345253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:52.345253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:20:52.345253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:52.345253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:20:52.345253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:20:52.345253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:52.345253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:52.345253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:52.345253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:52.345253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:52.345253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:52.345253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:52.345253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:52.345253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:52.345253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:52.345253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:52.345253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:52.346572 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:52.346572 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:52.346572 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:20:52.346572 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:20:52.346572 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:20:52.346572 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:20:52.346572 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:20:52.346572 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:20:52.346572 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:20:52.346572 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:52.346572 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 560/1095] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Aug 24 14:20:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:20:52.350894 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa371417-87e2-4f29-8b93-e0a0acd7b934 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:52.375314 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:52.424992 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bb0ae-77a8-45fb-a6da-472f0b70473e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:52.449379 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa371417-87e2-4f29-8b93-e0a0acd7b934 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:52.455748 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:52.460702 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3743996-0de4-48bb-93ba-6fa9993d0935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:52.461317 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3743996-0de4-48bb-93ba-6fa9993d0935 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:52.461596 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3743996-0de4-48bb-93ba-6fa9993d0935 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:52.467593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3743996-0de4-48bb-93ba-6fa9993d0935 None admin] PATH_INFO: `/v3/users/8d227930e3184d4ea9f1d98d006fb4fb` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:52.467593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3743996-0de4-48bb-93ba-6fa9993d0935 None admin] RBAC: Authorizing `identity:get_user(user_id=8d227930e3184d4ea9f1d98d006fb4fb)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:52.467593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3743996-0de4-48bb-93ba-6fa9993d0935 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:52.467593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 536/1096] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:20:52 2022] GET /identity/v3/users/8d227930e3184d4ea9f1d98d006fb4fb => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:52.472592 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3743996-0de4-48bb-93ba-6fa9993d0935 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:52.483958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a0d4c-49c8-4f55-a89c-55497f8c622d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:52.484557 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a0d4c-49c8-4f55-a89c-55497f8c622d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:52.484833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a0d4c-49c8-4f55-a89c-55497f8c622d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:52.485101 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a0d4c-49c8-4f55-a89c-55497f8c622d None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:52.485853 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a0d4c-49c8-4f55-a89c-55497f8c622d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:52.486160 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a0d4c-49c8-4f55-a89c-55497f8c622d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:52.487603 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a0d4c-49c8-4f55-a89c-55497f8c622d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:52.504567 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 561/1097] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Aug 24 14:20:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:52.510550 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a0d4c-49c8-4f55-a89c-55497f8c622d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:52.578745 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3743996-0de4-48bb-93ba-6fa9993d0935 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:52.589844 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:52.607809 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a0d4c-49c8-4f55-a89c-55497f8c622d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:52.612375 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d27cbe-fa4f-4f39-a86f-88a5bb017f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:52.612976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d27cbe-fa4f-4f39-a86f-88a5bb017f69 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:52.613323 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d27cbe-fa4f-4f39-a86f-88a5bb017f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:52.613600 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d27cbe-fa4f-4f39-a86f-88a5bb017f69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:52.642092 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be655033-6679-4600-8627-2d4788b09df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:52.642910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be655033-6679-4600-8627-2d4788b09df1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:52.643190 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be655033-6679-4600-8627-2d4788b09df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:52.643464 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be655033-6679-4600-8627-2d4788b09df1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:52.685983 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:52.688280 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d27cbe-fa4f-4f39-a86f-88a5bb017f69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:52.689714 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d27cbe-fa4f-4f39-a86f-88a5bb017f69 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:52.711193 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be655033-6679-4600-8627-2d4788b09df1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:52.712654 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be655033-6679-4600-8627-2d4788b09df1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:52.787380 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 537/1098] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:20:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 14:20:52.794060 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d27cbe-fa4f-4f39-a86f-88a5bb017f69 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:52.798042 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:52.816381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 562/1099] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:20:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 14:20:52.822068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be655033-6679-4600-8627-2d4788b09df1 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:52.892178 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:52.895520 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d27cbe-fa4f-4f39-a86f-88a5bb017f69 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:52.918893 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be655033-6679-4600-8627-2d4788b09df1 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:52.929640 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9ad7b-c87e-4c0d-a903-9c1c903d169b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:52.930286 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9ad7b-c87e-4c0d-a903-9c1c903d169b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:52.930560 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9ad7b-c87e-4c0d-a903-9c1c903d169b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:52.930829 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9ad7b-c87e-4c0d-a903-9c1c903d169b None admin] PATH_INFO: `/v3/projects/d2b909fda5e244cabd49830c888ced35` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:52.932190 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9ad7b-c87e-4c0d-a903-9c1c903d169b None admin] RBAC: Authorizing `identity:get_project(project_id=d2b909fda5e244cabd49830c888ced35)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:52.933635 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9ad7b-c87e-4c0d-a903-9c1c903d169b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:52.935282 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 538/1100] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:20:52 2022] GET /identity/v3/projects/d2b909fda5e244cabd49830c888ced35 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:52.941323 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9ad7b-c87e-4c0d-a903-9c1c903d169b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:52.952997 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7b235-8d46-4a11-abc8-4f2d75a6fb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:52.953619 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7b235-8d46-4a11-abc8-4f2d75a6fb2d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:52.953927 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7b235-8d46-4a11-abc8-4f2d75a6fb2d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:52.954200 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7b235-8d46-4a11-abc8-4f2d75a6fb2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:52.971220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b7b235-8d46-4a11-abc8-4f2d75a6fb2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:52.972644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b7b235-8d46-4a11-abc8-4f2d75a6fb2d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:52.987278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-69b7b235-8d46-4a11-abc8-4f2d75a6fb2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:52.987278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:52.987278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:52.987278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:52.987278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:52.987278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:52.987278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:52.987278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:52.987278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:52.987278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:52.987278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:52.987278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:52.987278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:20:52.987278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:20:52.987278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:20:52.987278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:20:52.988357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:52.988357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:52.988357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:52.988357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:52.988357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:52.988357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:52.988357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:52.988357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:52.988357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:52.988357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:52.988357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:52.988357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:52.988357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:52.988357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:52.988357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:52.988357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:52.988357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:20:52.989268 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:20:52.989268 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:20:52.989268 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:20:52.989268 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 563/1101] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:20:52.994065 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7b235-8d46-4a11-abc8-4f2d75a6fb2d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:53.028389 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:53.042938 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9ad7b-c87e-4c0d-a903-9c1c903d169b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:53.076629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e16cd-b801-4fbc-9c95-00d0b196519e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:53.077310 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e16cd-b801-4fbc-9c95-00d0b196519e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:53.077592 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e16cd-b801-4fbc-9c95-00d0b196519e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:53.077900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e16cd-b801-4fbc-9c95-00d0b196519e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:53.078627 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e16cd-b801-4fbc-9c95-00d0b196519e None admin] RBAC: Adding query filter params (role.id=b779073cee3c470ca4ad7a7b27d72c5e, scope.project.id=d2b909fda5e244cabd49830c888ced35, user.id=8d227930e3184d4ea9f1d98d006fb4fb) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:53.078934 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e16cd-b801-4fbc-9c95-00d0b196519e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:53.080359 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e16cd-b801-4fbc-9c95-00d0b196519e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:53.085969 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 539/1102] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:20:52 2022] GET /identity/v3/role_assignments?user.id=8d227930e3184d4ea9f1d98d006fb4fb&scope.project.id=d2b909fda5e244cabd49830c888ced35&role.id=b779073cee3c470ca4ad7a7b27d72c5e => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:53.094094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7b235-8d46-4a11-abc8-4f2d75a6fb2d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:53.130694 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d43a4-90da-4324-ad27-c98204cedb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:53.131315 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d43a4-90da-4324-ad27-c98204cedb14 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:53.131588 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d43a4-90da-4324-ad27-c98204cedb14 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:53.131856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d43a4-90da-4324-ad27-c98204cedb14 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:53.132523 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d43a4-90da-4324-ad27-c98204cedb14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:53.132820 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d43a4-90da-4324-ad27-c98204cedb14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:53.134262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d43a4-90da-4324-ad27-c98204cedb14 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:53.152839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 564/1103] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:20:53.154354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e16cd-b801-4fbc-9c95-00d0b196519e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:53.188189 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:53.263978 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e16cd-b801-4fbc-9c95-00d0b196519e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:53.298744 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82fd01-1077-4cca-af76-0982e81552a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:53.299372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82fd01-1077-4cca-af76-0982e81552a8 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:53.299653 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82fd01-1077-4cca-af76-0982e81552a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:53.299925 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82fd01-1077-4cca-af76-0982e81552a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:53.306570 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82fd01-1077-4cca-af76-0982e81552a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:53.308054 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82fd01-1077-4cca-af76-0982e81552a8 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:53.319160 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-ac82fd01-1077-4cca-af76-0982e81552a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:53.319160 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:20:53.319160 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:20:53.319160 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:20:53.319160 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:20:53.319160 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:20:53.319160 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:20:53.319160 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:20:53.319160 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:20:53.319160 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:20:53.319160 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:20:53.319160 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:20:53.319160 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:20:53.319160 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:20:53.319160 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:20:53.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:20:53.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:20:53.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:20:53.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:20:53.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:20:53.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:20:53.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:20:53.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:20:53.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:20:53.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:20:53.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:20:53.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:20:53.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:20:53.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:20:53.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:20:53.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:20:53.320230 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:20:53.321649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:20:53.321649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:20:53.321649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:20:53.321649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:20:53.321649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:20:53.321649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:20:53.321649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:20:53.321649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:20:53.321649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 540/1104] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:20:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:20:53.326242 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d43a4-90da-4324-ad27-c98204cedb14 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:53.419939 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:53.426324 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d43a4-90da-4324-ad27-c98204cedb14 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:53.460019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71589f5c-199c-4228-9ece-087c424eac9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:53.460621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71589f5c-199c-4228-9ece-087c424eac9e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:53.460896 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71589f5c-199c-4228-9ece-087c424eac9e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:53.461167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71589f5c-199c-4228-9ece-087c424eac9e None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:53.461886 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71589f5c-199c-4228-9ece-087c424eac9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:53.462189 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71589f5c-199c-4228-9ece-087c424eac9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:53.464118 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71589f5c-199c-4228-9ece-087c424eac9e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:53.475356 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 565/1105] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:20:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:53.481926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82fd01-1077-4cca-af76-0982e81552a8 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:53.572669 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:53.581398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82fd01-1077-4cca-af76-0982e81552a8 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:53.615238 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc68de-aa3b-4aa5-b3ea-426966bdc693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:53.615836 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc68de-aa3b-4aa5-b3ea-426966bdc693 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:53.616111 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc68de-aa3b-4aa5-b3ea-426966bdc693 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:53.616377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc68de-aa3b-4aa5-b3ea-426966bdc693 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:53.617091 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdc68de-aa3b-4aa5-b3ea-426966bdc693 None admin] RBAC: Adding query filter params (role.id=89526ad5407b4974a7368c7aa6411cf8, scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e, user.id=8d099678d6454f7eb494892a69feaf62) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:53.617394 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdc68de-aa3b-4aa5-b3ea-426966bdc693 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:53.618842 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdc68de-aa3b-4aa5-b3ea-426966bdc693 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:53.624994 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 541/1106] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:20:53 2022] GET /identity/v3/role_assignments?user.id=8d099678d6454f7eb494892a69feaf62&scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e&role.id=89526ad5407b4974a7368c7aa6411cf8 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:55.024339 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba55fe-a9a6-41bc-8645-436b20629b82 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:55.024896 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba55fe-a9a6-41bc-8645-436b20629b82 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:55.024896 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba55fe-a9a6-41bc-8645-436b20629b82 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:55.026278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 566/1107] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:55.031632 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5ae2a-473d-4f22-bfce-ae72913e4076 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:55.032045 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5ae2a-473d-4f22-bfce-ae72913e4076 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:55.032179 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5ae2a-473d-4f22-bfce-ae72913e4076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:55.051036 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-78a5ae2a-473d-4f22-bfce-ae72913e4076 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:55.052233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-78a5ae2a-473d-4f22-bfce-ae72913e4076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:55.116932 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 542/1108] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:20:55.387614 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba55fe-a9a6-41bc-8645-436b20629b82 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:55.488558 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba55fe-a9a6-41bc-8645-436b20629b82 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:55.523505 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ff12b-9cf8-46cc-a721-33d4ac169808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:55.524367 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ff12b-9cf8-46cc-a721-33d4ac169808 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:55.524640 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ff12b-9cf8-46cc-a721-33d4ac169808 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:55.524905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ff12b-9cf8-46cc-a721-33d4ac169808 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:55.526107 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ff12b-9cf8-46cc-a721-33d4ac169808 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:55.527552 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ff12b-9cf8-46cc-a721-33d4ac169808 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:55.529147 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 567/1109] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:20:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:55.534957 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5ae2a-473d-4f22-bfce-ae72913e4076 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:55.615688 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:55.630939 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5ae2a-473d-4f22-bfce-ae72913e4076 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:55.664032 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15646eb1-dbf6-4e39-9f23-edbc0b9f96a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:55.664554 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15646eb1-dbf6-4e39-9f23-edbc0b9f96a0 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:55.664828 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15646eb1-dbf6-4e39-9f23-edbc0b9f96a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:55.665097 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15646eb1-dbf6-4e39-9f23-edbc0b9f96a0 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:55.665730 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15646eb1-dbf6-4e39-9f23-edbc0b9f96a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:55.667193 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15646eb1-dbf6-4e39-9f23-edbc0b9f96a0 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:55.769899 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 543/1110] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 14:20:55 2022] POST /identity/v3/users => generated 286 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:20:57.680459 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1353d-7c89-44e1-8167-ebb9ed26e21e None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:57.681006 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1353d-7c89-44e1-8167-ebb9ed26e21e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:57.681006 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1353d-7c89-44e1-8167-ebb9ed26e21e None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:57.682953 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 568/1111] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:20:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:20:57.688251 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bce101-b497-4c98-bfe5-f0a0d924bb6b None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:57.688664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bce101-b497-4c98-bfe5-f0a0d924bb6b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:57.688785 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bce101-b497-4c98-bfe5-f0a0d924bb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:57.706812 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-f1bce101-b497-4c98-bfe5-f0a0d924bb6b None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:20:57.707986 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f1bce101-b497-4c98-bfe5-f0a0d924bb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:20:57.772773 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 544/1112] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:20:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:20:58.046196 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1353d-7c89-44e1-8167-ebb9ed26e21e None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:58.070426 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:58.148430 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1353d-7c89-44e1-8167-ebb9ed26e21e None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:58.181439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6db833-488b-40ea-b904-c5aafbc42823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:58.182213 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6db833-488b-40ea-b904-c5aafbc42823 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:58.182495 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6db833-488b-40ea-b904-c5aafbc42823 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:58.182769 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6db833-488b-40ea-b904-c5aafbc42823 None admin] PATH_INFO: `/v3/roles/eb8377ab1ad14341a780bc4acdfa2275` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:58.184162 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6db833-488b-40ea-b904-c5aafbc42823 None admin] RBAC: Authorizing `identity:get_role(role_id=eb8377ab1ad14341a780bc4acdfa2275)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:58.185528 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6db833-488b-40ea-b904-c5aafbc42823 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:58.186876 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 569/1113] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:20:58 2022] GET /identity/v3/roles/eb8377ab1ad14341a780bc4acdfa2275 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:58.192690 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bce101-b497-4c98-bfe5-f0a0d924bb6b None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:58.261867 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:58.291399 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bce101-b497-4c98-bfe5-f0a0d924bb6b None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:58.324700 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be5f6e-8e7b-4213-81d4-4a6fc55f68a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:58.325250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be5f6e-8e7b-4213-81d4-4a6fc55f68a6 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:58.325525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be5f6e-8e7b-4213-81d4-4a6fc55f68a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:58.325818 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be5f6e-8e7b-4213-81d4-4a6fc55f68a6 None admin] PATH_INFO: `/v3/users/2161a1ce85cb4144af04666967592d49` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:58.339274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be5f6e-8e7b-4213-81d4-4a6fc55f68a6 None admin] RBAC: Authorizing `identity:get_user(user_id=2161a1ce85cb4144af04666967592d49)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:58.340691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be5f6e-8e7b-4213-81d4-4a6fc55f68a6 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:58.342325 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 545/1114] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:20:58 2022] GET /identity/v3/users/2161a1ce85cb4144af04666967592d49 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:58.348103 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6db833-488b-40ea-b904-c5aafbc42823 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:58.436430 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:58.445715 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6db833-488b-40ea-b904-c5aafbc42823 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:58.479508 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036eb87-1175-4744-9826-e6ce6977403c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:58.480103 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036eb87-1175-4744-9826-e6ce6977403c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:58.480377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036eb87-1175-4744-9826-e6ce6977403c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:58.480642 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036eb87-1175-4744-9826-e6ce6977403c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:58.547029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036eb87-1175-4744-9826-e6ce6977403c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:58.548453 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036eb87-1175-4744-9826-e6ce6977403c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:58.634663 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:58.644427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 570/1115] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:20:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:20:58.650949 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be5f6e-8e7b-4213-81d4-4a6fc55f68a6 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:58.748789 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be5f6e-8e7b-4213-81d4-4a6fc55f68a6 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:58.777258 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:20:58.782949 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd55a79-c028-42ca-aca9-6d50dff4159f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:58.783570 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd55a79-c028-42ca-aca9-6d50dff4159f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:58.783850 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd55a79-c028-42ca-aca9-6d50dff4159f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:58.784126 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd55a79-c028-42ca-aca9-6d50dff4159f None admin] PATH_INFO: `/v3/projects/d2b909fda5e244cabd49830c888ced35` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:58.785238 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd55a79-c028-42ca-aca9-6d50dff4159f None admin] RBAC: Authorizing `identity:get_project(project_id=d2b909fda5e244cabd49830c888ced35)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:58.786740 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd55a79-c028-42ca-aca9-6d50dff4159f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:58.788362 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 546/1116] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:20:58 2022] GET /identity/v3/projects/d2b909fda5e244cabd49830c888ced35 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:20:58.795182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036eb87-1175-4744-9826-e6ce6977403c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:20:58.931247 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036eb87-1175-4744-9826-e6ce6977403c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:20:58.965432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe94e8-05e2-4493-8760-10cac7ac8906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:20:58.966059 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe94e8-05e2-4493-8760-10cac7ac8906 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:20:58.966340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe94e8-05e2-4493-8760-10cac7ac8906 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:20:58.966613 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe94e8-05e2-4493-8760-10cac7ac8906 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:20:58.967351 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe94e8-05e2-4493-8760-10cac7ac8906 None admin] RBAC: Adding query filter params (role.id=eb8377ab1ad14341a780bc4acdfa2275, scope.project.id=d2b909fda5e244cabd49830c888ced35, user.id=2161a1ce85cb4144af04666967592d49) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:20:58.967661 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe94e8-05e2-4493-8760-10cac7ac8906 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:20:58.969111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe94e8-05e2-4493-8760-10cac7ac8906 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:20:58.974485 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 571/1117] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:20:58 2022] GET /identity/v3/role_assignments?user.id=2161a1ce85cb4144af04666967592d49&scope.project.id=d2b909fda5e244cabd49830c888ced35&role.id=eb8377ab1ad14341a780bc4acdfa2275 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:00.862210 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9a48d-adba-46e7-ac78-ac7ee24298c0 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:00.862788 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9a48d-adba-46e7-ac78-ac7ee24298c0 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:00.862788 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9a48d-adba-46e7-ac78-ac7ee24298c0 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:00.864080 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 547/1118] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:21:00.869708 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f9188-8c79-49b1-87ac-80d868e824ea None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:00.870172 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f9188-8c79-49b1-87ac-80d868e824ea None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:00.870282 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f9188-8c79-49b1-87ac-80d868e824ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:00.888186 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-1c6f9188-8c79-49b1-87ac-80d868e824ea None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:21:00.889361 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1c6f9188-8c79-49b1-87ac-80d868e824ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:21:00.937461 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:00.954141 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 572/1119] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:21:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:21:01.223089 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9a48d-adba-46e7-ac78-ac7ee24298c0 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:01.324417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9a48d-adba-46e7-ac78-ac7ee24298c0 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:01.357018 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adfbc0f-7e39-4046-9ba3-25f721bad873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:01.357625 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfbc0f-7e39-4046-9ba3-25f721bad873 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:01.357927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfbc0f-7e39-4046-9ba3-25f721bad873 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:01.358198 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfbc0f-7e39-4046-9ba3-25f721bad873 None admin] PATH_INFO: `/v3/roles/eb8377ab1ad14341a780bc4acdfa2275` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:01.359569 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adfbc0f-7e39-4046-9ba3-25f721bad873 None admin] RBAC: Authorizing `identity:get_role(role_id=eb8377ab1ad14341a780bc4acdfa2275)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:01.360913 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adfbc0f-7e39-4046-9ba3-25f721bad873 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:01.362242 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 548/1120] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:21:01 2022] GET /identity/v3/roles/eb8377ab1ad14341a780bc4acdfa2275 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:01.368003 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f9188-8c79-49b1-87ac-80d868e824ea None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:01.466944 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f9188-8c79-49b1-87ac-80d868e824ea None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:01.499624 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729fc68-a8f2-4e81-b458-712bdcfcd2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:01.500200 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729fc68-a8f2-4e81-b458-712bdcfcd2b3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:01.500474 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729fc68-a8f2-4e81-b458-712bdcfcd2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:01.500741 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729fc68-a8f2-4e81-b458-712bdcfcd2b3 None admin] PATH_INFO: `/v3/users/2161a1ce85cb4144af04666967592d49` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:01.502120 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729fc68-a8f2-4e81-b458-712bdcfcd2b3 None admin] RBAC: Authorizing `identity:get_user(user_id=2161a1ce85cb4144af04666967592d49)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:01.503633 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729fc68-a8f2-4e81-b458-712bdcfcd2b3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:01.505198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 573/1121] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:21:01 2022] GET /identity/v3/users/2161a1ce85cb4144af04666967592d49 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:01.510946 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adfbc0f-7e39-4046-9ba3-25f721bad873 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:01.574232 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:01.608167 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adfbc0f-7e39-4046-9ba3-25f721bad873 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:01.641642 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e716736-1869-4fa6-a8a7-29d82e70fdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:01.642272 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e716736-1869-4fa6-a8a7-29d82e70fdff None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:01.642549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e716736-1869-4fa6-a8a7-29d82e70fdff None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:01.642820 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e716736-1869-4fa6-a8a7-29d82e70fdff None admin] PATH_INFO: `/v3/projects/d2b909fda5e244cabd49830c888ced35` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:01.643919 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e716736-1869-4fa6-a8a7-29d82e70fdff None admin] RBAC: Authorizing `identity:get_project(project_id=d2b909fda5e244cabd49830c888ced35)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:01.645339 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e716736-1869-4fa6-a8a7-29d82e70fdff None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:01.646964 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 549/1122] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:21:01 2022] GET /identity/v3/projects/d2b909fda5e244cabd49830c888ced35 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:01.653273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729fc68-a8f2-4e81-b458-712bdcfcd2b3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:01.704297 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:01.750040 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729fc68-a8f2-4e81-b458-712bdcfcd2b3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:01.782905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4564d59-2080-4c41-a9ec-4b271b4cf20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:01.783537 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4564d59-2080-4c41-a9ec-4b271b4cf20a None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:01.783811 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4564d59-2080-4c41-a9ec-4b271b4cf20a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:01.784079 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4564d59-2080-4c41-a9ec-4b271b4cf20a None admin] PATH_INFO: `/v3/projects/d2b909fda5e244cabd49830c888ced35/users/2161a1ce85cb4144af04666967592d49/roles/eb8377ab1ad14341a780bc4acdfa2275` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:01.786202 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4564d59-2080-4c41-a9ec-4b271b4cf20a None admin] RBAC: Authorizing `identity:create_grant(project_id=d2b909fda5e244cabd49830c888ced35, user_id=2161a1ce85cb4144af04666967592d49, role_id=eb8377ab1ad14341a780bc4acdfa2275)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:01.787619 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4564d59-2080-4c41-a9ec-4b271b4cf20a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:01.855020 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 574/1123] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 14:21:01 2022] PUT /identity/v3/projects/d2b909fda5e244cabd49830c888ced35/users/2161a1ce85cb4144af04666967592d49/roles/eb8377ab1ad14341a780bc4acdfa2275 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:21:03.745062 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cdef8-5dce-44d2-b848-2db851ff1f8a None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:03.745663 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cdef8-5dce-44d2-b848-2db851ff1f8a None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:03.745663 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cdef8-5dce-44d2-b848-2db851ff1f8a None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:03.746963 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 550/1124] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:21:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:21:03.752426 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6ca0a-165b-4426-9bb7-d6f5d3f28b6c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:03.752804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6ca0a-165b-4426-9bb7-d6f5d3f28b6c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:03.752975 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6ca0a-165b-4426-9bb7-d6f5d3f28b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:03.771617 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-42c6ca0a-165b-4426-9bb7-d6f5d3f28b6c None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:21:03.772805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-42c6ca0a-165b-4426-9bb7-d6f5d3f28b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:21:03.837392 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 575/1125] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:21:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:21:04.109224 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cdef8-5dce-44d2-b848-2db851ff1f8a None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:04.207862 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cdef8-5dce-44d2-b848-2db851ff1f8a None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:04.240691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e773a2-37f4-4f07-aa48-f92870eabd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:04.241297 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e773a2-37f4-4f07-aa48-f92870eabd79 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:04.241574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e773a2-37f4-4f07-aa48-f92870eabd79 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:04.241873 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e773a2-37f4-4f07-aa48-f92870eabd79 None admin] PATH_INFO: `/v3/roles/eb8377ab1ad14341a780bc4acdfa2275` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:04.243234 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e773a2-37f4-4f07-aa48-f92870eabd79 None admin] RBAC: Authorizing `identity:get_role(role_id=eb8377ab1ad14341a780bc4acdfa2275)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:04.245194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e773a2-37f4-4f07-aa48-f92870eabd79 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:04.246516 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 551/1126] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:21:04 2022] GET /identity/v3/roles/eb8377ab1ad14341a780bc4acdfa2275 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:04.252433 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6ca0a-165b-4426-9bb7-d6f5d3f28b6c None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:04.294538 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:04.348560 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6ca0a-165b-4426-9bb7-d6f5d3f28b6c None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:04.383026 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd7e94-5efd-4645-9fb3-30da1ba800ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:04.383571 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd7e94-5efd-4645-9fb3-30da1ba800ea None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:04.383845 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd7e94-5efd-4645-9fb3-30da1ba800ea None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:04.384161 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd7e94-5efd-4645-9fb3-30da1ba800ea None admin] PATH_INFO: `/v3/users/2161a1ce85cb4144af04666967592d49` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:04.385565 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd7e94-5efd-4645-9fb3-30da1ba800ea None admin] RBAC: Authorizing `identity:get_user(user_id=2161a1ce85cb4144af04666967592d49)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:04.387009 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd7e94-5efd-4645-9fb3-30da1ba800ea None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:04.388594 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 576/1127] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:21:04 2022] GET /identity/v3/users/2161a1ce85cb4144af04666967592d49 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:04.394414 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e773a2-37f4-4f07-aa48-f92870eabd79 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:04.397259 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:04.494480 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e773a2-37f4-4f07-aa48-f92870eabd79 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:04.527152 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0a3f3-ada4-4dda-aaab-c098331ff03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:04.527775 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0a3f3-ada4-4dda-aaab-c098331ff03c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:04.528054 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0a3f3-ada4-4dda-aaab-c098331ff03c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:04.528324 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0a3f3-ada4-4dda-aaab-c098331ff03c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:04.592698 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0a3f3-ada4-4dda-aaab-c098331ff03c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:04.594151 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0a3f3-ada4-4dda-aaab-c098331ff03c None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:04.595928 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:04.689135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 552/1128] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:21:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:21:04.694989 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd7e94-5efd-4645-9fb3-30da1ba800ea None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:04.791312 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd7e94-5efd-4645-9fb3-30da1ba800ea None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:04.801652 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:04.824250 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca467dc7-e7f9-40c0-b062-7c9bcf759548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:04.824865 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca467dc7-e7f9-40c0-b062-7c9bcf759548 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:04.825195 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca467dc7-e7f9-40c0-b062-7c9bcf759548 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:04.825474 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca467dc7-e7f9-40c0-b062-7c9bcf759548 None admin] PATH_INFO: `/v3/projects/d2b909fda5e244cabd49830c888ced35` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:04.826614 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca467dc7-e7f9-40c0-b062-7c9bcf759548 None admin] RBAC: Authorizing `identity:get_project(project_id=d2b909fda5e244cabd49830c888ced35)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:04.828030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca467dc7-e7f9-40c0-b062-7c9bcf759548 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:04.829641 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 577/1129] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:21:04 2022] GET /identity/v3/projects/d2b909fda5e244cabd49830c888ced35 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:04.835747 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0a3f3-ada4-4dda-aaab-c098331ff03c None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:04.931819 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0a3f3-ada4-4dda-aaab-c098331ff03c None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:04.933324 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:04.965303 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89da115-ef23-47ee-a1a8-1e60e8ea05d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:04.965856 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89da115-ef23-47ee-a1a8-1e60e8ea05d5 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:04.966135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89da115-ef23-47ee-a1a8-1e60e8ea05d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:04.966404 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89da115-ef23-47ee-a1a8-1e60e8ea05d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:04.967139 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89da115-ef23-47ee-a1a8-1e60e8ea05d5 None admin] RBAC: Adding query filter params (role.id=eb8377ab1ad14341a780bc4acdfa2275, scope.project.id=d2b909fda5e244cabd49830c888ced35, user.id=2161a1ce85cb4144af04666967592d49) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:21:04.967440 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89da115-ef23-47ee-a1a8-1e60e8ea05d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:04.968874 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89da115-ef23-47ee-a1a8-1e60e8ea05d5 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:04.974380 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 553/1130] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:21:04 2022] GET /identity/v3/role_assignments?user.id=2161a1ce85cb4144af04666967592d49&scope.project.id=d2b909fda5e244cabd49830c888ced35&role.id=eb8377ab1ad14341a780bc4acdfa2275 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:06.897635 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c219672-421b-47ed-ba05-4a73a61f7d23 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:06.898229 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c219672-421b-47ed-ba05-4a73a61f7d23 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:06.898229 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c219672-421b-47ed-ba05-4a73a61f7d23 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:06.899565 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 578/1131] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:21:06.905159 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e71c6d-e442-4913-a615-a0ff7a37a7ea None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:06.905561 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e71c6d-e442-4913-a615-a0ff7a37a7ea None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:06.905708 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e71c6d-e442-4913-a615-a0ff7a37a7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:06.924020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-30e71c6d-e442-4913-a615-a0ff7a37a7ea None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:21:06.925205 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-30e71c6d-e442-4913-a615-a0ff7a37a7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:21:06.990023 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 554/1132] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:21:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:21:07.261499 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c219672-421b-47ed-ba05-4a73a61f7d23 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:07.360707 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c219672-421b-47ed-ba05-4a73a61f7d23 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:07.394231 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2a5e5-0cab-41ae-bd4c-8ad1c1141064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:07.394846 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2a5e5-0cab-41ae-bd4c-8ad1c1141064 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:07.395121 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2a5e5-0cab-41ae-bd4c-8ad1c1141064 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:07.395391 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2a5e5-0cab-41ae-bd4c-8ad1c1141064 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:07.396493 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe2a5e5-0cab-41ae-bd4c-8ad1c1141064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:07.397951 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe2a5e5-0cab-41ae-bd4c-8ad1c1141064 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:07.400336 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 579/1133] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:21:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:07.408308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e71c6d-e442-4913-a615-a0ff7a37a7ea None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:07.499679 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:07.505583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e71c6d-e442-4913-a615-a0ff7a37a7ea None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:07.539061 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502f800-c4d3-4301-97d5-68b358c3aa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:07.539672 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502f800-c4d3-4301-97d5-68b358c3aa8b None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:07.540128 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502f800-c4d3-4301-97d5-68b358c3aa8b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:07.541376 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502f800-c4d3-4301-97d5-68b358c3aa8b None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:07.542063 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b502f800-c4d3-4301-97d5-68b358c3aa8b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:07.543805 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b502f800-c4d3-4301-97d5-68b358c3aa8b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:07.637544 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 555/1134] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 14:21:07 2022] POST /identity/v3/projects => generated 311 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:21:09.560238 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2d3c8-af15-4198-9fd0-0c61f58c161a None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:09.560766 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2d3c8-af15-4198-9fd0-0c61f58c161a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:09.560766 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2d3c8-af15-4198-9fd0-0c61f58c161a None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:09.562322 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 580/1135] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:21:09.567668 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d1f45-6bbb-40d3-afbc-840c207cf98a None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:09.568094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d1f45-6bbb-40d3-afbc-840c207cf98a None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:09.568223 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d1f45-6bbb-40d3-afbc-840c207cf98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:09.585960 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-6e9d1f45-6bbb-40d3-afbc-840c207cf98a None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:21:09.587138 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6e9d1f45-6bbb-40d3-afbc-840c207cf98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:21:09.652159 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 556/1136] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:21:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:21:09.920585 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2d3c8-af15-4198-9fd0-0c61f58c161a None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:09.968908 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:10.021697 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2d3c8-af15-4198-9fd0-0c61f58c161a None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:10.054045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1b136-e2d4-41f0-9985-b13934ca5836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:10.054660 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1b136-e2d4-41f0-9985-b13934ca5836 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:10.054933 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1b136-e2d4-41f0-9985-b13934ca5836 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:10.055199 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1b136-e2d4-41f0-9985-b13934ca5836 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:10.056963 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1b136-e2d4-41f0-9985-b13934ca5836 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:10.058425 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1b136-e2d4-41f0-9985-b13934ca5836 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:10.059982 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 581/1137] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:21:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:10.065685 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d1f45-6bbb-40d3-afbc-840c207cf98a None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:10.141247 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:10.161438 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d1f45-6bbb-40d3-afbc-840c207cf98a None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:10.194860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57e61c-f87a-4093-8454-ad26ab96d994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:10.195388 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57e61c-f87a-4093-8454-ad26ab96d994 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:10.195667 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57e61c-f87a-4093-8454-ad26ab96d994 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:10.195936 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57e61c-f87a-4093-8454-ad26ab96d994 None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:10.196567 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57e61c-f87a-4093-8454-ad26ab96d994 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:10.198350 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57e61c-f87a-4093-8454-ad26ab96d994 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:10.278401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 557/1138] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 14:21:10 2022] POST /identity/v3/users => generated 286 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:21:12.216863 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ee958-0cf6-4e94-b588-426dcd79c4dc None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:12.217401 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ee958-0cf6-4e94-b588-426dcd79c4dc None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:12.217401 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ee958-0cf6-4e94-b588-426dcd79c4dc None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:12.218766 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 582/1139] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:21:12.223955 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d4fdb-e4f1-42af-86ef-dac8713137ae None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:12.224323 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d4fdb-e4f1-42af-86ef-dac8713137ae None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:12.224513 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d4fdb-e4f1-42af-86ef-dac8713137ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:12.243091 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-d95d4fdb-e4f1-42af-86ef-dac8713137ae None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:21:12.244495 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d95d4fdb-e4f1-42af-86ef-dac8713137ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:21:12.311584 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 558/1140] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:21:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:21:12.581383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ee958-0cf6-4e94-b588-426dcd79c4dc None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:12.680257 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ee958-0cf6-4e94-b588-426dcd79c4dc None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:12.694297 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:12.713049 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1f322-b2f7-4991-aecc-9b77162f1f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:12.713658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1f322-b2f7-4991-aecc-9b77162f1f46 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:12.713960 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1f322-b2f7-4991-aecc-9b77162f1f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:12.714227 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1f322-b2f7-4991-aecc-9b77162f1f46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:12.723730 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1f322-b2f7-4991-aecc-9b77162f1f46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:21:12.729062 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-47d1f322-b2f7-4991-aecc-9b77162f1f46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:21:12.729062 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:21:12.729062 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:21:12.729062 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:21:12.729062 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:21:12.729062 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:21:12.729062 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:21:12.729062 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:21:12.729062 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:21:12.729062 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:21:12.729062 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:21:12.729062 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:21:12.729062 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:21:12.729062 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:21:12.729062 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:21:12.729062 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:21:12.730112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:21:12.730112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:21:12.730112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:21:12.730112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:21:12.730112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:21:12.730112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:21:12.730112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:21:12.730112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:21:12.730112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:21:12.730112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:21:12.730112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:21:12.730112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:21:12.730112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:21:12.730112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:21:12.730112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:21:12.730112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:21:12.731081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:21:12.731081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:21:12.731081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:21:12.731081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:21:12.731081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:21:12.731081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:21:12.731081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:21:12.731081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:21:12.731081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:21:12.731081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:21:12.731081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:21:12.731081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:21:12.731081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 583/1141] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:21:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:21:12.736360 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d4fdb-e4f1-42af-86ef-dac8713137ae None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:12.795796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:12.831940 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d4fdb-e4f1-42af-86ef-dac8713137ae None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:12.864413 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa44dfb-057b-448d-af7f-d810ac1a94dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:12.865004 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa44dfb-057b-448d-af7f-d810ac1a94dd None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:12.865280 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa44dfb-057b-448d-af7f-d810ac1a94dd None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:12.865548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa44dfb-057b-448d-af7f-d810ac1a94dd None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:12.866232 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa44dfb-057b-448d-af7f-d810ac1a94dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:21:12.866529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa44dfb-057b-448d-af7f-d810ac1a94dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:12.867874 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa44dfb-057b-448d-af7f-d810ac1a94dd None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:12.878776 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 559/1142] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:21:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:12.884682 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1f322-b2f7-4991-aecc-9b77162f1f46 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:12.982309 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1f322-b2f7-4991-aecc-9b77162f1f46 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:13.015654 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c549538-cee9-464e-88d6-07af51aaf20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:13.016263 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c549538-cee9-464e-88d6-07af51aaf20f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:13.016545 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c549538-cee9-464e-88d6-07af51aaf20f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:13.016918 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c549538-cee9-464e-88d6-07af51aaf20f None admin] PATH_INFO: `/v3/users/db3df96c762240eebb7b11e411a97977` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:13.029637 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c549538-cee9-464e-88d6-07af51aaf20f None admin] RBAC: Authorizing `identity:get_user(user_id=db3df96c762240eebb7b11e411a97977)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:13.031097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c549538-cee9-464e-88d6-07af51aaf20f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:13.032697 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 584/1143] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:21:12 2022] GET /identity/v3/users/db3df96c762240eebb7b11e411a97977 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:13.038831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa44dfb-057b-448d-af7f-d810ac1a94dd None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:13.136962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa44dfb-057b-448d-af7f-d810ac1a94dd None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:13.162055 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:13.171022 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c224469-cea8-4aab-a5a0-1e790a785b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:13.171616 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c224469-cea8-4aab-a5a0-1e790a785b11 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:13.171895 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c224469-cea8-4aab-a5a0-1e790a785b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:13.172167 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c224469-cea8-4aab-a5a0-1e790a785b11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:13.236980 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c224469-cea8-4aab-a5a0-1e790a785b11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:13.238436 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c224469-cea8-4aab-a5a0-1e790a785b11 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:13.334218 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 560/1144] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:21:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:21:13.340664 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c549538-cee9-464e-88d6-07af51aaf20f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:13.371320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:13.436926 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c549538-cee9-464e-88d6-07af51aaf20f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:13.471823 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff953a8-5405-4615-b74d-b98a5f9c6561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:13.472437 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff953a8-5405-4615-b74d-b98a5f9c6561 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:13.472714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff953a8-5405-4615-b74d-b98a5f9c6561 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:13.472984 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff953a8-5405-4615-b74d-b98a5f9c6561 None admin] PATH_INFO: `/v3/projects/f96a9801240d4246a78637592e0a0a5b` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:13.474120 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff953a8-5405-4615-b74d-b98a5f9c6561 None admin] RBAC: Authorizing `identity:get_project(project_id=f96a9801240d4246a78637592e0a0a5b)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:13.475552 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff953a8-5405-4615-b74d-b98a5f9c6561 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:13.477153 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 585/1145] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:21:13 2022] GET /identity/v3/projects/f96a9801240d4246a78637592e0a0a5b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:13.483480 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c224469-cea8-4aab-a5a0-1e790a785b11 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:13.510241 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:13.582799 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c224469-cea8-4aab-a5a0-1e790a785b11 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:13.615623 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901201c-52ca-4287-8848-de6ae72fce88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:13.616213 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901201c-52ca-4287-8848-de6ae72fce88 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:13.616489 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901201c-52ca-4287-8848-de6ae72fce88 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:13.616762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901201c-52ca-4287-8848-de6ae72fce88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:13.617484 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f901201c-52ca-4287-8848-de6ae72fce88 None admin] RBAC: Adding query filter params (role.id=b779073cee3c470ca4ad7a7b27d72c5e, scope.project.id=f96a9801240d4246a78637592e0a0a5b, user.id=db3df96c762240eebb7b11e411a97977) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:21:13.617845 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f901201c-52ca-4287-8848-de6ae72fce88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:13.619394 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f901201c-52ca-4287-8848-de6ae72fce88 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:13.624603 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 561/1146] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:21:13 2022] GET /identity/v3/role_assignments?user.id=db3df96c762240eebb7b11e411a97977&scope.project.id=f96a9801240d4246a78637592e0a0a5b&role.id=b779073cee3c470ca4ad7a7b27d72c5e => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:15.510545 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2472ff4-f993-49d6-b477-a02632467811 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:15.511048 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2472ff4-f993-49d6-b477-a02632467811 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:15.511048 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2472ff4-f993-49d6-b477-a02632467811 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:15.512351 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 586/1147] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:21:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:21:15.518293 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4b39b-b790-4d32-9eaf-685f274ab002 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:15.518742 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4b39b-b790-4d32-9eaf-685f274ab002 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:15.518838 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4b39b-b790-4d32-9eaf-685f274ab002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:15.536725 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-b6c4b39b-b790-4d32-9eaf-685f274ab002 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:21:15.537964 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b6c4b39b-b790-4d32-9eaf-685f274ab002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:21:15.605036 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 562/1148] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:21:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:21:15.878286 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2472ff4-f993-49d6-b477-a02632467811 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:15.972660 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:15.976231 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2472ff4-f993-49d6-b477-a02632467811 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:16.008552 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e675c-2314-4693-a3f4-afc70c3c8132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:16.009903 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e675c-2314-4693-a3f4-afc70c3c8132 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:16.010403 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e675c-2314-4693-a3f4-afc70c3c8132 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:16.010982 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e675c-2314-4693-a3f4-afc70c3c8132 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:16.020793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e675c-2314-4693-a3f4-afc70c3c8132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:21:16.025996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-804e675c-2314-4693-a3f4-afc70c3c8132 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:21:16.025996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:21:16.025996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:21:16.025996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:21:16.025996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:21:16.025996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:21:16.025996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:21:16.025996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:21:16.025996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:21:16.025996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:21:16.025996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:21:16.025996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:21:16.025996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:21:16.025996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:21:16.025996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:21:16.025996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:21:16.027111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:21:16.027111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:21:16.027111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:21:16.027111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:21:16.027111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:21:16.027111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:21:16.027111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:21:16.027111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:21:16.027111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:21:16.027111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:21:16.027111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:21:16.027111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:21:16.027111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:21:16.027111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:21:16.027111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:21:16.027111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:21:16.028150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:21:16.028150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:21:16.028150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:21:16.028150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:21:16.028150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:21:16.028150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:21:16.028150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:21:16.028150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:21:16.028150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:21:16.028150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:21:16.028150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:21:16.028150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:21:16.028150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 587/1149] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:21:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:21:16.033128 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4b39b-b790-4d32-9eaf-685f274ab002 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:16.053619 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:16.129015 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4b39b-b790-4d32-9eaf-685f274ab002 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:16.162625 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa0cff-0fa8-4d6a-abfd-f507d5ff195e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:16.163219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa0cff-0fa8-4d6a-abfd-f507d5ff195e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:16.163496 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa0cff-0fa8-4d6a-abfd-f507d5ff195e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:16.163771 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa0cff-0fa8-4d6a-abfd-f507d5ff195e None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:16.164421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa0cff-0fa8-4d6a-abfd-f507d5ff195e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:21:16.164718 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa0cff-0fa8-4d6a-abfd-f507d5ff195e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:16.166263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa0cff-0fa8-4d6a-abfd-f507d5ff195e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:16.174045 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 563/1150] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:21:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:16.179824 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e675c-2314-4693-a3f4-afc70c3c8132 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:16.280123 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e675c-2314-4693-a3f4-afc70c3c8132 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:16.312630 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f7356-efd8-4599-9d89-444001d1136a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:16.313239 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f7356-efd8-4599-9d89-444001d1136a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:16.313514 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f7356-efd8-4599-9d89-444001d1136a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:16.313812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f7356-efd8-4599-9d89-444001d1136a None admin] PATH_INFO: `/v3/users/db3df96c762240eebb7b11e411a97977` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:16.314922 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f7356-efd8-4599-9d89-444001d1136a None admin] RBAC: Authorizing `identity:get_user(user_id=db3df96c762240eebb7b11e411a97977)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:16.316346 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f7356-efd8-4599-9d89-444001d1136a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:16.317937 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 588/1151] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:21:16 2022] GET /identity/v3/users/db3df96c762240eebb7b11e411a97977 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:16.324465 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa0cff-0fa8-4d6a-abfd-f507d5ff195e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:16.403861 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:16.420922 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa0cff-0fa8-4d6a-abfd-f507d5ff195e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:16.455471 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c0e91-6b4f-4154-bd8a-6edb5195a2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:16.456080 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c0e91-6b4f-4154-bd8a-6edb5195a2b7 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:16.456358 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c0e91-6b4f-4154-bd8a-6edb5195a2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:16.456631 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c0e91-6b4f-4154-bd8a-6edb5195a2b7 None admin] PATH_INFO: `/v3/projects/f96a9801240d4246a78637592e0a0a5b` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:16.457725 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c0e91-6b4f-4154-bd8a-6edb5195a2b7 None admin] RBAC: Authorizing `identity:get_project(project_id=f96a9801240d4246a78637592e0a0a5b)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:16.459171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c0e91-6b4f-4154-bd8a-6edb5195a2b7 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:16.460776 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 564/1152] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:21:16 2022] GET /identity/v3/projects/f96a9801240d4246a78637592e0a0a5b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:16.466795 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f7356-efd8-4599-9d89-444001d1136a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:16.495604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:16.564605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f7356-efd8-4599-9d89-444001d1136a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:16.596830 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89daca75-72ae-4e64-8e54-0f178d416839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:16.597466 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89daca75-72ae-4e64-8e54-0f178d416839 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:16.597740 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89daca75-72ae-4e64-8e54-0f178d416839 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:16.598037 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89daca75-72ae-4e64-8e54-0f178d416839 None admin] PATH_INFO: `/v3/projects/f96a9801240d4246a78637592e0a0a5b/users/db3df96c762240eebb7b11e411a97977/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:16.599885 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89daca75-72ae-4e64-8e54-0f178d416839 None admin] RBAC: Authorizing `identity:create_grant(project_id=f96a9801240d4246a78637592e0a0a5b, user_id=db3df96c762240eebb7b11e411a97977, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:16.601304 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89daca75-72ae-4e64-8e54-0f178d416839 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:16.688021 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 589/1153] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 14:21:16 2022] PUT /identity/v3/projects/f96a9801240d4246a78637592e0a0a5b/users/db3df96c762240eebb7b11e411a97977/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:21:18.563540 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9ac20-ab57-44fc-b02a-e183472fdaab None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:18.564064 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9ac20-ab57-44fc-b02a-e183472fdaab None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:18.564064 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9ac20-ab57-44fc-b02a-e183472fdaab None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:18.565533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 565/1154] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:21:18.571411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a51c2a-000b-42c2-8173-f734079c7109 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:18.572000 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a51c2a-000b-42c2-8173-f734079c7109 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:18.572000 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a51c2a-000b-42c2-8173-f734079c7109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:18.589949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-91a51c2a-000b-42c2-8173-f734079c7109 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:21:18.591140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-91a51c2a-000b-42c2-8173-f734079c7109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:21:18.655052 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 590/1155] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:21:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:21:18.920824 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9ac20-ab57-44fc-b02a-e183472fdaab None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:19.018303 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9ac20-ab57-44fc-b02a-e183472fdaab None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:19.050867 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab37b8-314a-4107-8f95-36b6e30f53c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:19.051467 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab37b8-314a-4107-8f95-36b6e30f53c2 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:19.051741 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab37b8-314a-4107-8f95-36b6e30f53c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:19.052010 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab37b8-314a-4107-8f95-36b6e30f53c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:19.062205 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab37b8-314a-4107-8f95-36b6e30f53c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:21:19.066810 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-1bab37b8-314a-4107-8f95-36b6e30f53c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:21:19.066810 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:21:19.066810 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:21:19.066810 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:21:19.066810 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:21:19.066810 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:21:19.066810 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:21:19.066810 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:21:19.066810 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:21:19.066810 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:21:19.066810 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:21:19.066810 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:21:19.066810 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:21:19.066810 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:21:19.066810 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:21:19.066810 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:21:19.067909 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:21:19.067909 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:21:19.067909 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:21:19.067909 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:21:19.067909 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:21:19.067909 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:21:19.067909 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:21:19.067909 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:21:19.067909 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:21:19.067909 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:21:19.067909 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:21:19.067909 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:21:19.067909 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:21:19.067909 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:21:19.067909 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:21:19.067909 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:21:19.068760 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:21:19.068760 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:21:19.068760 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:21:19.068760 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:21:19.068760 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:21:19.068760 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:21:19.068760 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:21:19.068760 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:21:19.068760 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:21:19.068760 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:21:19.068760 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:21:19.068760 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:21:19.068760 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 566/1156] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:21:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:21:19.074407 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a51c2a-000b-42c2-8173-f734079c7109 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:19.092831 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:19.172035 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a51c2a-000b-42c2-8173-f734079c7109 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:19.204994 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f898bb3-7f5e-4165-b079-b45c5d8e8931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:19.205581 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f898bb3-7f5e-4165-b079-b45c5d8e8931 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:19.205889 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f898bb3-7f5e-4165-b079-b45c5d8e8931 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:19.206177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f898bb3-7f5e-4165-b079-b45c5d8e8931 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:19.206819 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f898bb3-7f5e-4165-b079-b45c5d8e8931 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:21:19.207123 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f898bb3-7f5e-4165-b079-b45c5d8e8931 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:19.208485 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f898bb3-7f5e-4165-b079-b45c5d8e8931 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:19.216295 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 591/1157] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:21:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:19.222110 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab37b8-314a-4107-8f95-36b6e30f53c2 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:19.235247 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:19.321812 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab37b8-314a-4107-8f95-36b6e30f53c2 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:19.354516 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36128f-ab57-427f-bde4-83973d3e41ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:19.355124 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36128f-ab57-427f-bde4-83973d3e41ff None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:19.355402 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36128f-ab57-427f-bde4-83973d3e41ff None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:19.355673 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36128f-ab57-427f-bde4-83973d3e41ff None admin] PATH_INFO: `/v3/users/db3df96c762240eebb7b11e411a97977` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:19.356782 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36128f-ab57-427f-bde4-83973d3e41ff None admin] RBAC: Authorizing `identity:get_user(user_id=db3df96c762240eebb7b11e411a97977)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:19.358226 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36128f-ab57-427f-bde4-83973d3e41ff None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:19.359796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 567/1158] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:21:19 2022] GET /identity/v3/users/db3df96c762240eebb7b11e411a97977 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:19.365688 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f898bb3-7f5e-4165-b079-b45c5d8e8931 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:19.445604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:19.464390 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f898bb3-7f5e-4165-b079-b45c5d8e8931 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:19.496768 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3189968-598d-4b16-a16b-43be86d16220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:19.497360 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3189968-598d-4b16-a16b-43be86d16220 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:19.497637 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3189968-598d-4b16-a16b-43be86d16220 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:19.497936 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3189968-598d-4b16-a16b-43be86d16220 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:19.564336 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3189968-598d-4b16-a16b-43be86d16220 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:19.565793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3189968-598d-4b16-a16b-43be86d16220 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:19.641777 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:19.660170 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 592/1159] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:21:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:21:19.666541 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36128f-ab57-427f-bde4-83973d3e41ff None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:19.742831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:19.765200 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36128f-ab57-427f-bde4-83973d3e41ff None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:19.797561 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0f489-6098-42f0-8298-52a2785dc6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:19.798204 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0f489-6098-42f0-8298-52a2785dc6a7 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:19.798482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0f489-6098-42f0-8298-52a2785dc6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:19.798754 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0f489-6098-42f0-8298-52a2785dc6a7 None admin] PATH_INFO: `/v3/projects/f96a9801240d4246a78637592e0a0a5b` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:19.799859 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0f489-6098-42f0-8298-52a2785dc6a7 None admin] RBAC: Authorizing `identity:get_project(project_id=f96a9801240d4246a78637592e0a0a5b)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:19.801271 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0f489-6098-42f0-8298-52a2785dc6a7 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:19.802915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 568/1160] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:21:19 2022] GET /identity/v3/projects/f96a9801240d4246a78637592e0a0a5b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:19.809744 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3189968-598d-4b16-a16b-43be86d16220 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:19.904972 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3189968-598d-4b16-a16b-43be86d16220 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:19.938327 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285b09f-e3bb-437a-8a8c-171c0964b950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:19.938916 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285b09f-e3bb-437a-8a8c-171c0964b950 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:19.939193 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285b09f-e3bb-437a-8a8c-171c0964b950 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:19.939464 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285b09f-e3bb-437a-8a8c-171c0964b950 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:19.940183 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285b09f-e3bb-437a-8a8c-171c0964b950 None admin] RBAC: Adding query filter params (role.id=b779073cee3c470ca4ad7a7b27d72c5e, scope.project.id=f96a9801240d4246a78637592e0a0a5b, user.id=db3df96c762240eebb7b11e411a97977) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:21:19.940486 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285b09f-e3bb-437a-8a8c-171c0964b950 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:19.941939 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285b09f-e3bb-437a-8a8c-171c0964b950 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:19.947581 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 593/1161] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:21:19 2022] GET /identity/v3/role_assignments?user.id=db3df96c762240eebb7b11e411a97977&scope.project.id=f96a9801240d4246a78637592e0a0a5b&role.id=b779073cee3c470ca4ad7a7b27d72c5e => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:21.953842 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493132e-e56a-4f84-b720-da3d01bdd5f8 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:21.954369 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493132e-e56a-4f84-b720-da3d01bdd5f8 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:21.954369 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493132e-e56a-4f84-b720-da3d01bdd5f8 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:21.955718 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 569/1162] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:21:21.960915 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae3edb-b348-4e5f-8a69-ded763e44a0c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:21.961323 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae3edb-b348-4e5f-8a69-ded763e44a0c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:21.961453 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae3edb-b348-4e5f-8a69-ded763e44a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:21.979490 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-07ae3edb-b348-4e5f-8a69-ded763e44a0c None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:21:21.980663 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-07ae3edb-b348-4e5f-8a69-ded763e44a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:21:22.019271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:22.044546 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 594/1163] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:21:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:21:22.315938 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493132e-e56a-4f84-b720-da3d01bdd5f8 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:22.414508 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493132e-e56a-4f84-b720-da3d01bdd5f8 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:22.447063 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489e613-0a8f-454e-94b6-c30715c34c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:22.447662 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489e613-0a8f-454e-94b6-c30715c34c6c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:22.447943 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489e613-0a8f-454e-94b6-c30715c34c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:22.448217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489e613-0a8f-454e-94b6-c30715c34c6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:22.462747 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:22.514838 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489e613-0a8f-454e-94b6-c30715c34c6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:22.516188 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489e613-0a8f-454e-94b6-c30715c34c6c None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:22.611415 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 570/1164] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:21:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:21:22.617276 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae3edb-b348-4e5f-8a69-ded763e44a0c None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:22.712313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae3edb-b348-4e5f-8a69-ded763e44a0c None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:22.745457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9960d-e0f9-4ca2-b0a6-cdaca07d9224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:22.746094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9960d-e0f9-4ca2-b0a6-cdaca07d9224 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:22.746369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9960d-e0f9-4ca2-b0a6-cdaca07d9224 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:22.746633 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9960d-e0f9-4ca2-b0a6-cdaca07d9224 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:22.753310 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9960d-e0f9-4ca2-b0a6-cdaca07d9224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:22.754748 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9960d-e0f9-4ca2-b0a6-cdaca07d9224 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:22.765962 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-8bd9960d-e0f9-4ca2-b0a6-cdaca07d9224 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 14:21:22.765962 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:21:22.765962 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 14:21:22.765962 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 14:21:22.765962 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:21:22.765962 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:21:22.765962 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:21:22.765962 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:21:22.765962 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 14:21:22.765962 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:21:22.765962 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:21:22.765962 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:21:22.765962 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:21:22.765962 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:21:22.765962 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:21:22.765962 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:21:22.765962 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:21:22.767201 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:21:22.767201 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:21:22.767201 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:21:22.767201 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:21:22.767201 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:21:22.767201 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:21:22.767201 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:21:22.767201 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:21:22.767201 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:21:22.767201 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:21:22.767201 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:21:22.767201 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:21:22.767201 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:21:22.767201 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:21:22.767201 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:21:22.767201 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:21:22.768307 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:21:22.768307 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:21:22.768307 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:21:22.768307 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:21:22.768307 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:21:22.768307 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:21:22.768307 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:21:22.768307 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:21:22.768307 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:21:22.768307 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:21:22.768307 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 14:21:22.768307 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:21:22.768307 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 14:21:22.768307 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:21:22.768307 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 595/1165] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Aug 24 14:21:22 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:21:22.772821 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489e613-0a8f-454e-94b6-c30715c34c6c None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:22.818664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:22.870540 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489e613-0a8f-454e-94b6-c30715c34c6c None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:22.903545 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191e1a5-243c-4709-8834-2acb82623913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:22.904142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191e1a5-243c-4709-8834-2acb82623913 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:22.904421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191e1a5-243c-4709-8834-2acb82623913 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:22.904694 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191e1a5-243c-4709-8834-2acb82623913 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:22.905328 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191e1a5-243c-4709-8834-2acb82623913 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:21:22.905629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191e1a5-243c-4709-8834-2acb82623913 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:22.907025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191e1a5-243c-4709-8834-2acb82623913 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:22.913884 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 571/1166] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Aug 24 14:21:22 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:24.795082 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b005680-fd99-4b42-9367-87c25d441d30 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:24.795613 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b005680-fd99-4b42-9367-87c25d441d30 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:24.795613 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b005680-fd99-4b42-9367-87c25d441d30 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:24.796942 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 596/1167] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:21:24.802150 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb60d2-72a3-40fd-832f-034387d31246 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:24.802552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb60d2-72a3-40fd-832f-034387d31246 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:24.802707 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb60d2-72a3-40fd-832f-034387d31246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:24.820439 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-2fdb60d2-72a3-40fd-832f-034387d31246 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:21:24.821710 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2fdb60d2-72a3-40fd-832f-034387d31246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:21:24.887368 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 572/1168] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:21:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:21:25.153109 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b005680-fd99-4b42-9367-87c25d441d30 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:25.186743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:25.250248 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b005680-fd99-4b42-9367-87c25d441d30 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:25.286132 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03054ead-c7e7-410b-92fd-b8075baaf93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:25.286720 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03054ead-c7e7-410b-92fd-b8075baaf93d None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:25.286993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03054ead-c7e7-410b-92fd-b8075baaf93d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:25.287254 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03054ead-c7e7-410b-92fd-b8075baaf93d None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:25.287891 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03054ead-c7e7-410b-92fd-b8075baaf93d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:25.289241 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03054ead-c7e7-410b-92fd-b8075baaf93d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:25.381205 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 597/1169] 10.222.0.65 () {60 vars in 1138 bytes} [Wed Aug 24 14:21:25 2022] POST /identity/v3/domains => generated 267 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:21:27.311308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eccfc6-4480-4e3b-b280-9c1f2610b870 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:27.311814 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eccfc6-4480-4e3b-b280-9c1f2610b870 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:27.311929 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eccfc6-4480-4e3b-b280-9c1f2610b870 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:27.313191 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 573/1170] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:21:27.318569 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f9e1d-7250-4597-a642-20a745be8378 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:27.319008 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f9e1d-7250-4597-a642-20a745be8378 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:27.319141 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f9e1d-7250-4597-a642-20a745be8378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:27.337242 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-7a3f9e1d-7250-4597-a642-20a745be8378 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:21:27.338451 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7a3f9e1d-7250-4597-a642-20a745be8378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:21:27.403486 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 598/1171] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:21:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:21:27.674007 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eccfc6-4480-4e3b-b280-9c1f2610b870 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:27.717586 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:27.775344 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eccfc6-4480-4e3b-b280-9c1f2610b870 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:27.808093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14872d18-908f-45fb-a299-03c5b0b892f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:27.808707 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14872d18-908f-45fb-a299-03c5b0b892f3 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:27.808986 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14872d18-908f-45fb-a299-03c5b0b892f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:27.809259 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14872d18-908f-45fb-a299-03c5b0b892f3 None admin] PATH_INFO: `/v3/domains/c61417c668244255a757d7f848082955` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:27.819233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14872d18-908f-45fb-a299-03c5b0b892f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c61417c668244255a757d7f848082955)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:27.820663 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14872d18-908f-45fb-a299-03c5b0b892f3 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:27.822388 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 574/1172] 10.222.0.65 () {56 vars in 1183 bytes} [Wed Aug 24 14:21:27 2022] GET /identity/v3/domains/c61417c668244255a757d7f848082955 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:27.828278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f9e1d-7250-4597-a642-20a745be8378 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:27.852918 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:27.925908 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f9e1d-7250-4597-a642-20a745be8378 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:27.957545 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06410bc9-f833-483d-a8d2-d055fcbfb0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:27.958167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06410bc9-f833-483d-a8d2-d055fcbfb0bd None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:27.958443 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06410bc9-f833-483d-a8d2-d055fcbfb0bd None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:27.958713 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06410bc9-f833-483d-a8d2-d055fcbfb0bd None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:27.959341 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06410bc9-f833-483d-a8d2-d055fcbfb0bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:27.960793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06410bc9-f833-483d-a8d2-d055fcbfb0bd None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:28.036199 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 599/1173] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 14:21:27 2022] POST /identity/v3/projects => generated 361 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:21:29.977856 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c363a6-db48-462f-a03d-64e2a88772f1 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:29.978415 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c363a6-db48-462f-a03d-64e2a88772f1 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:29.978561 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c363a6-db48-462f-a03d-64e2a88772f1 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:29.979911 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 575/1174] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:21:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:21:29.985019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a505d-8a76-4f4c-8d9a-9a5bacd2996d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:29.985443 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a505d-8a76-4f4c-8d9a-9a5bacd2996d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:29.985552 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a505d-8a76-4f4c-8d9a-9a5bacd2996d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:30.004122 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-344a505d-8a76-4f4c-8d9a-9a5bacd2996d None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:21:30.005302 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-344a505d-8a76-4f4c-8d9a-9a5bacd2996d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:21:30.070164 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 600/1175] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:21:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:21:30.343642 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c363a6-db48-462f-a03d-64e2a88772f1 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:30.439346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:30.443079 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c363a6-db48-462f-a03d-64e2a88772f1 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:30.475464 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c091ab-9eb0-499e-b902-eb213970c683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:30.476071 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c091ab-9eb0-499e-b902-eb213970c683 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:30.476349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c091ab-9eb0-499e-b902-eb213970c683 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:30.476618 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c091ab-9eb0-499e-b902-eb213970c683 None admin] PATH_INFO: `/v3/domains/c61417c668244255a757d7f848082955` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:30.478340 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c091ab-9eb0-499e-b902-eb213970c683 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c61417c668244255a757d7f848082955)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:30.479748 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c091ab-9eb0-499e-b902-eb213970c683 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:30.481294 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 576/1176] 10.222.0.65 () {56 vars in 1183 bytes} [Wed Aug 24 14:21:30 2022] GET /identity/v3/domains/c61417c668244255a757d7f848082955 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:30.487054 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a505d-8a76-4f4c-8d9a-9a5bacd2996d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:30.496438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:30.585808 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a505d-8a76-4f4c-8d9a-9a5bacd2996d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:30.619547 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c348b85-ba1a-4095-8c9e-e7a5bd478e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:30.620137 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c348b85-ba1a-4095-8c9e-e7a5bd478e9f None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:30.620476 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c348b85-ba1a-4095-8c9e-e7a5bd478e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:30.620753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c348b85-ba1a-4095-8c9e-e7a5bd478e9f None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:30.621399 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c348b85-ba1a-4095-8c9e-e7a5bd478e9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:30.622860 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c348b85-ba1a-4095-8c9e-e7a5bd478e9f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:30.740752 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 601/1177] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 14:21:30 2022] POST /identity/v3/users => generated 311 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:21:32.698511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468ca0f-aaa9-445b-84af-bdb66b118586 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:32.699088 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468ca0f-aaa9-445b-84af-bdb66b118586 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:32.699088 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468ca0f-aaa9-445b-84af-bdb66b118586 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:32.700353 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 577/1178] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:21:32.705655 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84563170-28f4-44a9-8a8c-af06589e02c9 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:32.706140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84563170-28f4-44a9-8a8c-af06589e02c9 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:32.706241 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84563170-28f4-44a9-8a8c-af06589e02c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:32.724581 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-84563170-28f4-44a9-8a8c-af06589e02c9 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:21:32.725792 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-84563170-28f4-44a9-8a8c-af06589e02c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:21:32.780583 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:32.790533 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 602/1179] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:21:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:21:33.057551 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468ca0f-aaa9-445b-84af-bdb66b118586 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:33.156696 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468ca0f-aaa9-445b-84af-bdb66b118586 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:33.189487 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaa91e-80ac-4090-ba2c-2683912ae878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:33.190126 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaa91e-80ac-4090-ba2c-2683912ae878 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:33.190409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaa91e-80ac-4090-ba2c-2683912ae878 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:33.190683 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaa91e-80ac-4090-ba2c-2683912ae878 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:33.200565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beaa91e-80ac-4090-ba2c-2683912ae878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:21:33.205173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-8beaa91e-80ac-4090-ba2c-2683912ae878 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:21:33.205173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:21:33.205173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:21:33.205173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:21:33.205173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:21:33.205173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:21:33.205173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:21:33.205173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:21:33.205173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:21:33.205173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:21:33.205173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:21:33.205173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:21:33.205173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:21:33.205173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:21:33.205173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:21:33.205173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:21:33.206398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:21:33.206398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:21:33.206398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:21:33.206398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:21:33.206398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:21:33.206398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:21:33.206398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:21:33.206398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:21:33.206398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:21:33.206398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:21:33.206398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:21:33.206398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:21:33.206398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:21:33.206398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:21:33.206398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:21:33.206398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:21:33.207529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:21:33.207529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:21:33.207529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:21:33.207529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:21:33.207529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:21:33.207529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:21:33.207529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:21:33.207529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:21:33.207529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:21:33.207529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:21:33.207529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:21:33.207529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:21:33.207529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 578/1180] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:21:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:21:33.213014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84563170-28f4-44a9-8a8c-af06589e02c9 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:33.309006 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84563170-28f4-44a9-8a8c-af06589e02c9 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:33.342387 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cb417-14cd-4cd2-ac32-bd6758d95b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:33.342983 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cb417-14cd-4cd2-ac32-bd6758d95b03 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:33.343259 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cb417-14cd-4cd2-ac32-bd6758d95b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:33.343549 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cb417-14cd-4cd2-ac32-bd6758d95b03 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:33.344209 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873cb417-14cd-4cd2-ac32-bd6758d95b03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:21:33.344507 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873cb417-14cd-4cd2-ac32-bd6758d95b03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:33.345902 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873cb417-14cd-4cd2-ac32-bd6758d95b03 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:33.354086 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 603/1181] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:21:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:33.359953 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaa91e-80ac-4090-ba2c-2683912ae878 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:33.388198 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:33.457578 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaa91e-80ac-4090-ba2c-2683912ae878 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:33.491247 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4452e7-1ade-4e06-a9d7-62bc639d5878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:33.491863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4452e7-1ade-4e06-a9d7-62bc639d5878 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:33.492174 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4452e7-1ade-4e06-a9d7-62bc639d5878 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:33.492452 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4452e7-1ade-4e06-a9d7-62bc639d5878 None admin] PATH_INFO: `/v3/users/982c63d236ae4e98aeae40d584589957` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:33.505496 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4452e7-1ade-4e06-a9d7-62bc639d5878 None admin] RBAC: Authorizing `identity:get_user(user_id=982c63d236ae4e98aeae40d584589957)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:33.506953 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4452e7-1ade-4e06-a9d7-62bc639d5878 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:33.509067 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 579/1182] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:21:33 2022] GET /identity/v3/users/982c63d236ae4e98aeae40d584589957 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:33.515131 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cb417-14cd-4cd2-ac32-bd6758d95b03 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:33.569803 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:33.612884 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cb417-14cd-4cd2-ac32-bd6758d95b03 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:33.645609 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af79398-2e90-4ea0-a31e-b604e1c2310c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:33.646226 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af79398-2e90-4ea0-a31e-b604e1c2310c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:33.646499 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af79398-2e90-4ea0-a31e-b604e1c2310c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:33.646765 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af79398-2e90-4ea0-a31e-b604e1c2310c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:33.711585 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af79398-2e90-4ea0-a31e-b604e1c2310c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:33.713005 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af79398-2e90-4ea0-a31e-b604e1c2310c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:33.764286 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:33.808085 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 604/1183] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:21:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:21:33.814054 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4452e7-1ade-4e06-a9d7-62bc639d5878 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:33.896104 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:33.910808 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4452e7-1ade-4e06-a9d7-62bc639d5878 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:33.944896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab72da3-9b2b-4e40-ae47-eff0c0ca015d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:33.945538 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab72da3-9b2b-4e40-ae47-eff0c0ca015d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:33.945910 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab72da3-9b2b-4e40-ae47-eff0c0ca015d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:33.946192 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab72da3-9b2b-4e40-ae47-eff0c0ca015d None admin] PATH_INFO: `/v3/projects/168f254997ae48f2b6b6a783156a2aee` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:33.947305 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab72da3-9b2b-4e40-ae47-eff0c0ca015d None admin] RBAC: Authorizing `identity:get_project(project_id=168f254997ae48f2b6b6a783156a2aee)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:33.948717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab72da3-9b2b-4e40-ae47-eff0c0ca015d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:33.950504 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 580/1184] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:21:33 2022] GET /identity/v3/projects/168f254997ae48f2b6b6a783156a2aee => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:33.956521 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af79398-2e90-4ea0-a31e-b604e1c2310c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:34.053006 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af79398-2e90-4ea0-a31e-b604e1c2310c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:34.085251 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714517fd-b8b5-4dfe-8440-2ad6b3a4a90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:34.085862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714517fd-b8b5-4dfe-8440-2ad6b3a4a90b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:34.086681 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714517fd-b8b5-4dfe-8440-2ad6b3a4a90b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:34.087139 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714517fd-b8b5-4dfe-8440-2ad6b3a4a90b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:34.087897 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714517fd-b8b5-4dfe-8440-2ad6b3a4a90b None admin] RBAC: Adding query filter params (role.id=b779073cee3c470ca4ad7a7b27d72c5e, scope.project.id=168f254997ae48f2b6b6a783156a2aee, user.id=982c63d236ae4e98aeae40d584589957) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:21:34.088202 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714517fd-b8b5-4dfe-8440-2ad6b3a4a90b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:34.089606 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714517fd-b8b5-4dfe-8440-2ad6b3a4a90b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:34.094818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 605/1185] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:21:33 2022] GET /identity/v3/role_assignments?user.id=982c63d236ae4e98aeae40d584589957&scope.project.id=168f254997ae48f2b6b6a783156a2aee&role.id=b779073cee3c470ca4ad7a7b27d72c5e => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:35.964461 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ffbee-4691-45e0-b8a6-5a72568f2e4a None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:35.965020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ffbee-4691-45e0-b8a6-5a72568f2e4a None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:35.965020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ffbee-4691-45e0-b8a6-5a72568f2e4a None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:35.966372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 581/1186] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:21:35.971483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc3bf6-05cf-48ec-b7b4-727aecd64115 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:35.971859 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc3bf6-05cf-48ec-b7b4-727aecd64115 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:35.972120 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc3bf6-05cf-48ec-b7b4-727aecd64115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:35.990340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-0fbc3bf6-05cf-48ec-b7b4-727aecd64115 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:21:35.991510 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0fbc3bf6-05cf-48ec-b7b4-727aecd64115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:21:36.005305 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:36.057190 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 606/1187] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:21:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:21:36.323744 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ffbee-4691-45e0-b8a6-5a72568f2e4a None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:36.423405 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ffbee-4691-45e0-b8a6-5a72568f2e4a None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:36.456297 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af7887-03ad-4b57-8783-a7a7d5935d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:36.456899 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af7887-03ad-4b57-8783-a7a7d5935d04 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:36.457176 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af7887-03ad-4b57-8783-a7a7d5935d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:36.457445 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af7887-03ad-4b57-8783-a7a7d5935d04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:36.467809 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af7887-03ad-4b57-8783-a7a7d5935d04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:21:36.472387 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-b0af7887-03ad-4b57-8783-a7a7d5935d04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:21:36.472387 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:21:36.472387 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:21:36.472387 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:21:36.472387 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:21:36.472387 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:21:36.472387 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:21:36.472387 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:21:36.472387 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:21:36.472387 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:21:36.472387 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:21:36.472387 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:21:36.472387 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:21:36.472387 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:21:36.472387 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:21:36.472387 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:21:36.473485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:21:36.473485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:21:36.473485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:21:36.473485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:21:36.473485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:21:36.473485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:21:36.473485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:21:36.473485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:21:36.473485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:21:36.473485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:21:36.473485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:21:36.473485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:21:36.473485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:21:36.473485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:21:36.473485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:21:36.473485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:21:36.474530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:21:36.474530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:21:36.474530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:21:36.474530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:21:36.474530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:21:36.474530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:21:36.474530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:21:36.474530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:21:36.474530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:21:36.474530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:21:36.474530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:21:36.474530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:21:36.474530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 582/1188] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:21:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:21:36.479464 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc3bf6-05cf-48ec-b7b4-727aecd64115 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:36.575729 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc3bf6-05cf-48ec-b7b4-727aecd64115 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:36.610219 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673bb5c-0799-42d3-b5f8-28c14ca85afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:36.610817 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673bb5c-0799-42d3-b5f8-28c14ca85afa None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:36.611097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673bb5c-0799-42d3-b5f8-28c14ca85afa None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:36.611370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673bb5c-0799-42d3-b5f8-28c14ca85afa None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:36.612034 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8673bb5c-0799-42d3-b5f8-28c14ca85afa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:21:36.612338 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8673bb5c-0799-42d3-b5f8-28c14ca85afa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:36.613695 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8673bb5c-0799-42d3-b5f8-28c14ca85afa None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:36.622268 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 607/1189] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:21:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:36.628277 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af7887-03ad-4b57-8783-a7a7d5935d04 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:36.646059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:36.735681 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af7887-03ad-4b57-8783-a7a7d5935d04 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:36.768782 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2a41b-051c-41e1-81d9-2bb7477edd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:36.769390 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2a41b-051c-41e1-81d9-2bb7477edd36 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:36.769668 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2a41b-051c-41e1-81d9-2bb7477edd36 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:36.769967 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2a41b-051c-41e1-81d9-2bb7477edd36 None admin] PATH_INFO: `/v3/users/982c63d236ae4e98aeae40d584589957` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:36.771085 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2a41b-051c-41e1-81d9-2bb7477edd36 None admin] RBAC: Authorizing `identity:get_user(user_id=982c63d236ae4e98aeae40d584589957)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:36.772506 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2a41b-051c-41e1-81d9-2bb7477edd36 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:36.774829 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 583/1190] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:21:36 2022] GET /identity/v3/users/982c63d236ae4e98aeae40d584589957 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:36.780420 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673bb5c-0799-42d3-b5f8-28c14ca85afa None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:36.795979 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:36.879538 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673bb5c-0799-42d3-b5f8-28c14ca85afa None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:36.911711 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6074fd-506d-4e93-9433-b794c0f72369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:36.912325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6074fd-506d-4e93-9433-b794c0f72369 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:36.912602 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6074fd-506d-4e93-9433-b794c0f72369 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:36.912873 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6074fd-506d-4e93-9433-b794c0f72369 None admin] PATH_INFO: `/v3/projects/168f254997ae48f2b6b6a783156a2aee` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:36.914003 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6074fd-506d-4e93-9433-b794c0f72369 None admin] RBAC: Authorizing `identity:get_project(project_id=168f254997ae48f2b6b6a783156a2aee)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:36.916461 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6074fd-506d-4e93-9433-b794c0f72369 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:36.918111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 608/1191] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:21:36 2022] GET /identity/v3/projects/168f254997ae48f2b6b6a783156a2aee => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:36.924071 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2a41b-051c-41e1-81d9-2bb7477edd36 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:37.003524 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:37.027165 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2a41b-051c-41e1-81d9-2bb7477edd36 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:37.060626 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b68fe-cb65-4b80-a5bf-355d52aaa2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:37.061267 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b68fe-cb65-4b80-a5bf-355d52aaa2f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:37.061548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b68fe-cb65-4b80-a5bf-355d52aaa2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:37.061847 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b68fe-cb65-4b80-a5bf-355d52aaa2f5 None admin] PATH_INFO: `/v3/projects/168f254997ae48f2b6b6a783156a2aee/users/982c63d236ae4e98aeae40d584589957/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:37.063746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b68fe-cb65-4b80-a5bf-355d52aaa2f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=168f254997ae48f2b6b6a783156a2aee, user_id=982c63d236ae4e98aeae40d584589957, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:37.065174 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b68fe-cb65-4b80-a5bf-355d52aaa2f5 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:37.132067 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 584/1192] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 14:21:36 2022] PUT /identity/v3/projects/168f254997ae48f2b6b6a783156a2aee/users/982c63d236ae4e98aeae40d584589957/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:21:39.014263 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16b5cf-bc3c-49f9-81c1-c21fbdf6987d None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:39.014819 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16b5cf-bc3c-49f9-81c1-c21fbdf6987d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:39.014819 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16b5cf-bc3c-49f9-81c1-c21fbdf6987d None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:39.016151 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 609/1193] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:21:39.021345 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da973ad2-feac-49f2-a64d-c1aa61dcf063 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:39.021728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da973ad2-feac-49f2-a64d-c1aa61dcf063 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:39.021956 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da973ad2-feac-49f2-a64d-c1aa61dcf063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:39.040004 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-da973ad2-feac-49f2-a64d-c1aa61dcf063 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:21:39.041198 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-da973ad2-feac-49f2-a64d-c1aa61dcf063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:21:39.105742 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 585/1194] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:21:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:21:39.374701 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16b5cf-bc3c-49f9-81c1-c21fbdf6987d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:39.451772 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:39.472861 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16b5cf-bc3c-49f9-81c1-c21fbdf6987d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:39.506534 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b5eb3-b97b-4666-a372-167fcb00af27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:39.507149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b5eb3-b97b-4666-a372-167fcb00af27 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:39.507427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b5eb3-b97b-4666-a372-167fcb00af27 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:39.507724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b5eb3-b97b-4666-a372-167fcb00af27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:39.517474 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b5eb3-b97b-4666-a372-167fcb00af27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:21:39.522167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-9a0b5eb3-b97b-4666-a372-167fcb00af27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:21:39.522167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:21:39.522167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:21:39.522167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:21:39.522167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:21:39.522167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:21:39.522167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:21:39.522167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:21:39.522167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:21:39.522167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:21:39.522167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:21:39.522167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:21:39.522167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:21:39.522167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:21:39.522167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:21:39.522167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:21:39.523262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:21:39.523262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:21:39.523262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:21:39.523262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:21:39.523262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:21:39.523262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:21:39.523262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:21:39.523262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:21:39.523262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:21:39.523262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:21:39.523262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:21:39.523262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:21:39.523262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:21:39.523262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:21:39.523262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:21:39.523262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:21:39.524555 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:21:39.524555 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:21:39.524555 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:21:39.524555 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:21:39.524555 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:21:39.524555 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:21:39.524555 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:21:39.524555 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:21:39.524555 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:21:39.524555 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:21:39.524555 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:21:39.524555 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:21:39.524555 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 610/1195] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:21:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:21:39.529273 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da973ad2-feac-49f2-a64d-c1aa61dcf063 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:39.597173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:39.628062 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da973ad2-feac-49f2-a64d-c1aa61dcf063 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:39.660742 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ce204-dd45-4784-93fc-f7a01321372a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:39.661330 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ce204-dd45-4784-93fc-f7a01321372a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:39.661604 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ce204-dd45-4784-93fc-f7a01321372a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:39.661904 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ce204-dd45-4784-93fc-f7a01321372a None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:39.662565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ce204-dd45-4784-93fc-f7a01321372a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:21:39.662861 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ce204-dd45-4784-93fc-f7a01321372a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:39.664893 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ce204-dd45-4784-93fc-f7a01321372a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:39.672599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 586/1196] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:21:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:39.678507 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b5eb3-b97b-4666-a372-167fcb00af27 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:39.776296 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b5eb3-b97b-4666-a372-167fcb00af27 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:39.809071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1fc7df-8201-4163-869d-03cc7cca50ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:39.809676 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fc7df-8201-4163-869d-03cc7cca50ce None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:39.809976 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fc7df-8201-4163-869d-03cc7cca50ce None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:39.810245 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fc7df-8201-4163-869d-03cc7cca50ce None admin] PATH_INFO: `/v3/users/982c63d236ae4e98aeae40d584589957` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:39.811349 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1fc7df-8201-4163-869d-03cc7cca50ce None admin] RBAC: Authorizing `identity:get_user(user_id=982c63d236ae4e98aeae40d584589957)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:39.812764 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1fc7df-8201-4163-869d-03cc7cca50ce None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:39.814344 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 611/1197] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 14:21:39 2022] GET /identity/v3/users/982c63d236ae4e98aeae40d584589957 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:39.820183 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ce204-dd45-4784-93fc-f7a01321372a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:39.920472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ce204-dd45-4784-93fc-f7a01321372a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:39.952304 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4818d-ac9a-4c84-bb1b-37b100840180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:39.952881 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4818d-ac9a-4c84-bb1b-37b100840180 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:39.953154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4818d-ac9a-4c84-bb1b-37b100840180 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:39.953421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4818d-ac9a-4c84-bb1b-37b100840180 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:39.955915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:40.018703 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4818d-ac9a-4c84-bb1b-37b100840180 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:40.020114 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4818d-ac9a-4c84-bb1b-37b100840180 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:40.114479 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 587/1198] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:21:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:21:40.120354 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1fc7df-8201-4163-869d-03cc7cca50ce None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:40.129716 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:40.217288 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1fc7df-8201-4163-869d-03cc7cca50ce None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:40.248980 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadbffce-f5b7-42ad-a783-6a93ead8f1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:40.249590 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbffce-f5b7-42ad-a783-6a93ead8f1a7 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:40.249894 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbffce-f5b7-42ad-a783-6a93ead8f1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:40.250419 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbffce-f5b7-42ad-a783-6a93ead8f1a7 None admin] PATH_INFO: `/v3/projects/168f254997ae48f2b6b6a783156a2aee` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:40.251525 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadbffce-f5b7-42ad-a783-6a93ead8f1a7 None admin] RBAC: Authorizing `identity:get_project(project_id=168f254997ae48f2b6b6a783156a2aee)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:40.252939 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadbffce-f5b7-42ad-a783-6a93ead8f1a7 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:40.254583 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 612/1199] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 14:21:40 2022] GET /identity/v3/projects/168f254997ae48f2b6b6a783156a2aee => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:40.261142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4818d-ac9a-4c84-bb1b-37b100840180 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:21:40.294415 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:40.357455 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4818d-ac9a-4c84-bb1b-37b100840180 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:21:40.390511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c37166-fcc4-4346-8903-abe18a6e2934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:21:40.391122 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c37166-fcc4-4346-8903-abe18a6e2934 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:21:40.391400 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c37166-fcc4-4346-8903-abe18a6e2934 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:21:40.391670 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c37166-fcc4-4346-8903-abe18a6e2934 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:21:40.392378 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c37166-fcc4-4346-8903-abe18a6e2934 None admin] RBAC: Adding query filter params (role.id=b779073cee3c470ca4ad7a7b27d72c5e, scope.project.id=168f254997ae48f2b6b6a783156a2aee, user.id=982c63d236ae4e98aeae40d584589957) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:21:40.392680 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c37166-fcc4-4346-8903-abe18a6e2934 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:21:40.394110 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c37166-fcc4-4346-8903-abe18a6e2934 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:21:40.400375 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 588/1200] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:21:40 2022] GET /identity/v3/role_assignments?user.id=982c63d236ae4e98aeae40d584589957&scope.project.id=168f254997ae48f2b6b6a783156a2aee&role.id=b779073cee3c470ca4ad7a7b27d72c5e => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:21:50.244882 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=63 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:21:50.397108 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=51 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:22:53.075093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eab2c1-0e51-4467-a2c3-b7ad83900a22 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:22:53.075738 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eab2c1-0e51-4467-a2c3-b7ad83900a22 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:22:53.075738 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eab2c1-0e51-4467-a2c3-b7ad83900a22 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:22:53.076984 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 613/1201] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:22:53.082167 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cd6bb-2874-4030-bd03-2b6640f0b5e4 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:22:53.084184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cd6bb-2874-4030-bd03-2b6640f0b5e4 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:22:53.084184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cd6bb-2874-4030-bd03-2b6640f0b5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:22:53.101367 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-c47cd6bb-2874-4030-bd03-2b6640f0b5e4 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:22:53.103305 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c47cd6bb-2874-4030-bd03-2b6640f0b5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:22:53.169138 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 589/1202] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:22:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:22:53.441142 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eab2c1-0e51-4467-a2c3-b7ad83900a22 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:22:53.541445 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eab2c1-0e51-4467-a2c3-b7ad83900a22 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:22:53.579514 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3514d-82ff-49a0-ad66-2abff2d84a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:22:53.580340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3514d-82ff-49a0-ad66-2abff2d84a67 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:22:53.580626 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3514d-82ff-49a0-ad66-2abff2d84a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:22:53.580901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3514d-82ff-49a0-ad66-2abff2d84a67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:22:53.591051 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf3514d-82ff-49a0-ad66-2abff2d84a67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:22:53.592487 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf3514d-82ff-49a0-ad66-2abff2d84a67 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:22:53.607364 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-abf3514d-82ff-49a0-ad66-2abff2d84a67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:22:53.607364 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:22:53.607364 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:22:53.607364 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:22:53.607364 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:22:53.607364 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:22:53.607364 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:22:53.607364 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:22:53.607364 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:22:53.607364 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:22:53.607364 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:22:53.607364 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:22:53.607364 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:22:53.607364 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:22:53.607364 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:22:53.607364 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:22:53.608602 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:22:53.608602 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:22:53.608602 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:22:53.608602 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:22:53.608602 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:22:53.608602 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:22:53.608602 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:22:53.608602 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:22:53.608602 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:22:53.608602 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:22:53.608602 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:22:53.608602 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:22:53.608602 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:22:53.608602 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:22:53.608602 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:22:53.608602 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:22:53.608602 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:22:53.609821 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:22:53.609821 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:22:53.609821 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:22:53.609821 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 614/1203] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:22:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:22:53.614488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cd6bb-2874-4030-bd03-2b6640f0b5e4 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:22:53.720604 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cd6bb-2874-4030-bd03-2b6640f0b5e4 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:22:53.748383 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:22:53.754540 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3ffff-4630-4853-a3da-22ff02519ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:22:53.755147 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3ffff-4630-4853-a3da-22ff02519ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:22:53.755429 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3ffff-4630-4853-a3da-22ff02519ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:22:53.755702 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3ffff-4630-4853-a3da-22ff02519ac8 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:22:53.756349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3ffff-4630-4853-a3da-22ff02519ac8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:22:53.756651 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3ffff-4630-4853-a3da-22ff02519ac8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:22:53.758928 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3ffff-4630-4853-a3da-22ff02519ac8 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:22:53.770472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 590/1204] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:22:53.776559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3514d-82ff-49a0-ad66-2abff2d84a67 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:22:53.829052 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:22:53.874722 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3514d-82ff-49a0-ad66-2abff2d84a67 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:22:53.906722 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a440e13-2ca3-419f-a79b-84d55b04f748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:22:53.907313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a440e13-2ca3-419f-a79b-84d55b04f748 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:22:53.907592 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a440e13-2ca3-419f-a79b-84d55b04f748 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:22:53.907866 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a440e13-2ca3-419f-a79b-84d55b04f748 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:22:53.908496 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a440e13-2ca3-419f-a79b-84d55b04f748 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:22:53.909953 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a440e13-2ca3-419f-a79b-84d55b04f748 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:22:54.033255 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 615/1205] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 14:22:53 2022] POST /identity/v3/users => generated 251 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:22:55.962511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da0690-0534-49c2-875b-e14a6f08f6ce None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:22:55.963076 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da0690-0534-49c2-875b-e14a6f08f6ce None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:22:55.963076 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da0690-0534-49c2-875b-e14a6f08f6ce None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:22:55.964382 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 591/1206] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:22:55.969661 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72773a4d-888e-495c-a4eb-d4cbf6d635ff None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:22:55.970115 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72773a4d-888e-495c-a4eb-d4cbf6d635ff None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:22:55.970251 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72773a4d-888e-495c-a4eb-d4cbf6d635ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:22:55.988916 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-72773a4d-888e-495c-a4eb-d4cbf6d635ff None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:22:55.990148 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-72773a4d-888e-495c-a4eb-d4cbf6d635ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:22:56.056834 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 616/1207] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:22:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:22:56.325549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da0690-0534-49c2-875b-e14a6f08f6ce None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:22:56.429080 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da0690-0534-49c2-875b-e14a6f08f6ce None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:22:56.462845 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d57e9-41a1-4ce7-939a-d1f9e8b1d738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:22:56.463449 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d57e9-41a1-4ce7-939a-d1f9e8b1d738 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:22:56.463722 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d57e9-41a1-4ce7-939a-d1f9e8b1d738 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:22:56.463988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d57e9-41a1-4ce7-939a-d1f9e8b1d738 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:22:56.474310 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d57e9-41a1-4ce7-939a-d1f9e8b1d738 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:22:56.479836 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-353d57e9-41a1-4ce7-939a-d1f9e8b1d738 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:22:56.479836 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:22:56.479836 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:22:56.479836 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:22:56.479836 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:22:56.479836 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:22:56.479836 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:22:56.479836 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:22:56.479836 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:22:56.479836 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:22:56.479836 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:22:56.479836 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:22:56.479836 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:22:56.479836 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:22:56.479836 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:22:56.479836 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:22:56.481016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:22:56.481016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:22:56.481016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:22:56.481016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:22:56.481016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:22:56.481016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:22:56.481016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:22:56.481016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:22:56.481016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:22:56.481016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:22:56.481016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:22:56.481016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:22:56.481016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:22:56.481016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:22:56.481016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:22:56.481016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:22:56.482111 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:22:56.482111 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:22:56.482111 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:22:56.482111 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:22:56.482111 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:22:56.482111 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:22:56.482111 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:22:56.482111 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:22:56.482111 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:22:56.482111 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:22:56.482111 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:22:56.482111 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:22:56.482111 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 592/1208] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 14:22:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:22:56.487245 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72773a4d-888e-495c-a4eb-d4cbf6d635ff None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:22:56.525835 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:22:56.585888 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72773a4d-888e-495c-a4eb-d4cbf6d635ff None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:22:56.619690 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9614ff-634f-4064-b633-5d89294a4408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:22:56.620295 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9614ff-634f-4064-b633-5d89294a4408 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:22:56.620573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9614ff-634f-4064-b633-5d89294a4408 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:22:56.620869 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9614ff-634f-4064-b633-5d89294a4408 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:22:56.621535 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9614ff-634f-4064-b633-5d89294a4408 None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:22:56.621883 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9614ff-634f-4064-b633-5d89294a4408 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:22:56.626196 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9614ff-634f-4064-b633-5d89294a4408 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:22:56.631221 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 617/1209] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 14:22:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:22:56.637276 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d57e9-41a1-4ce7-939a-d1f9e8b1d738 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:22:56.687436 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:22:56.737623 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d57e9-41a1-4ce7-939a-d1f9e8b1d738 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:22:56.771184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4f093-a79e-411e-b90d-3e7b10c5155c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:22:56.771806 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4f093-a79e-411e-b90d-3e7b10c5155c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:22:56.772087 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4f093-a79e-411e-b90d-3e7b10c5155c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:22:56.772367 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4f093-a79e-411e-b90d-3e7b10c5155c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:22:56.783285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4f093-a79e-411e-b90d-3e7b10c5155c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:22:56.784710 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4f093-a79e-411e-b90d-3e7b10c5155c None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:22:56.799059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-e8f4f093-a79e-411e-b90d-3e7b10c5155c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:22:56.799059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:22:56.799059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:22:56.799059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:22:56.799059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:22:56.799059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:22:56.799059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:22:56.799059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:22:56.799059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:22:56.799059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:22:56.799059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:22:56.799059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:22:56.799059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:22:56.799059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:22:56.799059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:22:56.799059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:22:56.800073 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:22:56.800073 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:22:56.800073 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:22:56.800073 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:22:56.800073 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:22:56.800073 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:22:56.800073 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:22:56.800073 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:22:56.800073 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:22:56.800073 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:22:56.800073 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:22:56.800073 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:22:56.800073 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:22:56.800073 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:22:56.800073 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:22:56.800073 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:22:56.800073 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:22:56.801086 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:22:56.801086 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:22:56.801086 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:22:56.801086 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 593/1210] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:22:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:22:56.806506 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9614ff-634f-4064-b633-5d89294a4408 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:22:56.901924 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:22:56.904784 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9614ff-634f-4064-b633-5d89294a4408 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:22:56.938189 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6f901-d337-424e-81d5-3ea43407d264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:22:56.938791 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6f901-d337-424e-81d5-3ea43407d264 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:22:56.939067 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6f901-d337-424e-81d5-3ea43407d264 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:22:56.939339 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6f901-d337-424e-81d5-3ea43407d264 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:22:56.939986 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6f901-d337-424e-81d5-3ea43407d264 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:22:56.940281 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6f901-d337-424e-81d5-3ea43407d264 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:22:56.941635 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6f901-d337-424e-81d5-3ea43407d264 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:22:56.952605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 618/1211] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:22:56.958380 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4f093-a79e-411e-b90d-3e7b10c5155c None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:22:57.060913 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4f093-a79e-411e-b90d-3e7b10c5155c None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:22:57.062454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:22:57.094380 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d8883-760e-4446-ae02-1ec820abdbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:22:57.094996 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d8883-760e-4446-ae02-1ec820abdbf8 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:22:57.095269 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d8883-760e-4446-ae02-1ec820abdbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:22:57.095536 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d8883-760e-4446-ae02-1ec820abdbf8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:22:57.103506 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d8883-760e-4446-ae02-1ec820abdbf8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:22:57.104921 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d8883-760e-4446-ae02-1ec820abdbf8 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:22:57.115593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-a54d8883-760e-4446-ae02-1ec820abdbf8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 14:22:57.115593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:22:57.115593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:22:57.115593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:22:57.115593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:22:57.115593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:22:57.115593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:22:57.115593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:22:57.115593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:22:57.115593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:22:57.115593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:22:57.115593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:22:57.115593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:22:57.115593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:22:57.115593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:22:57.115593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:22:57.116762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:22:57.116762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:22:57.116762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:22:57.116762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:22:57.116762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:22:57.116762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:22:57.116762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:22:57.116762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:22:57.116762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:22:57.116762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:22:57.116762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:22:57.116762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:22:57.116762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:22:57.116762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:22:57.116762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:22:57.116762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:22:57.116762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:22:57.116762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:22:57.124315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:22:57.124315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:22:57.124315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:22:57.124315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:22:57.124315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:22:57.124315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:22:57.124315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:22:57.124315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:22:57.124315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 14:22:57.124315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:22:57.124315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 594/1212] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:22:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:22:57.125190 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6f901-d337-424e-81d5-3ea43407d264 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:22:57.223644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6f901-d337-424e-81d5-3ea43407d264 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:22:57.257530 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a1bf3-8dad-4536-b686-a134e1f370a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:22:57.259894 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a1bf3-8dad-4536-b686-a134e1f370a9 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:22:57.259894 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a1bf3-8dad-4536-b686-a134e1f370a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:22:57.259894 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a1bf3-8dad-4536-b686-a134e1f370a9 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:22:57.259894 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a1bf3-8dad-4536-b686-a134e1f370a9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:22:57.259894 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a1bf3-8dad-4536-b686-a134e1f370a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:22:57.261215 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a1bf3-8dad-4536-b686-a134e1f370a9 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:22:57.279453 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 619/1213] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Aug 24 14:22:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:22:57.285348 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d8883-760e-4446-ae02-1ec820abdbf8 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:22:57.387443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d8883-760e-4446-ae02-1ec820abdbf8 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:22:57.422136 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c22ee3-c39e-472d-83f0-5e019f61430d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:22:57.422733 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c22ee3-c39e-472d-83f0-5e019f61430d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:22:57.423014 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c22ee3-c39e-472d-83f0-5e019f61430d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:22:57.423286 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c22ee3-c39e-472d-83f0-5e019f61430d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:22:57.455202 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:22:57.492761 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c22ee3-c39e-472d-83f0-5e019f61430d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:22:57.494250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c22ee3-c39e-472d-83f0-5e019f61430d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:22:57.591600 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 595/1214] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:22:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:22:57.597551 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a1bf3-8dad-4536-b686-a134e1f370a9 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:22:57.616386 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:22:57.696198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a1bf3-8dad-4536-b686-a134e1f370a9 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:22:57.729916 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bfa7f-0615-47ea-9fab-4699ca3a1f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:22:57.730557 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bfa7f-0615-47ea-9fab-4699ca3a1f3c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:22:57.730834 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bfa7f-0615-47ea-9fab-4699ca3a1f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:22:57.731102 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bfa7f-0615-47ea-9fab-4699ca3a1f3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:22:57.740937 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bfa7f-0615-47ea-9fab-4699ca3a1f3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:22:57.742466 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bfa7f-0615-47ea-9fab-4699ca3a1f3c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:22:57.757142 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-979bfa7f-0615-47ea-9fab-4699ca3a1f3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:22:57.757142 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:22:57.757142 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:22:57.757142 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:22:57.757142 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:22:57.757142 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:22:57.757142 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:22:57.757142 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:22:57.757142 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:22:57.757142 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:22:57.757142 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:22:57.757142 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:22:57.757142 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:22:57.757142 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:22:57.757142 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:22:57.757142 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:22:57.758805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:22:57.758805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:22:57.758805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:22:57.758805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:22:57.758805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:22:57.758805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:22:57.758805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:22:57.758805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:22:57.758805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:22:57.758805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:22:57.758805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:22:57.758805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:22:57.758805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:22:57.758805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:22:57.758805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:22:57.758805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:22:57.758805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:22:57.759914 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:22:57.759914 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:22:57.759914 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:22:57.759914 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 620/1215] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:22:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:22:57.764862 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c22ee3-c39e-472d-83f0-5e019f61430d None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:22:57.825184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:22:57.872008 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c22ee3-c39e-472d-83f0-5e019f61430d None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:22:57.905489 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a1937-7541-4e9c-b8a8-e70a30a3ee3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:22:57.906106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a1937-7541-4e9c-b8a8-e70a30a3ee3e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:22:57.906384 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a1937-7541-4e9c-b8a8-e70a30a3ee3e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:22:57.906654 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a1937-7541-4e9c-b8a8-e70a30a3ee3e None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:22:57.907383 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a1937-7541-4e9c-b8a8-e70a30a3ee3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:22:57.907693 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a1937-7541-4e9c-b8a8-e70a30a3ee3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:22:57.909035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a1937-7541-4e9c-b8a8-e70a30a3ee3e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:22:57.919750 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 596/1216] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:22:57.925522 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bfa7f-0615-47ea-9fab-4699ca3a1f3c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:22:57.997575 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:22:58.028369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bfa7f-0615-47ea-9fab-4699ca3a1f3c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:22:58.061561 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff72836-1c96-410d-806a-8da2b8faf31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:22:58.062217 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff72836-1c96-410d-806a-8da2b8faf31b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:22:58.062497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff72836-1c96-410d-806a-8da2b8faf31b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:22:58.062767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff72836-1c96-410d-806a-8da2b8faf31b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:22:58.069208 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff72836-1c96-410d-806a-8da2b8faf31b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:22:58.071271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff72836-1c96-410d-806a-8da2b8faf31b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:22:58.082218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-fff72836-1c96-410d-806a-8da2b8faf31b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:22:58.082218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:22:58.082218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:22:58.082218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:22:58.082218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:22:58.082218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:22:58.082218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:22:58.082218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:22:58.082218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:22:58.082218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:22:58.082218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:22:58.082218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:22:58.082218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:22:58.082218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:22:58.082218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:22:58.083312 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:22:58.083312 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:22:58.083312 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:22:58.083312 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:22:58.083312 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:22:58.083312 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:22:58.083312 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:22:58.083312 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:22:58.083312 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:22:58.083312 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:22:58.083312 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:22:58.083312 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:22:58.083312 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:22:58.083312 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:22:58.083312 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:22:58.083312 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:22:58.083312 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:22:58.084377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:22:58.084377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:22:58.084377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:22:58.084377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:22:58.084377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:22:58.084377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:22:58.084377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:22:58.084377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:22:58.084377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 621/1217] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:22:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:22:58.089564 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a1937-7541-4e9c-b8a8-e70a30a3ee3e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:22:58.187685 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a1937-7541-4e9c-b8a8-e70a30a3ee3e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:22:58.209612 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:22:58.221076 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e70144-70cd-4eb3-8d02-1a817588a920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:22:58.221678 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e70144-70cd-4eb3-8d02-1a817588a920 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:22:58.222053 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e70144-70cd-4eb3-8d02-1a817588a920 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:22:58.222325 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e70144-70cd-4eb3-8d02-1a817588a920 None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:22:58.223021 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e70144-70cd-4eb3-8d02-1a817588a920 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:22:58.223323 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e70144-70cd-4eb3-8d02-1a817588a920 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:22:58.224732 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e70144-70cd-4eb3-8d02-1a817588a920 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:22:58.237203 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 597/1218] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:22:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:22:58.244277 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff72836-1c96-410d-806a-8da2b8faf31b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:22:58.343374 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff72836-1c96-410d-806a-8da2b8faf31b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:22:58.370820 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:22:58.376877 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798650ac-26e4-479a-983c-bb77971466a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:22:58.380426 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798650ac-26e4-479a-983c-bb77971466a3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:22:58.380426 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798650ac-26e4-479a-983c-bb77971466a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:22:58.380426 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798650ac-26e4-479a-983c-bb77971466a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:22:58.380426 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798650ac-26e4-479a-983c-bb77971466a3 None admin] RBAC: Adding query filter params (role.id=0df7ee13692d4eb5a741a8b79fd58d58, scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e, user.id=63253cd786c04d6a9d099773198aee36) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:22:58.380426 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798650ac-26e4-479a-983c-bb77971466a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:22:58.380826 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798650ac-26e4-479a-983c-bb77971466a3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:22:58.386797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 622/1219] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:22:58 2022] GET /identity/v3/role_assignments?user.id=63253cd786c04d6a9d099773198aee36&scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e&role.id=0df7ee13692d4eb5a741a8b79fd58d58 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:00.266947 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7c95c-2a9f-4002-8da3-a872884bf9e2 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:00.267359 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7c95c-2a9f-4002-8da3-a872884bf9e2 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:00.267523 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7c95c-2a9f-4002-8da3-a872884bf9e2 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:00.268829 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 598/1220] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:23:00.273932 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc38e1-28aa-4ce2-a379-afda01c4c99a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:00.274328 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc38e1-28aa-4ce2-a379-afda01c4c99a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:00.274540 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc38e1-28aa-4ce2-a379-afda01c4c99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:00.292841 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c3bc38e1-28aa-4ce2-a379-afda01c4c99a None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:23:00.294053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c3bc38e1-28aa-4ce2-a379-afda01c4c99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:23:00.360576 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 623/1221] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:23:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:23:00.632972 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7c95c-2a9f-4002-8da3-a872884bf9e2 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:00.733217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7c95c-2a9f-4002-8da3-a872884bf9e2 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:00.766362 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f8291-3c2a-4873-80ca-d3a67e2a150a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:00.766969 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f8291-3c2a-4873-80ca-d3a67e2a150a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:00.767247 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f8291-3c2a-4873-80ca-d3a67e2a150a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:00.767518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f8291-3c2a-4873-80ca-d3a67e2a150a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:00.777684 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f8291-3c2a-4873-80ca-d3a67e2a150a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:23:00.782777 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-d70f8291-3c2a-4873-80ca-d3a67e2a150a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:23:00.782777 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:00.782777 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:23:00.782777 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:23:00.782777 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:23:00.782777 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:23:00.782777 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:23:00.782777 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:23:00.782777 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:23:00.782777 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:23:00.782777 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:23:00.782777 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:23:00.782777 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:23:00.782777 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:23:00.782777 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:23:00.782777 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:23:00.783927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:23:00.783927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:23:00.783927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:23:00.783927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:23:00.783927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:23:00.783927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:23:00.783927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:23:00.783927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:23:00.783927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:23:00.783927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:23:00.783927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:23:00.783927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:23:00.783927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:23:00.783927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:23:00.783927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:23:00.783927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:23:00.784890 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:23:00.784890 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:23:00.784890 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:23:00.784890 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:23:00.784890 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:23:00.784890 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:23:00.784890 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:23:00.784890 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:23:00.784890 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:23:00.784890 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:23:00.784890 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:23:00.784890 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:23:00.784890 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 599/1222] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 14:23:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:23:00.789376 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc38e1-28aa-4ce2-a379-afda01c4c99a None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:00.887268 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc38e1-28aa-4ce2-a379-afda01c4c99a None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:00.910359 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:00.920975 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afef161-f2e4-42a0-bced-c1d458e173b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:00.921562 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afef161-f2e4-42a0-bced-c1d458e173b0 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:00.921863 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afef161-f2e4-42a0-bced-c1d458e173b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:00.922131 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afef161-f2e4-42a0-bced-c1d458e173b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:00.922778 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afef161-f2e4-42a0-bced-c1d458e173b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:00.923087 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afef161-f2e4-42a0-bced-c1d458e173b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:00.924418 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afef161-f2e4-42a0-bced-c1d458e173b0 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:00.932604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 624/1223] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 14:23:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:00.938548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f8291-3c2a-4873-80ca-d3a67e2a150a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:00.982320 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:01.037816 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f8291-3c2a-4873-80ca-d3a67e2a150a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:01.074122 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6441a1-1748-4265-981d-86592cc61261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:01.074774 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6441a1-1748-4265-981d-86592cc61261 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:01.075056 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6441a1-1748-4265-981d-86592cc61261 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:01.075329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6441a1-1748-4265-981d-86592cc61261 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:01.085310 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6441a1-1748-4265-981d-86592cc61261 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:01.087906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6441a1-1748-4265-981d-86592cc61261 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:01.105206 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-8e6441a1-1748-4265-981d-86592cc61261 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:23:01.105206 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:01.105206 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:23:01.105206 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:23:01.105206 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:23:01.105206 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:23:01.105206 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:23:01.105206 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:23:01.105206 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:23:01.105206 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:23:01.105206 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:23:01.105206 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:23:01.105206 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:23:01.105206 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:23:01.105206 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:23:01.105206 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:23:01.106432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:23:01.106432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:23:01.106432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:23:01.106432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:23:01.106432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:23:01.106432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:23:01.106432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:23:01.106432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:23:01.106432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:23:01.106432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:23:01.106432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:23:01.106432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:23:01.106432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:23:01.106432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:23:01.106432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:23:01.106432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:23:01.106432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:23:01.107534 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:23:01.107534 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:23:01.107534 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:23:01.107534 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 600/1224] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:23:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:23:01.112269 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afef161-f2e4-42a0-bced-c1d458e173b0 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:01.217812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afef161-f2e4-42a0-bced-c1d458e173b0 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:01.254336 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184b8b3-6c0a-4ad8-96e9-eb1918a46cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:01.255816 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184b8b3-6c0a-4ad8-96e9-eb1918a46cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:01.255816 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184b8b3-6c0a-4ad8-96e9-eb1918a46cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:01.255816 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184b8b3-6c0a-4ad8-96e9-eb1918a46cb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:01.256167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184b8b3-6c0a-4ad8-96e9-eb1918a46cb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:01.256444 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184b8b3-6c0a-4ad8-96e9-eb1918a46cb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:01.258018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184b8b3-6c0a-4ad8-96e9-eb1918a46cb3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:01.271781 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 625/1225] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:23:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:01.277633 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6441a1-1748-4265-981d-86592cc61261 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:01.370810 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:01.377606 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6441a1-1748-4265-981d-86592cc61261 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:01.410338 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd29d5-2c51-4212-b7c4-a4ec42caae45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:01.410934 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd29d5-2c51-4212-b7c4-a4ec42caae45 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:01.411211 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd29d5-2c51-4212-b7c4-a4ec42caae45 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:01.411483 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd29d5-2c51-4212-b7c4-a4ec42caae45 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:01.419365 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd29d5-2c51-4212-b7c4-a4ec42caae45 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:01.420775 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd29d5-2c51-4212-b7c4-a4ec42caae45 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:01.432181 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-70cd29d5-2c51-4212-b7c4-a4ec42caae45 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 14:23:01.432181 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:01.432181 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:23:01.432181 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:23:01.432181 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:23:01.432181 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:23:01.432181 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:23:01.432181 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:23:01.432181 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:23:01.432181 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:23:01.432181 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:23:01.432181 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:23:01.432181 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:23:01.432181 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:23:01.432181 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:23:01.432181 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:23:01.433346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:23:01.433346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:23:01.433346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:23:01.433346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:23:01.433346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:23:01.433346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:23:01.433346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:23:01.433346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:23:01.433346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:23:01.433346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:23:01.433346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:23:01.433346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:23:01.433346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:23:01.433346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:23:01.433346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:23:01.433346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:23:01.433346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:23:01.433346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:23:01.434587 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:23:01.434587 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:23:01.434587 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:23:01.434587 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:23:01.434587 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:23:01.434587 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:23:01.434587 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:23:01.434587 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:23:01.434587 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 14:23:01.434587 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:23:01.434587 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 601/1226] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:23:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:23:01.439267 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184b8b3-6c0a-4ad8-96e9-eb1918a46cb3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:01.485494 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:01.537180 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184b8b3-6c0a-4ad8-96e9-eb1918a46cb3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:01.571656 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe8dbc-142a-4514-8ef0-3ab0a6081454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:01.572259 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe8dbc-142a-4514-8ef0-3ab0a6081454 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:01.572535 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe8dbc-142a-4514-8ef0-3ab0a6081454 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:01.572809 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe8dbc-142a-4514-8ef0-3ab0a6081454 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:01.573535 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe8dbc-142a-4514-8ef0-3ab0a6081454 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:01.573876 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe8dbc-142a-4514-8ef0-3ab0a6081454 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:01.575302 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe8dbc-142a-4514-8ef0-3ab0a6081454 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:01.592319 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 626/1227] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Aug 24 14:23:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:01.598198 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd29d5-2c51-4212-b7c4-a4ec42caae45 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:01.698072 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd29d5-2c51-4212-b7c4-a4ec42caae45 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:01.731432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7889f-fb21-4a62-96f4-b5e91f142aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:01.732069 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7889f-fb21-4a62-96f4-b5e91f142aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:01.732487 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7889f-fb21-4a62-96f4-b5e91f142aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:01.732587 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7889f-fb21-4a62-96f4-b5e91f142aa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:01.746996 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7889f-fb21-4a62-96f4-b5e91f142aa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:01.746996 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7889f-fb21-4a62-96f4-b5e91f142aa5 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:01.758932 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-68a7889f-fb21-4a62-96f4-b5e91f142aa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:23:01.758932 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:01.758932 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:23:01.758932 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:23:01.758932 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:23:01.758932 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:23:01.758932 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:23:01.758932 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:23:01.758932 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:23:01.758932 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:23:01.758932 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:23:01.758932 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:23:01.758932 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:23:01.758932 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:23:01.758932 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:23:01.758932 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:23:01.760113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:23:01.760113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:23:01.760113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:23:01.760113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:23:01.760113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:23:01.760113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:23:01.760113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:23:01.760113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:23:01.760113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:23:01.760113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:23:01.760113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:23:01.760113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:23:01.760113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:23:01.760113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:23:01.760113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:23:01.760113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:23:01.760113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:23:01.761903 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:23:01.761903 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:23:01.761903 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:23:01.761903 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 602/1228] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:23:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:23:01.766612 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe8dbc-142a-4514-8ef0-3ab0a6081454 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:01.866316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe8dbc-142a-4514-8ef0-3ab0a6081454 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:01.869532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:01.900928 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c40d31-a6de-4c0b-896e-522678ecf13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:01.901525 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c40d31-a6de-4c0b-896e-522678ecf13f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:01.901834 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c40d31-a6de-4c0b-896e-522678ecf13f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:01.902131 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c40d31-a6de-4c0b-896e-522678ecf13f None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:01.902766 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c40d31-a6de-4c0b-896e-522678ecf13f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:01.903064 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c40d31-a6de-4c0b-896e-522678ecf13f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:01.904409 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c40d31-a6de-4c0b-896e-522678ecf13f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:01.915873 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 627/1229] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:23:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:01.921631 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7889f-fb21-4a62-96f4-b5e91f142aa5 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:01.932093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:02.022236 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7889f-fb21-4a62-96f4-b5e91f142aa5 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:02.056104 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b8f9a-38a1-4aac-acf4-c1b24c0f25d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:02.056722 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b8f9a-38a1-4aac-acf4-c1b24c0f25d3 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:02.057000 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b8f9a-38a1-4aac-acf4-c1b24c0f25d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:02.057270 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b8f9a-38a1-4aac-acf4-c1b24c0f25d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:02.063783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b8f9a-38a1-4aac-acf4-c1b24c0f25d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:02.065200 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b8f9a-38a1-4aac-acf4-c1b24c0f25d3 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:02.076685 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-145b8f9a-38a1-4aac-acf4-c1b24c0f25d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:23:02.076685 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:02.076685 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:23:02.076685 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:23:02.076685 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:23:02.076685 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:23:02.076685 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:23:02.076685 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:23:02.076685 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:23:02.076685 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:23:02.076685 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:23:02.076685 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:23:02.076685 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:23:02.076685 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:23:02.076685 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:23:02.077790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:23:02.077790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:23:02.077790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:23:02.077790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:23:02.077790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:23:02.077790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:23:02.077790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:23:02.077790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:23:02.077790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:23:02.077790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:23:02.077790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:23:02.077790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:23:02.077790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:23:02.077790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:23:02.077790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:23:02.077790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:23:02.077790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:23:02.078923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:23:02.078923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:23:02.078923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:23:02.078923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:23:02.078923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:23:02.078923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:23:02.078923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:23:02.078923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:23:02.078923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 603/1230] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:23:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:23:02.083767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c40d31-a6de-4c0b-896e-522678ecf13f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:02.183669 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c40d31-a6de-4c0b-896e-522678ecf13f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:02.216947 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef293953-df18-4254-84f6-3e9c42ac76b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:02.217542 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef293953-df18-4254-84f6-3e9c42ac76b3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:02.217850 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef293953-df18-4254-84f6-3e9c42ac76b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:02.218126 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef293953-df18-4254-84f6-3e9c42ac76b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:02.218819 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef293953-df18-4254-84f6-3e9c42ac76b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:02.219125 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef293953-df18-4254-84f6-3e9c42ac76b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:02.220589 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef293953-df18-4254-84f6-3e9c42ac76b3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:02.232884 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 628/1231] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:23:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:02.238959 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b8f9a-38a1-4aac-acf4-c1b24c0f25d3 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:02.306706 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:02.339822 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b8f9a-38a1-4aac-acf4-c1b24c0f25d3 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:02.372277 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623dec86-a914-4be0-82e6-56f98530d517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:02.372930 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dec86-a914-4be0-82e6-56f98530d517 None admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:02.373205 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dec86-a914-4be0-82e6-56f98530d517 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:02.373475 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dec86-a914-4be0-82e6-56f98530d517 None admin] PATH_INFO: `/v3/projects/34cce205e8ee4ae9b09bb89bc4bb081e/users/63253cd786c04d6a9d099773198aee36/roles/0df7ee13692d4eb5a741a8b79fd58d58` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:02.388549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623dec86-a914-4be0-82e6-56f98530d517 None admin] RBAC: Authorizing `identity:create_grant(project_id=34cce205e8ee4ae9b09bb89bc4bb081e, user_id=63253cd786c04d6a9d099773198aee36, role_id=0df7ee13692d4eb5a741a8b79fd58d58)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:02.390017 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623dec86-a914-4be0-82e6-56f98530d517 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:02.491469 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 604/1232] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 14:23:02 2022] PUT /identity/v3/projects/34cce205e8ee4ae9b09bb89bc4bb081e/users/63253cd786c04d6a9d099773198aee36/roles/0df7ee13692d4eb5a741a8b79fd58d58 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:23:04.393605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebb84c-5a5f-42db-bb0b-b3db3f3f335b None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:04.394237 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebb84c-5a5f-42db-bb0b-b3db3f3f335b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:04.394237 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebb84c-5a5f-42db-bb0b-b3db3f3f335b None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:04.395526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 629/1233] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:23:04.401343 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214919d-bff4-4485-8f3d-8c79be8f5e24 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:04.401760 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214919d-bff4-4485-8f3d-8c79be8f5e24 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:04.401928 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214919d-bff4-4485-8f3d-8c79be8f5e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:04.420280 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-b214919d-bff4-4485-8f3d-8c79be8f5e24 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:23:04.421474 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b214919d-bff4-4485-8f3d-8c79be8f5e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:23:04.489476 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 605/1234] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:23:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:23:04.762417 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebb84c-5a5f-42db-bb0b-b3db3f3f335b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:04.787257 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:04.864451 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebb84c-5a5f-42db-bb0b-b3db3f3f335b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:04.898129 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa382d-11b6-40c2-a088-62e053e3bb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:04.898767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa382d-11b6-40c2-a088-62e053e3bb36 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:04.899161 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa382d-11b6-40c2-a088-62e053e3bb36 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:04.899448 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa382d-11b6-40c2-a088-62e053e3bb36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:04.909165 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa382d-11b6-40c2-a088-62e053e3bb36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:23:04.913793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-91aa382d-11b6-40c2-a088-62e053e3bb36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:23:04.913793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:04.913793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:23:04.913793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:23:04.913793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:23:04.913793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:23:04.913793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:23:04.913793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:23:04.913793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:23:04.913793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:23:04.913793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:23:04.913793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:23:04.913793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:23:04.913793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:23:04.913793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:23:04.913793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:23:04.915532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:23:04.915532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:23:04.915532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:23:04.915532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:23:04.915532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:23:04.915532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:23:04.915532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:23:04.915532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:23:04.915532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:23:04.915532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:23:04.915532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:23:04.915532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:23:04.915532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:23:04.915532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:23:04.915532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:23:04.915532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:23:04.916759 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:23:04.916759 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:23:04.916759 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:23:04.916759 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:23:04.916759 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:23:04.916759 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:23:04.916759 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:23:04.916759 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:23:04.916759 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:23:04.916759 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:23:04.916759 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:23:04.916759 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:23:04.916759 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 630/1235] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 14:23:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:23:04.921703 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214919d-bff4-4485-8f3d-8c79be8f5e24 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:04.967225 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:05.020803 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214919d-bff4-4485-8f3d-8c79be8f5e24 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:05.053757 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdf235-31f1-4359-9287-b1cf46ad4de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:05.054377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdf235-31f1-4359-9287-b1cf46ad4de2 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:05.054653 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdf235-31f1-4359-9287-b1cf46ad4de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:05.055569 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdf235-31f1-4359-9287-b1cf46ad4de2 None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:05.056340 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bdf235-31f1-4359-9287-b1cf46ad4de2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:05.056643 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bdf235-31f1-4359-9287-b1cf46ad4de2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:05.058030 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bdf235-31f1-4359-9287-b1cf46ad4de2 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:05.065571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 606/1236] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 14:23:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:05.071629 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa382d-11b6-40c2-a088-62e053e3bb36 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:05.155823 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:05.171470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa382d-11b6-40c2-a088-62e053e3bb36 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:05.204741 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833cce3-0cf9-4b2f-b0b1-ad9790ae6ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:05.205355 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833cce3-0cf9-4b2f-b0b1-ad9790ae6ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:05.205623 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833cce3-0cf9-4b2f-b0b1-ad9790ae6ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:05.205922 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833cce3-0cf9-4b2f-b0b1-ad9790ae6ca4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:05.215966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833cce3-0cf9-4b2f-b0b1-ad9790ae6ca4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:05.217386 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833cce3-0cf9-4b2f-b0b1-ad9790ae6ca4 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:05.231901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-6833cce3-0cf9-4b2f-b0b1-ad9790ae6ca4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:23:05.231901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:05.231901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:23:05.231901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:23:05.231901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:23:05.231901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:23:05.231901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:23:05.231901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:23:05.231901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:23:05.231901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:23:05.231901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:23:05.231901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:23:05.231901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:23:05.231901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:23:05.231901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:23:05.231901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:23:05.233057 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:23:05.233057 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:23:05.233057 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:23:05.233057 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:23:05.233057 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:23:05.233057 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:23:05.233057 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:23:05.233057 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:23:05.233057 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:23:05.233057 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:23:05.233057 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:23:05.233057 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:23:05.233057 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:23:05.233057 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:23:05.233057 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:23:05.233057 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:23:05.233057 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:23:05.234194 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:23:05.234194 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:23:05.234194 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:23:05.234194 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 631/1237] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:23:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:23:05.238978 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdf235-31f1-4359-9287-b1cf46ad4de2 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:05.343163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdf235-31f1-4359-9287-b1cf46ad4de2 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:05.352459 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:05.376480 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bdd396-07ac-4523-9f7e-ce6c6d98417c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:05.377077 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdd396-07ac-4523-9f7e-ce6c6d98417c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:05.377360 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdd396-07ac-4523-9f7e-ce6c6d98417c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:05.377635 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdd396-07ac-4523-9f7e-ce6c6d98417c None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:05.378427 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bdd396-07ac-4523-9f7e-ce6c6d98417c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:05.378733 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bdd396-07ac-4523-9f7e-ce6c6d98417c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:05.380087 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bdd396-07ac-4523-9f7e-ce6c6d98417c None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:05.391486 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 607/1238] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:05.397370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833cce3-0cf9-4b2f-b0b1-ad9790ae6ca4 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:05.497878 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833cce3-0cf9-4b2f-b0b1-ad9790ae6ca4 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:05.530544 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052113b-d326-40c6-b9e5-21f0c73278a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:05.531159 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052113b-d326-40c6-b9e5-21f0c73278a5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:05.531435 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052113b-d326-40c6-b9e5-21f0c73278a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:05.531704 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052113b-d326-40c6-b9e5-21f0c73278a5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:05.534375 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:05.539945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052113b-d326-40c6-b9e5-21f0c73278a5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:05.541536 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052113b-d326-40c6-b9e5-21f0c73278a5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:05.552222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-6052113b-d326-40c6-b9e5-21f0c73278a5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 14:23:05.552222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:05.552222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:23:05.552222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:23:05.552222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:23:05.552222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:23:05.552222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:23:05.552222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:23:05.552222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:23:05.552222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:23:05.552222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:23:05.552222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:23:05.552222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:23:05.552222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:23:05.552222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:23:05.552222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:23:05.555621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:23:05.555621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:23:05.555621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:23:05.555621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:23:05.555621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:23:05.555621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:23:05.555621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:23:05.555621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:23:05.555621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:23:05.555621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:23:05.555621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:23:05.555621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:23:05.555621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:23:05.555621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:23:05.555621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:23:05.555621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:23:05.555621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:23:05.555621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:23:05.556866 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:23:05.556866 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:23:05.556866 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:23:05.556866 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:23:05.556866 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:23:05.556866 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:23:05.556866 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:23:05.556866 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:23:05.556866 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 14:23:05.556866 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:23:05.556866 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 632/1239] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:23:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:23:05.559319 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bdd396-07ac-4523-9f7e-ce6c6d98417c None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:05.661102 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bdd396-07ac-4523-9f7e-ce6c6d98417c None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:05.694305 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599f05f-3366-4750-9fad-9cafef458eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:05.694899 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599f05f-3366-4750-9fad-9cafef458eff None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:05.695173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599f05f-3366-4750-9fad-9cafef458eff None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:05.695921 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599f05f-3366-4750-9fad-9cafef458eff None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:05.696690 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599f05f-3366-4750-9fad-9cafef458eff None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:05.696987 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599f05f-3366-4750-9fad-9cafef458eff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:05.698476 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599f05f-3366-4750-9fad-9cafef458eff None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:05.715566 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 608/1240] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Aug 24 14:23:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:05.721409 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052113b-d326-40c6-b9e5-21f0c73278a5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:05.818932 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052113b-d326-40c6-b9e5-21f0c73278a5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:05.852323 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23468f70-3bcc-42a1-9564-3c016f3f25d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:05.852997 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23468f70-3bcc-42a1-9564-3c016f3f25d5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:05.853237 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23468f70-3bcc-42a1-9564-3c016f3f25d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:05.853507 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23468f70-3bcc-42a1-9564-3c016f3f25d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:05.914122 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:05.920382 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23468f70-3bcc-42a1-9564-3c016f3f25d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:05.921875 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23468f70-3bcc-42a1-9564-3c016f3f25d5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:06.019289 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 633/1241] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:23:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:23:06.025420 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599f05f-3366-4750-9fad-9cafef458eff None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:06.052411 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:06.125440 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599f05f-3366-4750-9fad-9cafef458eff None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:06.159404 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea1af6-bae2-46ad-8d54-bb1985da772b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:06.159981 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea1af6-bae2-46ad-8d54-bb1985da772b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:06.160257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea1af6-bae2-46ad-8d54-bb1985da772b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:06.160526 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea1af6-bae2-46ad-8d54-bb1985da772b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:06.170675 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea1af6-bae2-46ad-8d54-bb1985da772b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:06.172042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea1af6-bae2-46ad-8d54-bb1985da772b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:06.187517 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-14ea1af6-bae2-46ad-8d54-bb1985da772b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:23:06.187517 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:06.187517 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:23:06.187517 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:23:06.187517 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:23:06.187517 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:23:06.187517 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:23:06.187517 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:23:06.187517 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:23:06.187517 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:23:06.187517 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:23:06.187517 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:23:06.187517 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:23:06.187517 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:23:06.187517 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:23:06.187517 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:23:06.188494 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:23:06.188494 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:23:06.188494 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:23:06.188494 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:23:06.188494 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:23:06.188494 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:23:06.188494 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:23:06.188494 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:23:06.188494 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:23:06.188494 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:23:06.188494 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:23:06.188494 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:23:06.188494 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:23:06.188494 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:23:06.188494 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:23:06.188494 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:23:06.188494 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:23:06.189454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:23:06.189454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:23:06.189454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:23:06.189454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 609/1242] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:23:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:23:06.194528 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23468f70-3bcc-42a1-9564-3c016f3f25d5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:06.289152 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:06.295250 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23468f70-3bcc-42a1-9564-3c016f3f25d5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:06.330049 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f00379-1f3e-436b-94c1-17be99b4cb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:06.330645 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f00379-1f3e-436b-94c1-17be99b4cb8b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:06.330918 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f00379-1f3e-436b-94c1-17be99b4cb8b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:06.331184 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f00379-1f3e-436b-94c1-17be99b4cb8b None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:06.331813 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f00379-1f3e-436b-94c1-17be99b4cb8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:06.332113 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f00379-1f3e-436b-94c1-17be99b4cb8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:06.333494 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f00379-1f3e-436b-94c1-17be99b4cb8b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:06.344287 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 634/1243] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:06.349967 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea1af6-bae2-46ad-8d54-bb1985da772b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:06.428844 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:06.450217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea1af6-bae2-46ad-8d54-bb1985da772b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:06.483015 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c121d9-bb6f-4c67-9f34-f6e7c13e6f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:06.483733 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c121d9-bb6f-4c67-9f34-f6e7c13e6f6f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:06.484007 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c121d9-bb6f-4c67-9f34-f6e7c13e6f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:06.484361 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c121d9-bb6f-4c67-9f34-f6e7c13e6f6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:06.491033 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c121d9-bb6f-4c67-9f34-f6e7c13e6f6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:06.495860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c121d9-bb6f-4c67-9f34-f6e7c13e6f6f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:06.504882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-c7c121d9-bb6f-4c67-9f34-f6e7c13e6f6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:23:06.504882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:06.504882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:23:06.504882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:23:06.504882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:23:06.504882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:23:06.504882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:23:06.504882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:23:06.504882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:23:06.504882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:23:06.504882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:23:06.504882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:23:06.504882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:23:06.504882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:23:06.504882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:23:06.506020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:23:06.506020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:23:06.506020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:23:06.506020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:23:06.506020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:23:06.506020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:23:06.506020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:23:06.506020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:23:06.506020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:23:06.506020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:23:06.506020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:23:06.506020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:23:06.506020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:23:06.506020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:23:06.506020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:23:06.506020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:23:06.506020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:23:06.507163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:23:06.507163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:23:06.507163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:23:06.507163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:23:06.507163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:23:06.507163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:23:06.507163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:23:06.507163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:23:06.507163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 610/1244] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:23:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:23:06.512523 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f00379-1f3e-436b-94c1-17be99b4cb8b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:06.611158 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f00379-1f3e-436b-94c1-17be99b4cb8b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:06.644649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aab398-ad02-467d-8506-b1225b4b4545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:06.645244 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aab398-ad02-467d-8506-b1225b4b4545 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:06.645540 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aab398-ad02-467d-8506-b1225b4b4545 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:06.645826 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aab398-ad02-467d-8506-b1225b4b4545 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:06.646535 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aab398-ad02-467d-8506-b1225b4b4545 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:06.646842 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aab398-ad02-467d-8506-b1225b4b4545 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:06.648264 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aab398-ad02-467d-8506-b1225b4b4545 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:06.660329 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 635/1245] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:23:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:06.667056 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c121d9-bb6f-4c67-9f34-f6e7c13e6f6f None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:06.766044 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c121d9-bb6f-4c67-9f34-f6e7c13e6f6f None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:06.799649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324155cf-fbbd-44dc-9b61-e8817eacfb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:06.800240 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324155cf-fbbd-44dc-9b61-e8817eacfb2c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:06.800521 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324155cf-fbbd-44dc-9b61-e8817eacfb2c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:06.800793 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324155cf-fbbd-44dc-9b61-e8817eacfb2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:06.801510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324155cf-fbbd-44dc-9b61-e8817eacfb2c None admin] RBAC: Adding query filter params (role.id=0df7ee13692d4eb5a741a8b79fd58d58, scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e, user.id=63253cd786c04d6a9d099773198aee36) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:06.801844 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324155cf-fbbd-44dc-9b61-e8817eacfb2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:06.803269 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324155cf-fbbd-44dc-9b61-e8817eacfb2c None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:06.809158 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 611/1246] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:23:06 2022] GET /identity/v3/role_assignments?user.id=63253cd786c04d6a9d099773198aee36&scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e&role.id=0df7ee13692d4eb5a741a8b79fd58d58 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:23:08.760978 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8722306-c28f-43cc-b4ed-a47b85b8f9b0 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:08.761506 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8722306-c28f-43cc-b4ed-a47b85b8f9b0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:08.761506 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8722306-c28f-43cc-b4ed-a47b85b8f9b0 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:08.762924 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 636/1247] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:23:08.768412 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9aabb-d71f-4f36-93c5-78b9ced860cb None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:08.768808 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9aabb-d71f-4f36-93c5-78b9ced860cb None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:08.768972 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9aabb-d71f-4f36-93c5-78b9ced860cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:08.775995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:08.787677 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ace9aabb-d71f-4f36-93c5-78b9ced860cb None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:23:08.788855 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ace9aabb-d71f-4f36-93c5-78b9ced860cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:23:08.854519 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 612/1248] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:23:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:23:09.128310 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8722306-c28f-43cc-b4ed-a47b85b8f9b0 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:09.147552 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:09.239945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8722306-c28f-43cc-b4ed-a47b85b8f9b0 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:09.278120 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620224bf-1a50-4b53-b376-a1dee5e761d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:09.278747 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620224bf-1a50-4b53-b376-a1dee5e761d6 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:09.279023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620224bf-1a50-4b53-b376-a1dee5e761d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:09.279291 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620224bf-1a50-4b53-b376-a1dee5e761d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:09.289139 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620224bf-1a50-4b53-b376-a1dee5e761d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:23:09.293793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-620224bf-1a50-4b53-b376-a1dee5e761d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:23:09.293793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:09.293793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:23:09.293793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:23:09.293793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:23:09.293793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:23:09.293793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:23:09.293793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:23:09.293793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:23:09.293793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:23:09.293793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:23:09.293793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:23:09.293793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:23:09.293793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:23:09.293793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:23:09.293793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:23:09.294833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:23:09.294833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:23:09.294833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:23:09.294833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:23:09.294833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:23:09.294833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:23:09.294833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:23:09.294833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:23:09.294833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:23:09.294833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:23:09.294833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:23:09.294833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:23:09.294833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:23:09.294833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:23:09.294833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:23:09.294833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:23:09.295784 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:23:09.295784 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:23:09.295784 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:23:09.295784 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:23:09.295784 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:23:09.295784 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:23:09.295784 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:23:09.295784 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:23:09.295784 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:23:09.295784 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:23:09.295784 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:23:09.295784 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:23:09.295784 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 637/1249] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:23:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:23:09.300985 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9aabb-d71f-4f36-93c5-78b9ced860cb None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:09.402028 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9aabb-d71f-4f36-93c5-78b9ced860cb None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:09.431570 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:09.436439 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76b952-f899-476b-a54c-a5d8d31bb85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:09.437036 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76b952-f899-476b-a54c-a5d8d31bb85a None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:09.437315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76b952-f899-476b-a54c-a5d8d31bb85a None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:09.437586 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76b952-f899-476b-a54c-a5d8d31bb85a None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:09.438274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76b952-f899-476b-a54c-a5d8d31bb85a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:09.438571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76b952-f899-476b-a54c-a5d8d31bb85a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:09.439934 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76b952-f899-476b-a54c-a5d8d31bb85a None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:09.447866 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 613/1250] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:23:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:09.453670 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620224bf-1a50-4b53-b376-a1dee5e761d6 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:09.531370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:09.553430 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620224bf-1a50-4b53-b376-a1dee5e761d6 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:09.586663 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847fd45-3794-4586-baf8-cdc149b811bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:09.587282 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847fd45-3794-4586-baf8-cdc149b811bc None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:09.587556 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847fd45-3794-4586-baf8-cdc149b811bc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:09.587823 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847fd45-3794-4586-baf8-cdc149b811bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:09.597419 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847fd45-3794-4586-baf8-cdc149b811bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:09.598879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847fd45-3794-4586-baf8-cdc149b811bc None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:09.614846 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-6847fd45-3794-4586-baf8-cdc149b811bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:23:09.614846 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:09.614846 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:23:09.614846 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:23:09.614846 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:23:09.614846 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:23:09.614846 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:23:09.614846 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:23:09.614846 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:23:09.614846 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:23:09.614846 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:23:09.614846 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:23:09.614846 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:23:09.614846 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:23:09.614846 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:23:09.614846 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:23:09.617025 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:23:09.617025 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:23:09.617025 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:23:09.617025 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:23:09.617025 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:23:09.617025 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:23:09.617025 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:23:09.617025 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:23:09.617025 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:23:09.617025 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:23:09.617025 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:23:09.617025 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:23:09.617025 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:23:09.617025 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:23:09.617025 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:23:09.617025 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:23:09.617025 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:23:09.618732 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:23:09.618732 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:23:09.618732 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:23:09.618732 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 638/1251] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:23:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:23:09.622845 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76b952-f899-476b-a54c-a5d8d31bb85a None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:09.721906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76b952-f899-476b-a54c-a5d8d31bb85a None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:09.755283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094605de-f3fa-4cb0-b8f1-e97be94a48b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:09.755873 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094605de-f3fa-4cb0-b8f1-e97be94a48b7 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:09.756154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094605de-f3fa-4cb0-b8f1-e97be94a48b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:09.756422 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094605de-f3fa-4cb0-b8f1-e97be94a48b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:09.757052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094605de-f3fa-4cb0-b8f1-e97be94a48b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:09.757351 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094605de-f3fa-4cb0-b8f1-e97be94a48b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:09.758818 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094605de-f3fa-4cb0-b8f1-e97be94a48b7 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:09.770904 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 614/1252] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:09.777299 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847fd45-3794-4586-baf8-cdc149b811bc None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:09.877344 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847fd45-3794-4586-baf8-cdc149b811bc None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:09.903441 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:09.911071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e5c72-b762-4548-bf0d-cb5989622349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:09.911688 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e5c72-b762-4548-bf0d-cb5989622349 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:09.911967 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e5c72-b762-4548-bf0d-cb5989622349 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:09.912238 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e5c72-b762-4548-bf0d-cb5989622349 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:09.920265 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e5c72-b762-4548-bf0d-cb5989622349 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:09.921691 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e5c72-b762-4548-bf0d-cb5989622349 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:09.932596 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-b57e5c72-b762-4548-bf0d-cb5989622349 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 14:23:09.932596 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:09.932596 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:23:09.932596 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:23:09.932596 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:23:09.932596 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:23:09.932596 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:23:09.932596 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:23:09.932596 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:23:09.932596 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:23:09.932596 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:23:09.932596 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:23:09.932596 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:23:09.932596 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:23:09.932596 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:23:09.932596 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:23:09.933743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:23:09.933743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:23:09.933743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:23:09.933743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:23:09.933743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:23:09.933743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:23:09.933743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:23:09.933743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:23:09.933743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:23:09.933743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:23:09.933743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:23:09.933743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:23:09.933743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:23:09.933743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:23:09.933743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:23:09.933743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:23:09.933743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:23:09.933743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:23:09.934945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:23:09.934945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:23:09.934945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:23:09.934945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:23:09.934945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:23:09.934945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:23:09.934945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:23:09.934945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:23:09.934945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 14:23:09.934945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:23:09.934945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 639/1253] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:23:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:23:09.939640 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094605de-f3fa-4cb0-b8f1-e97be94a48b7 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:09.993988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:10.036903 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094605de-f3fa-4cb0-b8f1-e97be94a48b7 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:10.071899 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c462c-47e2-40c4-84b2-b3a86fe500bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:10.072600 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c462c-47e2-40c4-84b2-b3a86fe500bb None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:10.072876 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c462c-47e2-40c4-84b2-b3a86fe500bb None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:10.073144 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c462c-47e2-40c4-84b2-b3a86fe500bb None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:10.073890 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c462c-47e2-40c4-84b2-b3a86fe500bb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:10.074191 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c462c-47e2-40c4-84b2-b3a86fe500bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:10.075594 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c462c-47e2-40c4-84b2-b3a86fe500bb None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:10.093069 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 615/1254] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Aug 24 14:23:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:10.098943 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e5c72-b762-4548-bf0d-cb5989622349 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:10.198765 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e5c72-b762-4548-bf0d-cb5989622349 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:10.231698 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0608921-dc4e-4541-b620-810309725dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:10.232299 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0608921-dc4e-4541-b620-810309725dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:10.232621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0608921-dc4e-4541-b620-810309725dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:10.232894 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0608921-dc4e-4541-b620-810309725dd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:10.288250 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:10.300447 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0608921-dc4e-4541-b620-810309725dd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:10.301970 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0608921-dc4e-4541-b620-810309725dd2 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:10.399329 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 640/1255] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:23:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:23:10.404690 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c462c-47e2-40c4-84b2-b3a86fe500bb None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:10.504466 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c462c-47e2-40c4-84b2-b3a86fe500bb None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:10.518179 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:10.539258 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b339f6-84e1-4c9a-bc9d-dd4ed3adfeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:10.539906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b339f6-84e1-4c9a-bc9d-dd4ed3adfeb9 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:10.540210 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b339f6-84e1-4c9a-bc9d-dd4ed3adfeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:10.540481 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b339f6-84e1-4c9a-bc9d-dd4ed3adfeb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:10.550216 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b339f6-84e1-4c9a-bc9d-dd4ed3adfeb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:10.551639 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b339f6-84e1-4c9a-bc9d-dd4ed3adfeb9 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:10.566231 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-f9b339f6-84e1-4c9a-bc9d-dd4ed3adfeb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:23:10.566231 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:10.566231 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:23:10.566231 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:23:10.566231 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:23:10.566231 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:23:10.566231 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:23:10.566231 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:23:10.566231 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:23:10.566231 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:23:10.566231 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:23:10.566231 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:23:10.566231 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:23:10.566231 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:23:10.566231 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:23:10.566231 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:23:10.567407 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:23:10.567407 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:23:10.567407 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:23:10.567407 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:23:10.567407 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:23:10.567407 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:23:10.567407 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:23:10.567407 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:23:10.567407 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:23:10.567407 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:23:10.567407 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:23:10.567407 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:23:10.567407 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:23:10.567407 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:23:10.567407 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:23:10.567407 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:23:10.567407 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:23:10.568434 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:23:10.568434 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:23:10.568434 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:23:10.568434 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 616/1256] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:23:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:23:10.573862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0608921-dc4e-4541-b620-810309725dd2 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:10.658128 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:10.669662 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0608921-dc4e-4541-b620-810309725dd2 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:10.703093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da4099-c5ae-4f27-a6cb-9e8e6bdf64ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:10.703686 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da4099-c5ae-4f27-a6cb-9e8e6bdf64ef None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:10.703961 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da4099-c5ae-4f27-a6cb-9e8e6bdf64ef None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:10.704229 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da4099-c5ae-4f27-a6cb-9e8e6bdf64ef None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:10.704857 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da4099-c5ae-4f27-a6cb-9e8e6bdf64ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:10.705155 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da4099-c5ae-4f27-a6cb-9e8e6bdf64ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:10.706521 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da4099-c5ae-4f27-a6cb-9e8e6bdf64ef None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:10.717193 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 641/1257] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:10.722877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b339f6-84e1-4c9a-bc9d-dd4ed3adfeb9 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:10.822121 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b339f6-84e1-4c9a-bc9d-dd4ed3adfeb9 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:10.855349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6edb3-8350-4d0a-ad24-d56611362551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:10.855964 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6edb3-8350-4d0a-ad24-d56611362551 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:10.856247 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6edb3-8350-4d0a-ad24-d56611362551 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:10.856521 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6edb3-8350-4d0a-ad24-d56611362551 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:10.862989 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6edb3-8350-4d0a-ad24-d56611362551 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:10.864456 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6edb3-8350-4d0a-ad24-d56611362551 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:10.876431 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-b7d6edb3-8350-4d0a-ad24-d56611362551 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:23:10.876431 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:10.876431 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:23:10.876431 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:23:10.876431 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:23:10.876431 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:23:10.876431 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:23:10.876431 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:23:10.876431 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:23:10.876431 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:23:10.876431 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:23:10.876431 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:23:10.876431 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:23:10.876431 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:23:10.876431 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:23:10.877511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:23:10.877511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:23:10.877511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:23:10.877511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:23:10.877511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:23:10.877511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:23:10.877511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:23:10.877511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:23:10.877511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:23:10.877511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:23:10.877511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:23:10.877511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:23:10.877511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:23:10.877511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:23:10.877511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:23:10.877511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:23:10.877511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:23:10.878819 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:23:10.878819 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:23:10.878819 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:23:10.878819 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:23:10.878819 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:23:10.878819 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:23:10.878819 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:23:10.878819 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:23:10.878819 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 617/1258] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:23:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:23:10.883904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da4099-c5ae-4f27-a6cb-9e8e6bdf64ef None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:10.983397 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da4099-c5ae-4f27-a6cb-9e8e6bdf64ef None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:11.017142 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9136361-6224-4ad5-a2ec-8666daf0ee9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:11.017741 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9136361-6224-4ad5-a2ec-8666daf0ee9a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:11.018086 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9136361-6224-4ad5-a2ec-8666daf0ee9a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:11.018360 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9136361-6224-4ad5-a2ec-8666daf0ee9a None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:11.019051 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9136361-6224-4ad5-a2ec-8666daf0ee9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:11.019354 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9136361-6224-4ad5-a2ec-8666daf0ee9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:11.020771 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9136361-6224-4ad5-a2ec-8666daf0ee9a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:11.032508 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 642/1259] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:23:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:11.038592 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6edb3-8350-4d0a-ad24-d56611362551 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:11.064866 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:11.137169 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6edb3-8350-4d0a-ad24-d56611362551 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:11.170114 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c6971-cdd4-4003-a411-5f593f950edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:11.170717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c6971-cdd4-4003-a411-5f593f950edb None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:11.170998 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c6971-cdd4-4003-a411-5f593f950edb None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:11.171270 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c6971-cdd4-4003-a411-5f593f950edb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:11.171994 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c6971-cdd4-4003-a411-5f593f950edb None admin] RBAC: Adding query filter params (role.id=b779073cee3c470ca4ad7a7b27d72c5e, scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e, user.id=63253cd786c04d6a9d099773198aee36) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:11.172299 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c6971-cdd4-4003-a411-5f593f950edb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:11.173725 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c6971-cdd4-4003-a411-5f593f950edb None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:11.179161 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 618/1260] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:23:11 2022] GET /identity/v3/role_assignments?user.id=63253cd786c04d6a9d099773198aee36&scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e&role.id=b779073cee3c470ca4ad7a7b27d72c5e => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:13.065096 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf67e6-800e-4e1e-aa37-33be74fc985e None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:13.065784 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf67e6-800e-4e1e-aa37-33be74fc985e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:13.065784 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf67e6-800e-4e1e-aa37-33be74fc985e None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:13.067126 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 643/1261] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:23:13.073212 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cdd8f-c820-4b2c-949e-700c2bc46424 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:13.073952 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cdd8f-c820-4b2c-949e-700c2bc46424 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:13.074183 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cdd8f-c820-4b2c-949e-700c2bc46424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:13.094126 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-9e2cdd8f-c820-4b2c-949e-700c2bc46424 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:23:13.095318 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9e2cdd8f-c820-4b2c-949e-700c2bc46424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:23:13.161048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 619/1262] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:23:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:23:13.429583 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf67e6-800e-4e1e-aa37-33be74fc985e None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:13.440968 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:13.533093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf67e6-800e-4e1e-aa37-33be74fc985e None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:13.567444 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9f764-5b3f-49af-a8db-2c6985ebe7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:13.568058 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9f764-5b3f-49af-a8db-2c6985ebe7d1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:13.568335 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9f764-5b3f-49af-a8db-2c6985ebe7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:13.568596 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9f764-5b3f-49af-a8db-2c6985ebe7d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:13.578635 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9f764-5b3f-49af-a8db-2c6985ebe7d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:23:13.583261 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-44e9f764-5b3f-49af-a8db-2c6985ebe7d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:23:13.583261 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:13.583261 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:23:13.583261 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:23:13.583261 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:23:13.583261 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:23:13.583261 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:23:13.583261 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:23:13.583261 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:23:13.583261 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:23:13.583261 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:23:13.583261 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:23:13.583261 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:23:13.583261 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:23:13.583261 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:23:13.583261 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:23:13.584411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:23:13.584411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:23:13.584411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:23:13.584411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:23:13.584411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:23:13.584411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:23:13.584411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:23:13.584411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:23:13.584411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:23:13.584411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:23:13.584411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:23:13.584411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:23:13.584411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:23:13.584411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:23:13.584411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:23:13.584411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:23:13.585476 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:23:13.585476 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:23:13.585476 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:23:13.585476 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:23:13.585476 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:23:13.585476 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:23:13.585476 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:23:13.585476 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:23:13.585476 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:23:13.585476 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:23:13.585476 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:23:13.585476 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:23:13.585476 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 644/1263] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:23:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:23:13.591633 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2cdd8f-c820-4b2c-949e-700c2bc46424 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:13.610344 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:13.688044 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2cdd8f-c820-4b2c-949e-700c2bc46424 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:13.722724 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015eaad-de1f-4ed3-88af-bec4159e34ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:13.723323 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015eaad-de1f-4ed3-88af-bec4159e34ac None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:13.723603 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015eaad-de1f-4ed3-88af-bec4159e34ac None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:13.724001 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015eaad-de1f-4ed3-88af-bec4159e34ac None admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:13.724668 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015eaad-de1f-4ed3-88af-bec4159e34ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:13.724969 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015eaad-de1f-4ed3-88af-bec4159e34ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:13.726405 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015eaad-de1f-4ed3-88af-bec4159e34ac None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:13.734946 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 620/1264] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:23:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:13.740672 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9f764-5b3f-49af-a8db-2c6985ebe7d1 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:13.808079 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:13.841613 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9f764-5b3f-49af-a8db-2c6985ebe7d1 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:13.878494 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78581b06-bc48-4876-9476-d15dcb5e66b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:13.879106 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78581b06-bc48-4876-9476-d15dcb5e66b8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:13.879387 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78581b06-bc48-4876-9476-d15dcb5e66b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:13.879654 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78581b06-bc48-4876-9476-d15dcb5e66b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:13.890880 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78581b06-bc48-4876-9476-d15dcb5e66b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:13.892358 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78581b06-bc48-4876-9476-d15dcb5e66b8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:13.907463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-78581b06-bc48-4876-9476-d15dcb5e66b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:23:13.907463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:13.907463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:23:13.907463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:23:13.907463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:23:13.907463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:23:13.907463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:23:13.907463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:23:13.907463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:23:13.907463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:23:13.907463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:23:13.907463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:23:13.907463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:23:13.907463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:23:13.907463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:23:13.907463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:23:13.908804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:23:13.908804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:23:13.908804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:23:13.908804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:23:13.908804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:23:13.908804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:23:13.908804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:23:13.908804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:23:13.908804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:23:13.908804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:23:13.908804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:23:13.908804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:23:13.908804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:23:13.908804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:23:13.908804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:23:13.908804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:23:13.908804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:23:13.910122 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:23:13.910122 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:23:13.910122 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:23:13.910122 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 645/1265] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:23:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:23:13.914944 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015eaad-de1f-4ed3-88af-bec4159e34ac None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:13.998473 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:14.017524 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015eaad-de1f-4ed3-88af-bec4159e34ac None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:14.051543 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55defce8-8dd6-4056-b265-c02ba44c156b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:14.052180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55defce8-8dd6-4056-b265-c02ba44c156b None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:14.052457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55defce8-8dd6-4056-b265-c02ba44c156b None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:14.052730 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55defce8-8dd6-4056-b265-c02ba44c156b None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:14.053367 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55defce8-8dd6-4056-b265-c02ba44c156b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:14.053667 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55defce8-8dd6-4056-b265-c02ba44c156b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:14.055869 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55defce8-8dd6-4056-b265-c02ba44c156b None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:14.067497 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 621/1266] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:14.073505 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78581b06-bc48-4876-9476-d15dcb5e66b8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:14.172656 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78581b06-bc48-4876-9476-d15dcb5e66b8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:14.192045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:14.206419 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006b722-649f-4cac-8e4b-44ab3bdec9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:14.207041 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006b722-649f-4cac-8e4b-44ab3bdec9f5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:14.207318 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006b722-649f-4cac-8e4b-44ab3bdec9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:14.207589 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006b722-649f-4cac-8e4b-44ab3bdec9f5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:14.215621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006b722-649f-4cac-8e4b-44ab3bdec9f5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:14.222530 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006b722-649f-4cac-8e4b-44ab3bdec9f5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:14.228023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-9006b722-649f-4cac-8e4b-44ab3bdec9f5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 14:23:14.228023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:14.228023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:23:14.228023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:23:14.228023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:23:14.228023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:23:14.228023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:23:14.228023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:23:14.228023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:23:14.228023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:23:14.228023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:23:14.228023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:23:14.228023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:23:14.228023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:23:14.228023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:23:14.228023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:23:14.229149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:23:14.229149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:23:14.229149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:23:14.229149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:23:14.229149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:23:14.229149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:23:14.229149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:23:14.229149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:23:14.229149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:23:14.229149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:23:14.229149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:23:14.229149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:23:14.229149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:23:14.229149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:23:14.229149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:23:14.229149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:23:14.229149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:23:14.229149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:23:14.230141 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:23:14.230141 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:23:14.230141 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:23:14.230141 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:23:14.230141 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:23:14.230141 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:23:14.230141 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:23:14.230141 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:23:14.230141 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 14:23:14.230141 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:23:14.230141 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 646/1267] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:23:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:23:14.235097 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55defce8-8dd6-4056-b265-c02ba44c156b None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:14.338889 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55defce8-8dd6-4056-b265-c02ba44c156b None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:14.373003 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7081d35-17ad-4a18-9c01-e8b486ba1d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:14.373603 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7081d35-17ad-4a18-9c01-e8b486ba1d4f None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:14.374201 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7081d35-17ad-4a18-9c01-e8b486ba1d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:14.374476 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7081d35-17ad-4a18-9c01-e8b486ba1d4f None admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:14.375198 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7081d35-17ad-4a18-9c01-e8b486ba1d4f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:14.375503 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7081d35-17ad-4a18-9c01-e8b486ba1d4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:14.376953 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7081d35-17ad-4a18-9c01-e8b486ba1d4f None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:14.386365 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:14.394945 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 622/1268] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Aug 24 14:23:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:14.400613 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006b722-649f-4cac-8e4b-44ab3bdec9f5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:14.500671 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006b722-649f-4cac-8e4b-44ab3bdec9f5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:14.533534 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074c237-5935-443e-b0d6-f61fd0f05ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:14.534110 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074c237-5935-443e-b0d6-f61fd0f05ffb None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:14.534392 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074c237-5935-443e-b0d6-f61fd0f05ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:14.534660 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074c237-5935-443e-b0d6-f61fd0f05ffb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:14.546206 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074c237-5935-443e-b0d6-f61fd0f05ffb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:14.549272 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074c237-5935-443e-b0d6-f61fd0f05ffb None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:14.562756 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-1074c237-5935-443e-b0d6-f61fd0f05ffb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:23:14.562756 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:14.562756 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:23:14.562756 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:23:14.562756 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:23:14.562756 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:23:14.562756 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:23:14.562756 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:23:14.562756 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:23:14.562756 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:23:14.562756 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:23:14.562756 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:23:14.562756 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:23:14.562756 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:23:14.562756 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:23:14.562756 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:23:14.563935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:23:14.563935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:23:14.563935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:23:14.563935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:23:14.563935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:23:14.563935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:23:14.563935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:23:14.563935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:23:14.563935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:23:14.563935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:23:14.563935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:23:14.563935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:23:14.563935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:23:14.563935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:23:14.563935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:23:14.563935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:23:14.563935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:23:14.565311 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:23:14.565311 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:23:14.565311 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:23:14.565311 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 647/1269] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:23:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:23:14.569935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7081d35-17ad-4a18-9c01-e8b486ba1d4f None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:14.670063 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7081d35-17ad-4a18-9c01-e8b486ba1d4f None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:14.704060 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8f3ef-493b-4182-a363-735cfbaa43aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:14.704652 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8f3ef-493b-4182-a363-735cfbaa43aa None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:14.704929 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8f3ef-493b-4182-a363-735cfbaa43aa None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:14.705201 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8f3ef-493b-4182-a363-735cfbaa43aa None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:14.705874 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8f3ef-493b-4182-a363-735cfbaa43aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:14.706161 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8f3ef-493b-4182-a363-735cfbaa43aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:14.707511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8f3ef-493b-4182-a363-735cfbaa43aa None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:14.718605 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 623/1270] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:14.724189 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074c237-5935-443e-b0d6-f61fd0f05ffb None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:14.756537 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:14.824238 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074c237-5935-443e-b0d6-f61fd0f05ffb None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:14.857442 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87365d03-58cc-4a5d-b04e-3e6e175f84d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:14.858091 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87365d03-58cc-4a5d-b04e-3e6e175f84d3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:14.858365 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87365d03-58cc-4a5d-b04e-3e6e175f84d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:14.858634 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87365d03-58cc-4a5d-b04e-3e6e175f84d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:14.865036 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87365d03-58cc-4a5d-b04e-3e6e175f84d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:14.866489 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87365d03-58cc-4a5d-b04e-3e6e175f84d3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:14.878116 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-87365d03-58cc-4a5d-b04e-3e6e175f84d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:23:14.878116 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:14.878116 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:23:14.878116 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:23:14.878116 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:23:14.878116 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:23:14.878116 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:23:14.878116 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:23:14.878116 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:23:14.878116 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:23:14.878116 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:23:14.878116 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:23:14.878116 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:23:14.878116 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:23:14.878116 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:23:14.879198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:23:14.879198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:23:14.879198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:23:14.879198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:23:14.879198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:23:14.879198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:23:14.879198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:23:14.879198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:23:14.879198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:23:14.879198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:23:14.879198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:23:14.879198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:23:14.879198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:23:14.879198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:23:14.879198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:23:14.879198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:23:14.879198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:23:14.880120 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:23:14.880120 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:23:14.880120 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:23:14.880120 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:23:14.880120 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:23:14.880120 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:23:14.880120 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:23:14.880120 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:23:14.880120 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 648/1271] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:23:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:23:14.885348 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8f3ef-493b-4182-a363-735cfbaa43aa None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:14.944734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:14.986172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8f3ef-493b-4182-a363-735cfbaa43aa None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:15.018952 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378fa844-77f3-4c6d-861e-5f167fa595fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:15.019605 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fa844-77f3-4c6d-861e-5f167fa595fd None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:15.020120 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fa844-77f3-4c6d-861e-5f167fa595fd None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:15.020576 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fa844-77f3-4c6d-861e-5f167fa595fd None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:15.021727 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378fa844-77f3-4c6d-861e-5f167fa595fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:15.022074 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378fa844-77f3-4c6d-861e-5f167fa595fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:15.024106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378fa844-77f3-4c6d-861e-5f167fa595fd None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:15.036675 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 624/1272] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:23:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:15.043812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87365d03-58cc-4a5d-b04e-3e6e175f84d3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:15.133549 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:15.142425 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87365d03-58cc-4a5d-b04e-3e6e175f84d3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:15.176619 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacc4fe-9b53-43c4-8e53-211456098193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:15.177257 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacc4fe-9b53-43c4-8e53-211456098193 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:15.177529 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacc4fe-9b53-43c4-8e53-211456098193 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:15.177817 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacc4fe-9b53-43c4-8e53-211456098193 None admin] PATH_INFO: `/v3/projects/34cce205e8ee4ae9b09bb89bc4bb081e/users/63253cd786c04d6a9d099773198aee36/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:15.179664 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feacc4fe-9b53-43c4-8e53-211456098193 None admin] RBAC: Authorizing `identity:create_grant(project_id=34cce205e8ee4ae9b09bb89bc4bb081e, user_id=63253cd786c04d6a9d099773198aee36, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:15.181411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feacc4fe-9b53-43c4-8e53-211456098193 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:15.282690 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 649/1273] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 14:23:15 2022] PUT /identity/v3/projects/34cce205e8ee4ae9b09bb89bc4bb081e/users/63253cd786c04d6a9d099773198aee36/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:23:17.181578 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005cf37-b560-4720-90fb-d6c38aae1c3f None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:17.182240 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005cf37-b560-4720-90fb-d6c38aae1c3f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:17.182390 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005cf37-b560-4720-90fb-d6c38aae1c3f None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:17.183784 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 625/1274] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:23:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:23:17.188984 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8a1f5-b6ca-4b21-85b8-8b968dcf5604 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:17.189458 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8a1f5-b6ca-4b21-85b8-8b968dcf5604 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:17.189551 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8a1f5-b6ca-4b21-85b8-8b968dcf5604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:17.207405 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d7e8a1f5-b6ca-4b21-85b8-8b968dcf5604 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:23:17.208585 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d7e8a1f5-b6ca-4b21-85b8-8b968dcf5604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:23:17.276161 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 650/1275] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:23:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:23:17.549769 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005cf37-b560-4720-90fb-d6c38aae1c3f None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:17.651495 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005cf37-b560-4720-90fb-d6c38aae1c3f None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:17.668253 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:17.684243 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf8d97-eeda-44a7-8f9b-b73e6ca422d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:17.684860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf8d97-eeda-44a7-8f9b-b73e6ca422d5 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:17.685135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf8d97-eeda-44a7-8f9b-b73e6ca422d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:17.685403 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf8d97-eeda-44a7-8f9b-b73e6ca422d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:17.695221 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf8d97-eeda-44a7-8f9b-b73e6ca422d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:23:17.700728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-13bf8d97-eeda-44a7-8f9b-b73e6ca422d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:23:17.700728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:17.700728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:23:17.700728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:23:17.700728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:23:17.700728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:23:17.700728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:23:17.700728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:23:17.700728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:23:17.700728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:23:17.700728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:23:17.700728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:23:17.700728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:23:17.700728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:23:17.700728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:23:17.700728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:23:17.702591 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:23:17.702591 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:23:17.702591 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:23:17.702591 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:23:17.702591 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:23:17.702591 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:23:17.702591 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:23:17.702591 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:23:17.702591 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:23:17.702591 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:23:17.702591 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:23:17.702591 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:23:17.702591 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:23:17.702591 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:23:17.702591 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:23:17.702591 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:23:17.703929 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:23:17.703929 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:23:17.703929 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:23:17.703929 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:23:17.703929 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:23:17.703929 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:23:17.703929 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:23:17.703929 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:23:17.703929 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:23:17.703929 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:23:17.703929 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:23:17.703929 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:23:17.703929 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 626/1276] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 14:23:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:23:17.707850 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8a1f5-b6ca-4b21-85b8-8b968dcf5604 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:17.788402 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:17.805805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8a1f5-b6ca-4b21-85b8-8b968dcf5604 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:17.840837 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666c38a-cceb-4510-8dd1-ec8909277536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:17.841481 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666c38a-cceb-4510-8dd1-ec8909277536 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:17.841775 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666c38a-cceb-4510-8dd1-ec8909277536 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:17.842064 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666c38a-cceb-4510-8dd1-ec8909277536 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:17.842728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666c38a-cceb-4510-8dd1-ec8909277536 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:17.843033 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666c38a-cceb-4510-8dd1-ec8909277536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:17.844406 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666c38a-cceb-4510-8dd1-ec8909277536 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:17.852686 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 651/1277] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 14:23:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:17.858467 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf8d97-eeda-44a7-8f9b-b73e6ca422d5 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:17.956575 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf8d97-eeda-44a7-8f9b-b73e6ca422d5 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:17.989767 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84645622-100a-467e-adde-9ed57ffbedd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:17.990395 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84645622-100a-467e-adde-9ed57ffbedd6 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:17.990669 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84645622-100a-467e-adde-9ed57ffbedd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:17.990937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84645622-100a-467e-adde-9ed57ffbedd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:18.002265 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84645622-100a-467e-adde-9ed57ffbedd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:18.003720 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84645622-100a-467e-adde-9ed57ffbedd6 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:18.018421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-84645622-100a-467e-adde-9ed57ffbedd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:23:18.018421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:18.018421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:23:18.018421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:23:18.018421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:23:18.018421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:23:18.018421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:23:18.018421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:23:18.018421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:23:18.018421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:23:18.018421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:23:18.018421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:23:18.018421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:23:18.018421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:23:18.018421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:23:18.018421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:23:18.019565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:23:18.019565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:23:18.019565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:23:18.019565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:23:18.019565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:23:18.019565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:23:18.019565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:23:18.019565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:23:18.019565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:23:18.019565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:23:18.019565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:23:18.019565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:23:18.019565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:23:18.019565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:23:18.019565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:23:18.019565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:23:18.019565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:23:18.020713 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:23:18.020713 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:23:18.020713 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:23:18.020713 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 627/1278] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:23:18.027393 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666c38a-cceb-4510-8dd1-ec8909277536 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:18.126135 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666c38a-cceb-4510-8dd1-ec8909277536 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:18.160104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfd680-2ca4-494d-b7f8-0d6267bba18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:18.160745 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfd680-2ca4-494d-b7f8-0d6267bba18b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:18.161026 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfd680-2ca4-494d-b7f8-0d6267bba18b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:18.161297 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfd680-2ca4-494d-b7f8-0d6267bba18b None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:18.161960 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfd680-2ca4-494d-b7f8-0d6267bba18b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:18.162269 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfd680-2ca4-494d-b7f8-0d6267bba18b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:18.163613 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfd680-2ca4-494d-b7f8-0d6267bba18b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:18.175184 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 652/1279] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:18.181776 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84645622-100a-467e-adde-9ed57ffbedd6 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:18.212881 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:18.281539 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84645622-100a-467e-adde-9ed57ffbedd6 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:18.316271 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4225c-8778-4636-9600-1c0ec1f2d9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:18.316912 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4225c-8778-4636-9600-1c0ec1f2d9f9 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:18.317181 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4225c-8778-4636-9600-1c0ec1f2d9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:18.317457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4225c-8778-4636-9600-1c0ec1f2d9f9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:18.325033 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4225c-8778-4636-9600-1c0ec1f2d9f9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:18.326501 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4225c-8778-4636-9600-1c0ec1f2d9f9 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:18.337390 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-14b4225c-8778-4636-9600-1c0ec1f2d9f9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 14:23:18.337390 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:18.337390 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:23:18.337390 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:23:18.337390 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:23:18.337390 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:23:18.337390 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:23:18.337390 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:23:18.337390 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:23:18.337390 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:23:18.337390 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:23:18.337390 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:23:18.337390 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:23:18.337390 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:23:18.337390 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:23:18.337390 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:23:18.338745 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:23:18.338745 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:23:18.338745 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:23:18.338745 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:23:18.338745 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:23:18.338745 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:23:18.338745 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:23:18.338745 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:23:18.338745 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:23:18.338745 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:23:18.338745 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:23:18.338745 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:23:18.338745 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:23:18.338745 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:23:18.338745 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:23:18.338745 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:23:18.338745 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:23:18.338745 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:23:18.339824 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:23:18.339824 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:23:18.339824 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:23:18.339824 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:23:18.339824 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:23:18.339824 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:23:18.339824 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:23:18.339824 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:23:18.339824 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 14:23:18.339824 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:23:18.339824 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 628/1280] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:23:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:23:18.344425 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfd680-2ca4-494d-b7f8-0d6267bba18b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:18.348284 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:18.441509 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfd680-2ca4-494d-b7f8-0d6267bba18b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:18.475369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aaff39-4c67-4046-b80f-cf496f6b73ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:18.475984 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aaff39-4c67-4046-b80f-cf496f6b73ff None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:18.476259 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aaff39-4c67-4046-b80f-cf496f6b73ff None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:18.476525 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aaff39-4c67-4046-b80f-cf496f6b73ff None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:18.477238 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aaff39-4c67-4046-b80f-cf496f6b73ff None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:18.477535 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aaff39-4c67-4046-b80f-cf496f6b73ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:18.479477 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aaff39-4c67-4046-b80f-cf496f6b73ff None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:18.496819 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 653/1281] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Aug 24 14:23:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:18.502871 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4225c-8778-4636-9600-1c0ec1f2d9f9 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:18.592402 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:18.601932 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4225c-8778-4636-9600-1c0ec1f2d9f9 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:18.637840 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942673f-75bc-401f-ac6e-64fa5f8d0f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:18.638433 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942673f-75bc-401f-ac6e-64fa5f8d0f38 None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:18.638708 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942673f-75bc-401f-ac6e-64fa5f8d0f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:18.638976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942673f-75bc-401f-ac6e-64fa5f8d0f38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:18.704472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942673f-75bc-401f-ac6e-64fa5f8d0f38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:18.705856 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942673f-75bc-401f-ac6e-64fa5f8d0f38 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:18.793391 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:18.802991 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 629/1282] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 14:23:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:23:18.809019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aaff39-4c67-4046-b80f-cf496f6b73ff None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:18.869725 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:18.906678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aaff39-4c67-4046-b80f-cf496f6b73ff None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:18.939043 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6315f-2f64-4b34-abf7-294cda06784a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:18.939663 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6315f-2f64-4b34-abf7-294cda06784a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:18.939941 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6315f-2f64-4b34-abf7-294cda06784a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:18.940210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6315f-2f64-4b34-abf7-294cda06784a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:18.949769 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6315f-2f64-4b34-abf7-294cda06784a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:18.951208 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6315f-2f64-4b34-abf7-294cda06784a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:18.965532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-00c6315f-2f64-4b34-abf7-294cda06784a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:23:18.965532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:18.965532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:23:18.965532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:23:18.965532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:23:18.965532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:23:18.965532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:23:18.965532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:23:18.965532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:23:18.965532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:23:18.965532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:23:18.965532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:23:18.965532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:23:18.965532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:23:18.965532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:23:18.965532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:23:18.966799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:23:18.966799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:23:18.966799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:23:18.966799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:23:18.966799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:23:18.966799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:23:18.966799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:23:18.966799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:23:18.966799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:23:18.966799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:23:18.966799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:23:18.966799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:23:18.966799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:23:18.966799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:23:18.966799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:23:18.966799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:23:18.966799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:23:18.968141 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:23:18.968141 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:23:18.968141 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:23:18.968141 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 654/1283] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:23:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:23:18.972355 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942673f-75bc-401f-ac6e-64fa5f8d0f38 None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:19.072865 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942673f-75bc-401f-ac6e-64fa5f8d0f38 None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:19.108507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c872eda-d572-4b35-97a0-c35aa1c25cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:19.109109 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c872eda-d572-4b35-97a0-c35aa1c25cde None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:19.109389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c872eda-d572-4b35-97a0-c35aa1c25cde None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:19.109660 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c872eda-d572-4b35-97a0-c35aa1c25cde None admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:19.110331 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c872eda-d572-4b35-97a0-c35aa1c25cde None admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:19.110635 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c872eda-d572-4b35-97a0-c35aa1c25cde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:19.111993 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c872eda-d572-4b35-97a0-c35aa1c25cde None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:19.123360 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 630/1284] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 14:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:19.129411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6315f-2f64-4b34-abf7-294cda06784a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:19.229537 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6315f-2f64-4b34-abf7-294cda06784a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:19.243183 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:19.266613 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d2c21-df5c-4883-a7bf-2f13cc67fa24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:19.267247 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d2c21-df5c-4883-a7bf-2f13cc67fa24 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:19.267524 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d2c21-df5c-4883-a7bf-2f13cc67fa24 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:19.267826 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d2c21-df5c-4883-a7bf-2f13cc67fa24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:19.274807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d2c21-df5c-4883-a7bf-2f13cc67fa24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:19.276922 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d2c21-df5c-4883-a7bf-2f13cc67fa24 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:19.288990 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-498d2c21-df5c-4883-a7bf-2f13cc67fa24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:23:19.288990 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:19.288990 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:23:19.288990 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:23:19.288990 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:23:19.288990 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:23:19.288990 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:23:19.288990 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:23:19.288990 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:23:19.288990 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:23:19.288990 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:23:19.288990 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:23:19.288990 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:23:19.288990 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:23:19.288990 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:23:19.295587 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:23:19.295587 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:23:19.295587 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:23:19.295587 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:23:19.295587 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:23:19.295587 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:23:19.295587 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:23:19.295587 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:23:19.295587 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 14:23:19.295587 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:23:19.295587 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:23:19.295587 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:23:19.295587 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:23:19.295587 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:23:19.295587 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:23:19.295587 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:23:19.295587 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:23:19.296556 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:23:19.296556 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:23:19.296556 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:23:19.296556 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:23:19.296556 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:23:19.296556 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:23:19.296556 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:23:19.296556 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 14:23:19.296556 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 655/1285] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 14:23:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:23:19.297059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c872eda-d572-4b35-97a0-c35aa1c25cde None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:19.348933 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:19.398674 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c872eda-d572-4b35-97a0-c35aa1c25cde None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:19.432103 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bf8dc-c91d-42a9-9b38-cc859f17f6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:19.432731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bf8dc-c91d-42a9-9b38-cc859f17f6bb None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:19.433009 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bf8dc-c91d-42a9-9b38-cc859f17f6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:19.433280 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bf8dc-c91d-42a9-9b38-cc859f17f6bb None admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:19.434002 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4bf8dc-c91d-42a9-9b38-cc859f17f6bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:19.434306 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4bf8dc-c91d-42a9-9b38-cc859f17f6bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:19.435729 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4bf8dc-c91d-42a9-9b38-cc859f17f6bb None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:19.448318 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 631/1286] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 14:23:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:19.454516 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d2c21-df5c-4883-a7bf-2f13cc67fa24 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:19.552225 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d2c21-df5c-4883-a7bf-2f13cc67fa24 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:19.589262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88910201-c7fb-409f-a939-194df8ed2ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:19.589880 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88910201-c7fb-409f-a939-194df8ed2ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:19.590155 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88910201-c7fb-409f-a939-194df8ed2ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:19.590421 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88910201-c7fb-409f-a939-194df8ed2ce1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:19.591140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88910201-c7fb-409f-a939-194df8ed2ce1 None admin] RBAC: Adding query filter params (role.id=b779073cee3c470ca4ad7a7b27d72c5e, scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e, user.id=63253cd786c04d6a9d099773198aee36) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:19.591444 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88910201-c7fb-409f-a939-194df8ed2ce1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:19.592858 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88910201-c7fb-409f-a939-194df8ed2ce1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:19.598718 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 656/1287] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 14:23:19 2022] GET /identity/v3/role_assignments?user.id=63253cd786c04d6a9d099773198aee36&scope.project.id=34cce205e8ee4ae9b09bb89bc4bb081e&role.id=b779073cee3c470ca4ad7a7b27d72c5e => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:23:21.555235 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddff581-1912-485c-8d00-4c55e5da24fa None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:21.555791 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddff581-1912-485c-8d00-4c55e5da24fa None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:21.555791 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddff581-1912-485c-8d00-4c55e5da24fa None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:21.557731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 632/1288] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:23:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:23:21.563058 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffbf73-1411-45fc-836e-89673590e74d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:21.563492 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffbf73-1411-45fc-836e-89673590e74d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:21.563600 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffbf73-1411-45fc-836e-89673590e74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:21.581463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-56ffbf73-1411-45fc-836e-89673590e74d None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:23:21.582677 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-56ffbf73-1411-45fc-836e-89673590e74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:23:21.612150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:21.648516 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 657/1289] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:23:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:23:21.919139 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddff581-1912-485c-8d00-4c55e5da24fa None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:22.019117 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddff581-1912-485c-8d00-4c55e5da24fa None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:22.030570 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:22.053715 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff3c79-8ce2-4fe0-88bd-9e8e871c377c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:22.054371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff3c79-8ce2-4fe0-88bd-9e8e871c377c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:22.054653 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff3c79-8ce2-4fe0-88bd-9e8e871c377c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:22.054926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff3c79-8ce2-4fe0-88bd-9e8e871c377c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:22.055524 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff3c79-8ce2-4fe0-88bd-9e8e871c377c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:22.057140 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff3c79-8ce2-4fe0-88bd-9e8e871c377c None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:22.065643 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-5eff3c79-8ce2-4fe0-88bd-9e8e871c377c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 14:23:22.065643 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:22.065643 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:23:22.065643 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:23:22.065643 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:23:22.065643 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:23:22.065643 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:23:22.065643 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:23:22.065643 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 14:23:22.065643 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:23:22.065643 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:23:22.065643 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:23:22.065643 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:22.065643 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:23:22.065643 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:23:22.065643 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:23:22.065643 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:23:22.066962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:23:22.066962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:23:22.066962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:23:22.066962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:23:22.066962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:23:22.066962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:23:22.066962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:23:22.066962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:23:22.066962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:23:22.066962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:23:22.066962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:23:22.066962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:23:22.066962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:23:22.066962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:23:22.066962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:23:22.066962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:23:22.068268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:23:22.068268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:23:22.068268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:23:22.068268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:23:22.068268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:23:22.068268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:23:22.068268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:23:22.068268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:23:22.068268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:23:22.068268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:23:22.068268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:23:22.068268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:23:22.068268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 14:23:22.068268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:23:22.068268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 633/1290] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Aug 24 14:23:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:23:22.073467 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffbf73-1411-45fc-836e-89673590e74d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:22.171573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffbf73-1411-45fc-836e-89673590e74d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:22.204547 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe2c16-a976-4ec5-bab3-7b86a22916e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:22.205140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe2c16-a976-4ec5-bab3-7b86a22916e7 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:22.205412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe2c16-a976-4ec5-bab3-7b86a22916e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:22.205677 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe2c16-a976-4ec5-bab3-7b86a22916e7 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:22.206325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe2c16-a976-4ec5-bab3-7b86a22916e7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:22.206649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe2c16-a976-4ec5-bab3-7b86a22916e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:22.208018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe2c16-a976-4ec5-bab3-7b86a22916e7 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:22.215294 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 658/1291] 10.222.0.65 () {56 vars in 1116 bytes} [Wed Aug 24 14:23:22 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:22.221274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff3c79-8ce2-4fe0-88bd-9e8e871c377c None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:22.323246 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff3c79-8ce2-4fe0-88bd-9e8e871c377c None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:22.361490 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a033bb-3a42-4721-8d1c-cb4670b5f61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:22.362172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a033bb-3a42-4721-8d1c-cb4670b5f61d None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:22.362474 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a033bb-3a42-4721-8d1c-cb4670b5f61d None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:22.362916 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a033bb-3a42-4721-8d1c-cb4670b5f61d None admin] PATH_INFO: `/v3/services` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:22.363511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a033bb-3a42-4721-8d1c-cb4670b5f61d None admin] RBAC: Adding query filter params (type=placement) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:22.363814 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a033bb-3a42-4721-8d1c-cb4670b5f61d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:22.365552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a033bb-3a42-4721-8d1c-cb4670b5f61d None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:22.370815 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 634/1292] 10.222.0.65 () {56 vars in 1116 bytes} [Wed Aug 24 14:23:22 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:24.276786 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33196b38-50c3-4e5a-bf6e-f4f4a5136e3f None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:24.277278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33196b38-50c3-4e5a-bf6e-f4f4a5136e3f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:24.277370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33196b38-50c3-4e5a-bf6e-f4f4a5136e3f None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:24.278779 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 659/1293] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:23:24.288383 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d3885-6a98-4c0e-a837-1cd6a107c991 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:24.290844 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d3885-6a98-4c0e-a837-1cd6a107c991 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:24.290844 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d3885-6a98-4c0e-a837-1cd6a107c991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:24.308081 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-1c3d3885-6a98-4c0e-a837-1cd6a107c991 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:23:24.309350 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1c3d3885-6a98-4c0e-a837-1cd6a107c991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:23:24.338867 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:24.376337 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 635/1294] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:23:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:23:24.645345 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33196b38-50c3-4e5a-bf6e-f4f4a5136e3f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:24.677438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:24.746500 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33196b38-50c3-4e5a-bf6e-f4f4a5136e3f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:24.779978 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f057dfd-8a90-44f2-8230-368c26f94596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:24.781051 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f057dfd-8a90-44f2-8230-368c26f94596 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:24.781051 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f057dfd-8a90-44f2-8230-368c26f94596 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:24.781243 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f057dfd-8a90-44f2-8230-368c26f94596 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:24.781713 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f057dfd-8a90-44f2-8230-368c26f94596 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:24.783094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f057dfd-8a90-44f2-8230-368c26f94596 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:24.894133 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 660/1295] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 14:23:24 2022] POST /identity/v3/services => generated 246 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:23:26.820649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fcb35-74e0-4cb4-af87-703f27accba7 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:26.821187 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fcb35-74e0-4cb4-af87-703f27accba7 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:26.821187 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fcb35-74e0-4cb4-af87-703f27accba7 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:26.822607 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 636/1296] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:23:26.829398 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077304bc-51b7-461a-ba28-06220f5b8225 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:26.829845 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077304bc-51b7-461a-ba28-06220f5b8225 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:26.829972 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077304bc-51b7-461a-ba28-06220f5b8225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:26.847509 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-077304bc-51b7-461a-ba28-06220f5b8225 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:23:26.848683 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-077304bc-51b7-461a-ba28-06220f5b8225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:23:26.923485 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 661/1297] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:23:26 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:23:27.191995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fcb35-74e0-4cb4-af87-703f27accba7 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:27.300289 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fcb35-74e0-4cb4-af87-703f27accba7 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:27.334194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecdb5e-63ce-46b3-b1cb-c0073461705e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:27.334815 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecdb5e-63ce-46b3-b1cb-c0073461705e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:27.335094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecdb5e-63ce-46b3-b1cb-c0073461705e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:27.335367 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecdb5e-63ce-46b3-b1cb-c0073461705e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:27.335947 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecdb5e-63ce-46b3-b1cb-c0073461705e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:27.338014 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecdb5e-63ce-46b3-b1cb-c0073461705e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:27.346629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-a0ecdb5e-63ce-46b3-b1cb-c0073461705e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 14:23:27.346629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:27.346629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:23:27.346629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:23:27.346629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:23:27.346629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:23:27.346629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:23:27.346629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:23:27.346629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 14:23:27.346629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:23:27.346629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:23:27.346629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:23:27.346629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:27.346629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:23:27.346629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:23:27.346629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:23:27.346629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:23:27.347826 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:23:27.347826 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:23:27.347826 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:23:27.347826 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:23:27.347826 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:23:27.347826 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:23:27.347826 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:23:27.347826 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:23:27.347826 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:23:27.347826 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:23:27.347826 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:23:27.347826 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:23:27.347826 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:23:27.347826 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:23:27.347826 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:23:27.347826 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:23:27.348734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:23:27.348734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:23:27.348734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:23:27.348734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:23:27.348734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:23:27.348734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:23:27.348734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:23:27.348734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:23:27.348734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:23:27.348734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:23:27.348734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:23:27.348734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:23:27.348734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 14:23:27.348734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:23:27.348734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 637/1298] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Aug 24 14:23:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:23:27.354074 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077304bc-51b7-461a-ba28-06220f5b8225 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:27.372103 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:27.451307 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077304bc-51b7-461a-ba28-06220f5b8225 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:27.486303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c5ee6-cbc4-414d-8754-542f388996d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:27.486897 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c5ee6-cbc4-414d-8754-542f388996d4 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:27.487171 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c5ee6-cbc4-414d-8754-542f388996d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:27.487436 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c5ee6-cbc4-414d-8754-542f388996d4 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:27.488057 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c5ee6-cbc4-414d-8754-542f388996d4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:27.488358 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c5ee6-cbc4-414d-8754-542f388996d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:27.489714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c5ee6-cbc4-414d-8754-542f388996d4 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:27.494841 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 662/1299] 10.222.0.65 () {56 vars in 1116 bytes} [Wed Aug 24 14:23:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:27.501083 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecdb5e-63ce-46b3-b1cb-c0073461705e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:27.533851 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:27.600551 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecdb5e-63ce-46b3-b1cb-c0073461705e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:27.633699 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd3857-dc77-4ba1-b2e6-1f9b434b8c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:27.635071 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd3857-dc77-4ba1-b2e6-1f9b434b8c7c None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:27.635384 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd3857-dc77-4ba1-b2e6-1f9b434b8c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:27.635672 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd3857-dc77-4ba1-b2e6-1f9b434b8c7c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:27.636372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd3857-dc77-4ba1-b2e6-1f9b434b8c7c None admin] RBAC: Adding query filter params (interface=public, service_id=9591b46b047044c8aab6acf1e53f7db1, region_id=RegionOne) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:27.636685 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd3857-dc77-4ba1-b2e6-1f9b434b8c7c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:27.638083 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd3857-dc77-4ba1-b2e6-1f9b434b8c7c None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:27.643216 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 638/1300] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Aug 24 14:23:27 2022] GET /identity/v3/endpoints?service_id=9591b46b047044c8aab6acf1e53f7db1&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:27.648858 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c5ee6-cbc4-414d-8754-542f388996d4 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:27.729380 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:27.746583 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c5ee6-cbc4-414d-8754-542f388996d4 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:27.779490 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874459eb-acbc-4634-bcf7-bf957bc6d776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:27.780088 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874459eb-acbc-4634-bcf7-bf957bc6d776 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:27.780364 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874459eb-acbc-4634-bcf7-bf957bc6d776 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:27.780632 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874459eb-acbc-4634-bcf7-bf957bc6d776 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:27.781226 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874459eb-acbc-4634-bcf7-bf957bc6d776 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:27.782609 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874459eb-acbc-4634-bcf7-bf957bc6d776 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:27.789167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 663/1301] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Aug 24 14:23:27 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:23:29.698351 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1b423-d960-4bfb-930e-35e71718b185 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:29.698882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1b423-d960-4bfb-930e-35e71718b185 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:29.698975 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1b423-d960-4bfb-930e-35e71718b185 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:29.700270 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 639/1302] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:23:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:23:29.706763 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e859ca-c068-496b-b4fb-379450870eae None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:29.707189 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e859ca-c068-496b-b4fb-379450870eae None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:29.707337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e859ca-c068-496b-b4fb-379450870eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:29.725903 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a6e859ca-c068-496b-b4fb-379450870eae None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:23:29.727080 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a6e859ca-c068-496b-b4fb-379450870eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:23:29.792012 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 664/1303] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:23:29 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:23:30.063580 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1b423-d960-4bfb-930e-35e71718b185 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:30.157298 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:30.163800 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1b423-d960-4bfb-930e-35e71718b185 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:30.197215 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b1d5c-1980-4282-b5e1-60b39560cf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:30.197928 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b1d5c-1980-4282-b5e1-60b39560cf5e None admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:30.198209 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b1d5c-1980-4282-b5e1-60b39560cf5e None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:30.198480 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b1d5c-1980-4282-b5e1-60b39560cf5e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:30.199058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b1d5c-1980-4282-b5e1-60b39560cf5e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:30.200416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b1d5c-1980-4282-b5e1-60b39560cf5e None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:30.209237 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application [None req-2f5b1d5c-1980-4282-b5e1-60b39560cf5e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 14:23:30.209237 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:30.209237 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:23:30.209237 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:23:30.209237 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:23:30.209237 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:23:30.209237 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:23:30.209237 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:23:30.209237 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 14:23:30.209237 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:23:30.209237 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:23:30.209237 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:23:30.209237 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:23:30.209237 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:23:30.209237 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:23:30.209237 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:23:30.209237 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:23:30.210454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:23:30.210454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:23:30.210454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:23:30.210454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:23:30.210454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:23:30.210454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:23:30.210454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:23:30.210454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:23:30.210454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:23:30.210454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:23:30.210454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:23:30.210454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:23:30.210454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:23:30.210454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:23:30.210454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:23:30.210454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:23:30.211556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:23:30.211556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application with Lock( Aug 24 14:23:30.211556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:23:30.211556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:23:30.211556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:23:30.211556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:23:30.211556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:23:30.211556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:23:30.211556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:23:30.211556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:23:30.211556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:23:30.211556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:23:30.211556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 14:23:30.211556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: ERROR keystone.server.flask.application Aug 24 14:23:30.211556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 640/1304] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Aug 24 14:23:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:23:30.218975 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e859ca-c068-496b-b4fb-379450870eae None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:30.297426 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:30.320409 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e859ca-c068-496b-b4fb-379450870eae None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:30.354089 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e767648-08bc-45b0-940b-fb6fc199e847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:30.354692 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e767648-08bc-45b0-940b-fb6fc199e847 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:30.354973 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e767648-08bc-45b0-940b-fb6fc199e847 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:30.355245 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e767648-08bc-45b0-940b-fb6fc199e847 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:30.355874 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e767648-08bc-45b0-940b-fb6fc199e847 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:23:30.356289 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e767648-08bc-45b0-940b-fb6fc199e847 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:30.357708 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e767648-08bc-45b0-940b-fb6fc199e847 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:30.362740 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 665/1305] 10.222.0.65 () {56 vars in 1116 bytes} [Wed Aug 24 14:23:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:23:30.369396 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b1d5c-1980-4282-b5e1-60b39560cf5e None admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:23:30.467974 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b1d5c-1980-4282-b5e1-60b39560cf5e None admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:23:30.501955 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8cf4b-7040-4ce7-9ac5-7165825622b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:23:30.502544 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8cf4b-7040-4ce7-9ac5-7165825622b2 None admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:23:30.502821 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8cf4b-7040-4ce7-9ac5-7165825622b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:23:30.503091 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8cf4b-7040-4ce7-9ac5-7165825622b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:23:30.503745 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8cf4b-7040-4ce7-9ac5-7165825622b2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:23:30.505239 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8cf4b-7040-4ce7-9ac5-7165825622b2 None admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:23:30.603359 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 641/1306] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:23:30 2022] POST /identity/v3/endpoints => generated 331 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:23:40.425938 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=30 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:23:40.598042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:29:39.852103 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516a191-4d53-4099-a551-c39c9b197db3 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:29:39.853087 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516a191-4d53-4099-a551-c39c9b197db3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:29:39.853592 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516a191-4d53-4099-a551-c39c9b197db3 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:29:39.855197 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 666/1307] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:29:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:29:39.861039 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcef02-f913-4c53-9343-c9d80bde8514 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:29:39.861943 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcef02-f913-4c53-9343-c9d80bde8514 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:29:39.862435 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcef02-f913-4c53-9343-c9d80bde8514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:29:39.955284 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-89fcef02-f913-4c53-9343-c9d80bde8514 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:29:39.955284 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-89fcef02-f913-4c53-9343-c9d80bde8514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:29:40.166450 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 642/1308] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:29:40.465045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a1dca-a077-4901-81df-5398f2ace336 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:29:40.465325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a1dca-a077-4901-81df-5398f2ace336 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:29:40.465871 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a1dca-a077-4901-81df-5398f2ace336 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:29:40.467297 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 667/1309] 10.222.0.65 () {54 vars in 965 bytes} [Wed Aug 24 14:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:29:40.473905 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a69c1-17a9-4f15-b586-6fec240dc3df None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:29:40.474322 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a69c1-17a9-4f15-b586-6fec240dc3df None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:29:40.474714 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a69c1-17a9-4f15-b586-6fec240dc3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:29:40.563322 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-da1a69c1-17a9-4f15-b586-6fec240dc3df None None] MFA Rules not processed for user `cb5021b569db41a08218cbec928442af`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:29:40.564632 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-da1a69c1-17a9-4f15-b586-6fec240dc3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:29:40.587425 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:29:40.650783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 643/1310] 10.222.0.65 () {58 vars in 1062 bytes} [Wed Aug 24 14:29:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:29:40.659993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a1dca-a077-4901-81df-5398f2ace336 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:29:40.662053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ec3a1dca-a077-4901-81df-5398f2ace336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:29:40.786495 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a1dca-a077-4901-81df-5398f2ace336 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:29:40.864924 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a0b42-7339-4876-881e-d813416df2bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:29:40.865570 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a0b42-7339-4876-881e-d813416df2bb service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:29:40.865655 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a0b42-7339-4876-881e-d813416df2bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:29:40.865981 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a0b42-7339-4876-881e-d813416df2bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:29:40.867904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7b4a0b42-7339-4876-881e-d813416df2bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:29:40.927460 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:29:40.986336 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a0b42-7339-4876-881e-d813416df2bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:29:40.987792 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a0b42-7339-4876-881e-d813416df2bb service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:29:41.007107 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 668/1311] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:29:43.243178 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a539e5-26f8-4540-8c1d-620408f53de7 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:29:43.243178 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a539e5-26f8-4540-8c1d-620408f53de7 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:29:43.243817 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a539e5-26f8-4540-8c1d-620408f53de7 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:29:43.244676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 644/1312] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:29:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:29:43.250347 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872d60a-77e4-4446-9b23-9e0d6bf937a5 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:29:43.250768 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872d60a-77e4-4446-9b23-9e0d6bf937a5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:29:43.250892 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872d60a-77e4-4446-9b23-9e0d6bf937a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:29:43.333132 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-9872d60a-77e4-4446-9b23-9e0d6bf937a5 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:29:43.334381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9872d60a-77e4-4446-9b23-9e0d6bf937a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:29:43.429963 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 669/1313] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:29:43.730866 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a539e5-26f8-4540-8c1d-620408f53de7 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:29:43.732430 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f3a539e5-26f8-4540-8c1d-620408f53de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:29:43.834221 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a539e5-26f8-4540-8c1d-620408f53de7 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:29:43.905983 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:29:43.908614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f870d-e9b9-49ec-b5d9-3e4c7075d443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:29:43.909211 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f870d-e9b9-49ec-b5d9-3e4c7075d443 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:29:43.909485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f870d-e9b9-49ec-b5d9-3e4c7075d443 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:29:43.909779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f870d-e9b9-49ec-b5d9-3e4c7075d443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:29:43.911426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-5e7f870d-e9b9-49ec-b5d9-3e4c7075d443 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:29:44.019462 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f870d-e9b9-49ec-b5d9-3e4c7075d443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:29:44.020800 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f870d-e9b9-49ec-b5d9-3e4c7075d443 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:29:44.039939 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 645/1314] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:29:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:29:46.419891 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0e336-79a4-4c81-9053-4c9a5e0ce392 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:29:46.420443 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0e336-79a4-4c81-9053-4c9a5e0ce392 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:29:46.420443 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0e336-79a4-4c81-9053-4c9a5e0ce392 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:29:46.421801 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 670/1315] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:29:46.427008 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249df4b2-7685-413e-82ea-f79b7f31ae71 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:29:46.427443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249df4b2-7685-413e-82ea-f79b7f31ae71 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:29:46.427554 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249df4b2-7685-413e-82ea-f79b7f31ae71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:29:46.493999 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-249df4b2-7685-413e-82ea-f79b7f31ae71 None None] MFA Rules not processed for user `26be6d4d0994465aa60353e2ce00c1d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:29:46.495138 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-249df4b2-7685-413e-82ea-f79b7f31ae71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:29:46.545598 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:29:46.589386 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 646/1316] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:29:46 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:29:46.880781 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0e336-79a4-4c81-9053-4c9a5e0ce392 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:29:46.882377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d4d0e336-79a4-4c81-9053-4c9a5e0ce392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:29:46.892021 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:29:46.986342 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0e336-79a4-4c81-9053-4c9a5e0ce392 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:29:47.057766 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d293e57-d184-4a61-8c32-6e13409385e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:29:47.058431 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d293e57-d184-4a61-8c32-6e13409385e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:29:47.058708 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d293e57-d184-4a61-8c32-6e13409385e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:29:47.058981 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d293e57-d184-4a61-8c32-6e13409385e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:29:47.060570 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8d293e57-d184-4a61-8c32-6e13409385e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:29:47.123302 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:29:47.169485 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d293e57-d184-4a61-8c32-6e13409385e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:29:47.170878 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d293e57-d184-4a61-8c32-6e13409385e6 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:29:47.188318 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 671/1317] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:29:46 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:29:49.871281 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764612e2-fb6b-49b1-a00d-827739ecba1c None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:29:49.872072 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764612e2-fb6b-49b1-a00d-827739ecba1c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:29:49.872072 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764612e2-fb6b-49b1-a00d-827739ecba1c None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:29:49.873432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 647/1318] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:29:49.878545 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83722c15-7a46-4f84-a5e8-e128262d0915 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:29:49.878993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83722c15-7a46-4f84-a5e8-e128262d0915 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:29:49.879122 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83722c15-7a46-4f84-a5e8-e128262d0915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:29:49.944326 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-83722c15-7a46-4f84-a5e8-e128262d0915 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:29:49.945789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-83722c15-7a46-4f84-a5e8-e128262d0915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:29:50.040611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 672/1319] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:29:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:29:50.326811 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764612e2-fb6b-49b1-a00d-827739ecba1c None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:29:50.328362 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-764612e2-fb6b-49b1-a00d-827739ecba1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:29:50.430724 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764612e2-fb6b-49b1-a00d-827739ecba1c None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:29:50.503767 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bd2db-a431-49c2-880c-93ccae8a115d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:29:50.504357 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bd2db-a431-49c2-880c-93ccae8a115d service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:29:50.504632 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bd2db-a431-49c2-880c-93ccae8a115d service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:29:50.504903 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bd2db-a431-49c2-880c-93ccae8a115d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:29:50.506518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-5f1bd2db-a431-49c2-880c-93ccae8a115d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:29:50.514716 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:29:50.614356 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1bd2db-a431-49c2-880c-93ccae8a115d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:29:50.615768 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1bd2db-a431-49c2-880c-93ccae8a115d service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:29:50.634502 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 648/1320] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:29:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:29:53.536083 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e6d2a-dc7d-4346-974e-fb557afd4fca None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:29:53.536602 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e6d2a-dc7d-4346-974e-fb557afd4fca None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:29:53.536711 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e6d2a-dc7d-4346-974e-fb557afd4fca None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:29:53.538044 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 673/1321] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:29:53.544105 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29879a1f-df3a-4d92-91ca-3e30e18bbc46 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:29:53.544528 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29879a1f-df3a-4d92-91ca-3e30e18bbc46 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:29:53.544674 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29879a1f-df3a-4d92-91ca-3e30e18bbc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:29:53.610401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-29879a1f-df3a-4d92-91ca-3e30e18bbc46 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:29:53.611610 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-29879a1f-df3a-4d92-91ca-3e30e18bbc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:29:53.669664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:29:53.709100 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 649/1322] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:29:53.997603 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e6d2a-dc7d-4346-974e-fb557afd4fca None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:29:53.999207 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f29e6d2a-dc7d-4346-974e-fb557afd4fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:29:54.020258 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:29:54.109157 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e6d2a-dc7d-4346-974e-fb557afd4fca None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:29:54.184008 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50a65d-af42-432e-8a6e-d6ef53712cfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:29:54.184604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50a65d-af42-432e-8a6e-d6ef53712cfb service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:29:54.184876 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50a65d-af42-432e-8a6e-d6ef53712cfb service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:29:54.185144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50a65d-af42-432e-8a6e-d6ef53712cfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:29:54.186762 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fc50a65d-af42-432e-8a6e-d6ef53712cfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:29:54.262074 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:29:54.299362 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50a65d-af42-432e-8a6e-d6ef53712cfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:29:54.300780 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50a65d-af42-432e-8a6e-d6ef53712cfb service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:29:54.321221 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 674/1323] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:29:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:29:56.292968 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03926e-a2cc-449e-90b8-73573e7e4259 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:29:56.293511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03926e-a2cc-449e-90b8-73573e7e4259 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:29:56.293511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03926e-a2cc-449e-90b8-73573e7e4259 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:29:56.294917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 650/1324] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:29:56.300438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b663e-c03d-4dbb-9018-2ab49d46e71c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:29:56.300943 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b663e-c03d-4dbb-9018-2ab49d46e71c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:29:56.301044 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b663e-c03d-4dbb-9018-2ab49d46e71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:29:56.366266 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e41b663e-c03d-4dbb-9018-2ab49d46e71c None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:29:56.368021 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e41b663e-c03d-4dbb-9018-2ab49d46e71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:29:56.463643 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 675/1325] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:29:56.746767 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03926e-a2cc-449e-90b8-73573e7e4259 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:29:56.748315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1f03926e-a2cc-449e-90b8-73573e7e4259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:29:56.857651 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03926e-a2cc-449e-90b8-73573e7e4259 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:29:56.931866 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ddb08-f27f-48f7-9c1d-147a8da21bb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:29:56.932471 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ddb08-f27f-48f7-9c1d-147a8da21bb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:29:56.932745 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ddb08-f27f-48f7-9c1d-147a8da21bb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:29:56.933013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ddb08-f27f-48f7-9c1d-147a8da21bb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:29:56.934643 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-bd8ddb08-f27f-48f7-9c1d-147a8da21bb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:29:56.952033 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:29:57.055766 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ddb08-f27f-48f7-9c1d-147a8da21bb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:29:57.057199 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ddb08-f27f-48f7-9c1d-147a8da21bb7 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:29:57.076154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 651/1326] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:29:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:29:59.030029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed974d-70fe-4230-8ee8-50041642b8bc None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:29:59.030580 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed974d-70fe-4230-8ee8-50041642b8bc None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:29:59.030675 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed974d-70fe-4230-8ee8-50041642b8bc None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:29:59.031999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 676/1327] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:29:59.037233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdbdd1-a4bf-4408-9cbe-37561ac8bab9 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:29:59.037709 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdbdd1-a4bf-4408-9cbe-37561ac8bab9 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:29:59.037827 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdbdd1-a4bf-4408-9cbe-37561ac8bab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:29:59.107288 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-b2bdbdd1-a4bf-4408-9cbe-37561ac8bab9 None None] MFA Rules not processed for user `26be6d4d0994465aa60353e2ce00c1d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:29:59.108451 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b2bdbdd1-a4bf-4408-9cbe-37561ac8bab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:29:59.177195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:29:59.214559 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 652/1328] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:29:59 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:29:59.502504 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed974d-70fe-4230-8ee8-50041642b8bc None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:29:59.504083 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-89ed974d-70fe-4230-8ee8-50041642b8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:29:59.534945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:29:59.632693 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed974d-70fe-4230-8ee8-50041642b8bc None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:29:59.712667 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99621c67-859f-428f-b9b6-601a67e00e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:29:59.713278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99621c67-859f-428f-b9b6-601a67e00e02 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:29:59.713553 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99621c67-859f-428f-b9b6-601a67e00e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:29:59.713888 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99621c67-859f-428f-b9b6-601a67e00e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:29:59.715470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-99621c67-859f-428f-b9b6-601a67e00e02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:29:59.792019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:29:59.824494 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99621c67-859f-428f-b9b6-601a67e00e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:29:59.825986 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99621c67-859f-428f-b9b6-601a67e00e02 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:29:59.844730 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 677/1329] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:29:59 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:30:02.114466 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f8e20-24c6-4daa-91ad-5abc589acb5c None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:02.115008 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f8e20-24c6-4daa-91ad-5abc589acb5c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:02.115008 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f8e20-24c6-4daa-91ad-5abc589acb5c None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:02.116358 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 653/1330] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:30:02.122019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059a202-863f-477a-ae10-a30bf2e63008 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:02.122425 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059a202-863f-477a-ae10-a30bf2e63008 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:02.122581 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059a202-863f-477a-ae10-a30bf2e63008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:02.190820 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d059a202-863f-477a-ae10-a30bf2e63008 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:30:02.192052 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d059a202-863f-477a-ae10-a30bf2e63008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:02.287968 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 678/1331] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:30:02.571713 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f8e20-24c6-4daa-91ad-5abc589acb5c None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:30:02.573250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a57f8e20-24c6-4daa-91ad-5abc589acb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:02.675087 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f8e20-24c6-4daa-91ad-5abc589acb5c None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:30:02.747424 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218cda9-7bf1-4535-9afb-711447adbe9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:30:02.748010 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218cda9-7bf1-4535-9afb-711447adbe9d service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:02.748284 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218cda9-7bf1-4535-9afb-711447adbe9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:02.748561 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218cda9-7bf1-4535-9afb-711447adbe9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:02.750140 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e218cda9-7bf1-4535-9afb-711447adbe9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:02.778566 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:02.871772 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218cda9-7bf1-4535-9afb-711447adbe9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:30:02.873185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218cda9-7bf1-4535-9afb-711447adbe9d service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:30:02.892112 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 654/1332] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:30:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:30:04.873423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6cae2-7eb2-4bcd-8992-d7a316a80b3a None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:04.873992 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6cae2-7eb2-4bcd-8992-d7a316a80b3a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:04.873992 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6cae2-7eb2-4bcd-8992-d7a316a80b3a None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:04.875386 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 679/1333] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:30:04.880547 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aac185-284d-4b3f-814b-dac94d5d95b2 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:04.880994 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aac185-284d-4b3f-814b-dac94d5d95b2 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:04.881106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aac185-284d-4b3f-814b-dac94d5d95b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:04.948749 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-d6aac185-284d-4b3f-814b-dac94d5d95b2 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:30:04.949993 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d6aac185-284d-4b3f-814b-dac94d5d95b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:05.022927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:05.045222 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 655/1334] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:30:05.341961 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6cae2-7eb2-4bcd-8992-d7a316a80b3a None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:30:05.343589 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5ac6cae2-7eb2-4bcd-8992-d7a316a80b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:05.383682 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:05.446528 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6cae2-7eb2-4bcd-8992-d7a316a80b3a None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:30:05.517807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2eb98a-35c6-49ad-907f-7160d91ae2c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:30:05.518331 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2eb98a-35c6-49ad-907f-7160d91ae2c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:05.518604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2eb98a-35c6-49ad-907f-7160d91ae2c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:05.518871 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2eb98a-35c6-49ad-907f-7160d91ae2c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:05.520441 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5a2eb98a-35c6-49ad-907f-7160d91ae2c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:05.600642 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:05.626317 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2eb98a-35c6-49ad-907f-7160d91ae2c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:30:05.627736 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2eb98a-35c6-49ad-907f-7160d91ae2c7 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:30:05.645390 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 680/1335] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:30:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:30:08.190916 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d76b7-8fe6-4c2b-877a-1ac48e4a71ad None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:08.191483 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d76b7-8fe6-4c2b-877a-1ac48e4a71ad None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:08.191483 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d76b7-8fe6-4c2b-877a-1ac48e4a71ad None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:08.192802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 656/1336] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:30:08.198348 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be5f4f-e0d2-44c4-9af9-508e8a8cd71f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:08.198805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be5f4f-e0d2-44c4-9af9-508e8a8cd71f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:08.198935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be5f4f-e0d2-44c4-9af9-508e8a8cd71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:08.265734 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f5be5f4f-e0d2-44c4-9af9-508e8a8cd71f None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:30:08.266948 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f5be5f4f-e0d2-44c4-9af9-508e8a8cd71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:08.363466 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 681/1337] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:30:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:30:08.663394 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0afc61-2bb7-4290-9c73-b30f14d502d4 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:08.663675 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0afc61-2bb7-4290-9c73-b30f14d502d4 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:08.664669 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0afc61-2bb7-4290-9c73-b30f14d502d4 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:08.666337 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 657/1338] 10.222.0.65 () {54 vars in 965 bytes} [Wed Aug 24 14:30:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:30:08.672319 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f3685-e3db-4a67-beca-4e6ad4232c4c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:08.672609 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f3685-e3db-4a67-beca-4e6ad4232c4c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:08.672885 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f3685-e3db-4a67-beca-4e6ad4232c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:08.725853 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:08.747797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-209f3685-e3db-4a67-beca-4e6ad4232c4c None None] MFA Rules not processed for user `cb5021b569db41a08218cbec928442af`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:30:08.749004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-209f3685-e3db-4a67-beca-4e6ad4232c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:08.823908 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 682/1339] 10.222.0.65 () {58 vars in 1062 bytes} [Wed Aug 24 14:30:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:30:08.833019 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0afc61-2bb7-4290-9c73-b30f14d502d4 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:30:08.834789 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-5d0afc61-2bb7-4290-9c73-b30f14d502d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:08.939749 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0afc61-2bb7-4290-9c73-b30f14d502d4 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:30:09.014165 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966a6fc-5382-4900-9812-5b14243efd7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:30:09.014761 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966a6fc-5382-4900-9812-5b14243efd7f service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:09.015035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966a6fc-5382-4900-9812-5b14243efd7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:09.015301 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966a6fc-5382-4900-9812-5b14243efd7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:09.016976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2966a6fc-5382-4900-9812-5b14243efd7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:09.053550 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:09.128391 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966a6fc-5382-4900-9812-5b14243efd7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:30:09.129870 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966a6fc-5382-4900-9812-5b14243efd7f service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:30:09.149093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 658/1340] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:30:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:30:13.875171 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99b849-07fa-4961-b8e9-4778e9aa63d1 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:13.875795 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99b849-07fa-4961-b8e9-4778e9aa63d1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:13.875795 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99b849-07fa-4961-b8e9-4778e9aa63d1 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:13.877137 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 683/1341] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:30:13.883159 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dfe55-96ea-4839-bbe5-995344d320be None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:13.883659 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dfe55-96ea-4839-bbe5-995344d320be None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:13.883837 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dfe55-96ea-4839-bbe5-995344d320be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:13.954345 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-718dfe55-96ea-4839-bbe5-995344d320be None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:30:13.955565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-718dfe55-96ea-4839-bbe5-995344d320be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:14.043382 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:14.060623 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 659/1342] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:30:14.343139 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99b849-07fa-4961-b8e9-4778e9aa63d1 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:30:14.344844 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1d99b849-07fa-4961-b8e9-4778e9aa63d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:14.451880 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99b849-07fa-4961-b8e9-4778e9aa63d1 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:30:14.491446 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:14.527627 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfdd4c-722b-4255-bb6a-fafed3a05316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:30:14.528444 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfdd4c-722b-4255-bb6a-fafed3a05316 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:14.528945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfdd4c-722b-4255-bb6a-fafed3a05316 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:14.529362 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfdd4c-722b-4255-bb6a-fafed3a05316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:14.531432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fbdfdd4c-722b-4255-bb6a-fafed3a05316 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:14.641857 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdfdd4c-722b-4255-bb6a-fafed3a05316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:30:14.643218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdfdd4c-722b-4255-bb6a-fafed3a05316 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:30:14.662341 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 684/1343] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:30:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:30:17.618982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c7977-5a9f-48ff-8c08-9b7f8fe66143 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:17.619538 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c7977-5a9f-48ff-8c08-9b7f8fe66143 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:17.619538 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c7977-5a9f-48ff-8c08-9b7f8fe66143 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:17.620877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 660/1344] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:30:17.626391 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d56c5-964f-4a61-8e8d-04bd4ece1197 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:17.626810 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d56c5-964f-4a61-8e8d-04bd4ece1197 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:17.627061 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d56c5-964f-4a61-8e8d-04bd4ece1197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:17.697097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ab1d56c5-964f-4a61-8e8d-04bd4ece1197 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:30:17.698339 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ab1d56c5-964f-4a61-8e8d-04bd4ece1197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:17.716497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:17.795426 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 685/1345] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:30:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:30:18.082412 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c7977-5a9f-48ff-8c08-9b7f8fe66143 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:30:18.083968 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-583c7977-5a9f-48ff-8c08-9b7f8fe66143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:18.198784 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c7977-5a9f-48ff-8c08-9b7f8fe66143 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:30:18.277834 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e7244-434f-41e1-a50a-eb5145a3883b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:30:18.278432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e7244-434f-41e1-a50a-eb5145a3883b service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:18.278706 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e7244-434f-41e1-a50a-eb5145a3883b service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:18.278973 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e7244-434f-41e1-a50a-eb5145a3883b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:18.280550 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-080e7244-434f-41e1-a50a-eb5145a3883b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:18.326730 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:18.397642 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e7244-434f-41e1-a50a-eb5145a3883b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:30:18.399545 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e7244-434f-41e1-a50a-eb5145a3883b service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:30:18.419548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 661/1346] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:30:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:30:22.837563 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8979390-7ae4-44a0-86a4-f3963f5b9137 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:22.838041 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8979390-7ae4-44a0-86a4-f3963f5b9137 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:22.838132 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8979390-7ae4-44a0-86a4-f3963f5b9137 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:22.839484 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 686/1347] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:30:22.845337 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351edc5-798d-406a-809d-399651b38392 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:22.845860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351edc5-798d-406a-809d-399651b38392 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:22.846010 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351edc5-798d-406a-809d-399651b38392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:22.920073 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-f351edc5-798d-406a-809d-399651b38392 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:30:22.921339 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f351edc5-798d-406a-809d-399651b38392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:23.023991 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:23.026968 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 662/1348] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:30:23.315111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8979390-7ae4-44a0-86a4-f3963f5b9137 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:30:23.316955 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b8979390-7ae4-44a0-86a4-f3963f5b9137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:23.439273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8979390-7ae4-44a0-86a4-f3963f5b9137 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:30:23.493950 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:23.522770 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df361537-92ba-403a-9ac3-9ca5904029b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:30:23.523699 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df361537-92ba-403a-9ac3-9ca5904029b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:23.523972 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df361537-92ba-403a-9ac3-9ca5904029b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:23.524239 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df361537-92ba-403a-9ac3-9ca5904029b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:23.525858 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-df361537-92ba-403a-9ac3-9ca5904029b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:23.637301 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df361537-92ba-403a-9ac3-9ca5904029b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:30:23.638836 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df361537-92ba-403a-9ac3-9ca5904029b2 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:30:23.657580 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 687/1349] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:30:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:30:29.038952 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab304f2-5f7c-4aff-8c21-7e09a02ae0f9 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:29.039437 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab304f2-5f7c-4aff-8c21-7e09a02ae0f9 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:29.039540 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab304f2-5f7c-4aff-8c21-7e09a02ae0f9 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:29.041371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 663/1350] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 14:30:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:30:29.046783 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f62950-94c6-432a-8ffb-6e43c56b5691 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:29.047238 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f62950-94c6-432a-8ffb-6e43c56b5691 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:29.047321 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f62950-94c6-432a-8ffb-6e43c56b5691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:29.150116 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-96f62950-94c6-432a-8ffb-6e43c56b5691 None None] MFA Rules not processed for user `63253cd786c04d6a9d099773198aee36`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:30:29.152188 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-96f62950-94c6-432a-8ffb-6e43c56b5691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:29.222310 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:29.370407 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 688/1351] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 14:30:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:30:34.321097 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf3039-2756-49ea-9a50-4c88999fa04b None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:34.321623 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf3039-2756-49ea-9a50-4c88999fa04b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:34.321985 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf3039-2756-49ea-9a50-4c88999fa04b None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:34.324024 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 664/1352] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 14:30:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:30:34.329833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2c416-52c4-4250-bd37-b6871840e793 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:34.330308 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2c416-52c4-4250-bd37-b6871840e793 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:34.330432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2c416-52c4-4250-bd37-b6871840e793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:34.441367 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-6aa2c416-52c4-4250-bd37-b6871840e793 None None] MFA Rules not processed for user `63253cd786c04d6a9d099773198aee36`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:30:34.443129 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6aa2c416-52c4-4250-bd37-b6871840e793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:34.551985 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:34.587466 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 689/1353] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 14:30:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:30:36.015183 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265c43d-7ca7-47d0-875e-6c6b6ac8d3d7 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:36.015705 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265c43d-7ca7-47d0-875e-6c6b6ac8d3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:36.015705 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265c43d-7ca7-47d0-875e-6c6b6ac8d3d7 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:36.017107 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 665/1354] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 14:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:30:36.022709 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83032814-49ac-4130-b9fc-9325bae27444 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:36.023158 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83032814-49ac-4130-b9fc-9325bae27444 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:36.023240 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83032814-49ac-4130-b9fc-9325bae27444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:36.108828 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-83032814-49ac-4130-b9fc-9325bae27444 None None] MFA Rules not processed for user `63253cd786c04d6a9d099773198aee36`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:30:36.110093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-83032814-49ac-4130-b9fc-9325bae27444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:36.227981 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 690/1355] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 14:30:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:30:39.268253 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b6c2e-375d-4265-bb8f-10410225cac9 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:39.268738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b6c2e-375d-4265-bb8f-10410225cac9 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:39.268861 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b6c2e-375d-4265-bb8f-10410225cac9 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:39.270436 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 666/1356] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:30:39.275625 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f1633-1ab6-4a0a-8f8f-33e922f4cd52 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:39.276390 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f1633-1ab6-4a0a-8f8f-33e922f4cd52 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:39.276668 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f1633-1ab6-4a0a-8f8f-33e922f4cd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:39.315929 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:39.349072 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-475f1633-1ab6-4a0a-8f8f-33e922f4cd52 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:30:39.350362 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-475f1633-1ab6-4a0a-8f8f-33e922f4cd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:39.482269 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 691/1357] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:30:39.795025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79774a5a-84a0-4c84-b6c3-bd04361b6a8d None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:39.795650 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79774a5a-84a0-4c84-b6c3-bd04361b6a8d None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:39.796098 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79774a5a-84a0-4c84-b6c3-bd04361b6a8d None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:39.798016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 667/1358] 10.222.0.65 () {54 vars in 962 bytes} [Wed Aug 24 14:30:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:30:39.808113 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472a7e2-8fdb-4f45-b3a6-f5e1e2b79259 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:39.808627 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472a7e2-8fdb-4f45-b3a6-f5e1e2b79259 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:39.812300 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472a7e2-8fdb-4f45-b3a6-f5e1e2b79259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:39.897071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-6472a7e2-8fdb-4f45-b3a6-f5e1e2b79259 None None] MFA Rules not processed for user `8d099678d6454f7eb494892a69feaf62`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:30:39.899145 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6472a7e2-8fdb-4f45-b3a6-f5e1e2b79259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:39.952489 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:40.024019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 692/1359] 10.222.0.65 () {58 vars in 1059 bytes} [Wed Aug 24 14:30:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:30:40.031729 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79774a5a-84a0-4c84-b6c3-bd04361b6a8d None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:30:40.033230 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-79774a5a-84a0-4c84-b6c3-bd04361b6a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:40.191948 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79774a5a-84a0-4c84-b6c3-bd04361b6a8d None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:30:40.276013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:40.328130 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bced629-2176-4e98-b15c-ac3d561cb1b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:30:40.328920 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bced629-2176-4e98-b15c-ac3d561cb1b2 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:40.329205 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bced629-2176-4e98-b15c-ac3d561cb1b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:40.329477 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bced629-2176-4e98-b15c-ac3d561cb1b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:40.331194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0bced629-2176-4e98-b15c-ac3d561cb1b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:40.433396 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bced629-2176-4e98-b15c-ac3d561cb1b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:30:40.435087 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bced629-2176-4e98-b15c-ac3d561cb1b2 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:30:40.454346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 668/1360] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:30:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:30:42.627875 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86dd550-09dc-45a1-94db-cddc658e8e16 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:42.628377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86dd550-09dc-45a1-94db-cddc658e8e16 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:42.628377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86dd550-09dc-45a1-94db-cddc658e8e16 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:42.629882 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 693/1361] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:30:42.635720 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a2141-187f-4608-bd06-e9009a9cf42b None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:42.636172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a2141-187f-4608-bd06-e9009a9cf42b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:42.636253 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a2141-187f-4608-bd06-e9009a9cf42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:42.705204 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-0f1a2141-187f-4608-bd06-e9009a9cf42b None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:30:42.706433 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0f1a2141-187f-4608-bd06-e9009a9cf42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:42.748074 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:42.816330 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 669/1362] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:30:43.119783 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86dd550-09dc-45a1-94db-cddc658e8e16 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:30:43.121565 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f86dd550-09dc-45a1-94db-cddc658e8e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:43.324386 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86dd550-09dc-45a1-94db-cddc658e8e16 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:30:43.334715 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:43.448648 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91cbdca-d44f-40a5-9477-5cf2d334138b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:30:43.449281 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cbdca-d44f-40a5-9477-5cf2d334138b service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:43.449564 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cbdca-d44f-40a5-9477-5cf2d334138b service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:43.449867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cbdca-d44f-40a5-9477-5cf2d334138b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:43.451501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d91cbdca-d44f-40a5-9477-5cf2d334138b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:43.545778 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91cbdca-d44f-40a5-9477-5cf2d334138b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:30:43.547433 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91cbdca-d44f-40a5-9477-5cf2d334138b service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:30:43.567244 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 694/1363] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:30:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:30:46.027046 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf833e-252b-4ee6-b15f-1f04e0eedf4b None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:46.027650 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf833e-252b-4ee6-b15f-1f04e0eedf4b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:46.027650 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf833e-252b-4ee6-b15f-1f04e0eedf4b None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:46.029169 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 670/1364] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:30:46.034688 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8bc87-3f28-4102-88e9-d629306444bd None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:46.035496 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8bc87-3f28-4102-88e9-d629306444bd None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:46.035944 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8bc87-3f28-4102-88e9-d629306444bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:46.051901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:46.105488 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-46c8bc87-3f28-4102-88e9-d629306444bd None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:30:46.106735 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-46c8bc87-3f28-4102-88e9-d629306444bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:46.207669 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 695/1365] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:30:46.504342 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bf15c-bc1b-48a5-ae01-f44e9f15ffb9 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:46.504627 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bf15c-bc1b-48a5-ae01-f44e9f15ffb9 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:46.505097 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bf15c-bc1b-48a5-ae01-f44e9f15ffb9 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:46.506540 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 671/1366] 10.222.0.65 () {54 vars in 962 bytes} [Wed Aug 24 14:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:30:46.513295 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dac1fd-d8cf-475f-8027-6e428e4fc1fb None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:46.513581 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dac1fd-d8cf-475f-8027-6e428e4fc1fb None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:46.513875 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dac1fd-d8cf-475f-8027-6e428e4fc1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:46.595556 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-06dac1fd-d8cf-475f-8027-6e428e4fc1fb None None] MFA Rules not processed for user `8d099678d6454f7eb494892a69feaf62`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:30:46.596764 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-06dac1fd-d8cf-475f-8027-6e428e4fc1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:46.633830 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:46.729361 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 696/1367] 10.222.0.65 () {58 vars in 1059 bytes} [Wed Aug 24 14:30:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:30:46.738374 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3bf15c-bc1b-48a5-ae01-f44e9f15ffb9 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:30:46.740233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-8a3bf15c-bc1b-48a5-ae01-f44e9f15ffb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:46.902886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3bf15c-bc1b-48a5-ae01-f44e9f15ffb9 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:30:46.927266 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:47.027336 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586fe86-2017-45d2-a696-1d8e2168607e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:30:47.028007 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586fe86-2017-45d2-a696-1d8e2168607e service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:47.028113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586fe86-2017-45d2-a696-1d8e2168607e service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:47.028373 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586fe86-2017-45d2-a696-1d8e2168607e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:47.029965 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4586fe86-2017-45d2-a696-1d8e2168607e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:47.121572 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586fe86-2017-45d2-a696-1d8e2168607e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:30:47.123189 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586fe86-2017-45d2-a696-1d8e2168607e service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:30:47.141836 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 672/1368] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:30:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:30:47.781266 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8566742-7a8b-483d-b670-da1bd0846748 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:47.781870 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8566742-7a8b-483d-b670-da1bd0846748 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:47.781870 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8566742-7a8b-483d-b670-da1bd0846748 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:47.783391 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 697/1369] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:30:47.789305 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65ce16-d84b-4c1e-9be1-62d0fa2ca7a2 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:47.789600 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65ce16-d84b-4c1e-9be1-62d0fa2ca7a2 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:47.789922 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65ce16-d84b-4c1e-9be1-62d0fa2ca7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:47.823337 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:47.861026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-bc65ce16-d84b-4c1e-9be1-62d0fa2ca7a2 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:30:47.862255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-bc65ce16-d84b-4c1e-9be1-62d0fa2ca7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:47.964178 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 673/1370] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:30:48.559459 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937947ac-d870-4cdd-9db0-8cba4cc9f8d7 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:48.559459 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937947ac-d870-4cdd-9db0-8cba4cc9f8d7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:48.559459 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937947ac-d870-4cdd-9db0-8cba4cc9f8d7 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:48.562179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 698/1371] 10.222.0.65 () {54 vars in 964 bytes} [Wed Aug 24 14:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:30:48.565155 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ec0df-06d3-4b4b-b151-820eae2be66c None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:48.565632 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ec0df-06d3-4b4b-b151-820eae2be66c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:48.565872 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ec0df-06d3-4b4b-b151-820eae2be66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:48.644001 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ba6ec0df-06d3-4b4b-b151-820eae2be66c None None] MFA Rules not processed for user `d03ddcf4bcc24f86be508345ad63ab5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:30:48.645295 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ba6ec0df-06d3-4b4b-b151-820eae2be66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:48.693428 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:48.725984 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 674/1372] 10.222.0.65 () {58 vars in 1061 bytes} [Wed Aug 24 14:30:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:30:48.734349 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937947ac-d870-4cdd-9db0-8cba4cc9f8d7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:30:48.735995 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-937947ac-d870-4cdd-9db0-8cba4cc9f8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:48.844003 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937947ac-d870-4cdd-9db0-8cba4cc9f8d7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:30:48.887408 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:48.926991 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb5a8f-3885-4d8e-90bc-4676c59d99b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:30:48.927742 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb5a8f-3885-4d8e-90bc-4676c59d99b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:48.929081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb5a8f-3885-4d8e-90bc-4676c59d99b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:48.929656 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb5a8f-3885-4d8e-90bc-4676c59d99b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:48.934484 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-89eb5a8f-3885-4d8e-90bc-4676c59d99b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:49.053594 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb5a8f-3885-4d8e-90bc-4676c59d99b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:30:49.055256 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb5a8f-3885-4d8e-90bc-4676c59d99b9 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:30:49.076307 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 699/1373] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:30:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:30:49.315653 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146d690-e2d6-4da8-b7e3-5e82a73bf25c None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:49.315984 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146d690-e2d6-4da8-b7e3-5e82a73bf25c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:49.316275 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146d690-e2d6-4da8-b7e3-5e82a73bf25c None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:49.318164 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 675/1374] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:30:49.323084 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a370c7-1304-4e29-902e-cedff10a43b4 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:49.323570 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a370c7-1304-4e29-902e-cedff10a43b4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:49.323721 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a370c7-1304-4e29-902e-cedff10a43b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:49.397135 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-60a370c7-1304-4e29-902e-cedff10a43b4 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:30:49.398379 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-60a370c7-1304-4e29-902e-cedff10a43b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:49.421390 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:49.499119 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 700/1375] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:30:49.791801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146d690-e2d6-4da8-b7e3-5e82a73bf25c None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:30:49.793338 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-7146d690-e2d6-4da8-b7e3-5e82a73bf25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:49.942956 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146d690-e2d6-4da8-b7e3-5e82a73bf25c None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:30:49.999890 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:50.061042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724bd41-3172-4ebe-bbff-c3961fd29be4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:30:50.061645 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724bd41-3172-4ebe-bbff-c3961fd29be4 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:50.061950 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724bd41-3172-4ebe-bbff-c3961fd29be4 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:50.062219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724bd41-3172-4ebe-bbff-c3961fd29be4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:50.063812 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c724bd41-3172-4ebe-bbff-c3961fd29be4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:50.152268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724bd41-3172-4ebe-bbff-c3961fd29be4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:30:50.153876 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724bd41-3172-4ebe-bbff-c3961fd29be4 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:30:50.172184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 676/1376] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:30:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:30:52.225229 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5436c-1fb3-471f-8972-e2ec48936d5d None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:52.225809 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5436c-1fb3-471f-8972-e2ec48936d5d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:52.225925 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5436c-1fb3-471f-8972-e2ec48936d5d None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:52.227307 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 701/1377] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:30:52.232988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7b1b4-4af9-459c-b11f-0f3eb4c56f9b None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:52.233394 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7b1b4-4af9-459c-b11f-0f3eb4c56f9b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:52.233541 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7b1b4-4af9-459c-b11f-0f3eb4c56f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:52.331891 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-f4f7b1b4-4af9-459c-b11f-0f3eb4c56f9b None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:30:52.333455 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f4f7b1b4-4af9-459c-b11f-0f3eb4c56f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:52.344976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:52.440410 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 677/1378] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:30:52.739474 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5436c-1fb3-471f-8972-e2ec48936d5d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:30:52.741845 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-35f5436c-1fb3-471f-8972-e2ec48936d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:52.942456 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5436c-1fb3-471f-8972-e2ec48936d5d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:30:52.946616 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:53.065396 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0269bc-e4f7-4d1f-8a6e-46b211cf8cda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:30:53.066191 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0269bc-e4f7-4d1f-8a6e-46b211cf8cda service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:53.066536 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0269bc-e4f7-4d1f-8a6e-46b211cf8cda service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:53.066874 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0269bc-e4f7-4d1f-8a6e-46b211cf8cda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:53.069006 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7b0269bc-e4f7-4d1f-8a6e-46b211cf8cda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:53.175305 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0269bc-e4f7-4d1f-8a6e-46b211cf8cda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:30:53.177178 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0269bc-e4f7-4d1f-8a6e-46b211cf8cda service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:30:53.199277 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 702/1379] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:30:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:30:55.319285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8139b-3c63-4caf-9307-ebbdbbf97aa6 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:55.319804 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8139b-3c63-4caf-9307-ebbdbbf97aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:55.319889 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8139b-3c63-4caf-9307-ebbdbbf97aa6 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:55.321324 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 678/1380] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:30:55.326685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696cf4c-10ee-4338-9851-498b162e3ca7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:55.327091 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696cf4c-10ee-4338-9851-498b162e3ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:55.327283 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696cf4c-10ee-4338-9851-498b162e3ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:55.339434 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:55.398676 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-1696cf4c-10ee-4338-9851-498b162e3ca7 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:30:55.399779 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1696cf4c-10ee-4338-9851-498b162e3ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:55.505568 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 703/1381] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:30:55.808831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8139b-3c63-4caf-9307-ebbdbbf97aa6 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:30:55.810425 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-80e8139b-3c63-4caf-9307-ebbdbbf97aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:55.960145 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:55.970614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8139b-3c63-4caf-9307-ebbdbbf97aa6 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:30:56.091513 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf6d54-7c2b-40df-854c-1a99999f4acc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:30:56.092050 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf6d54-7c2b-40df-854c-1a99999f4acc service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:56.092314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf6d54-7c2b-40df-854c-1a99999f4acc service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:56.092721 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf6d54-7c2b-40df-854c-1a99999f4acc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:56.094198 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-67cf6d54-7c2b-40df-854c-1a99999f4acc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:56.191347 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf6d54-7c2b-40df-854c-1a99999f4acc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:30:56.192968 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf6d54-7c2b-40df-854c-1a99999f4acc service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:30:56.204070 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:56.213338 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 679/1382] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:30:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:30:58.445051 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb380619-50af-40fe-9741-bb58749db272 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:58.445608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb380619-50af-40fe-9741-bb58749db272 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:58.445608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb380619-50af-40fe-9741-bb58749db272 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:58.448045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 704/1383] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:30:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:30:58.453565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406f192-a70b-4737-a9ca-06ad3f302c98 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:58.454099 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406f192-a70b-4737-a9ca-06ad3f302c98 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:58.454099 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406f192-a70b-4737-a9ca-06ad3f302c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:58.524576 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-1406f192-a70b-4737-a9ca-06ad3f302c98 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:30:58.525707 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1406f192-a70b-4737-a9ca-06ad3f302c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:58.630172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 680/1384] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:30:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:30:58.919314 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb380619-50af-40fe-9741-bb58749db272 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:30:58.920905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-bb380619-50af-40fe-9741-bb58749db272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:59.008588 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:59.072164 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb380619-50af-40fe-9741-bb58749db272 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:30:59.186838 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb28a39-9e7c-47e6-9c21-f013cae934e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:30:59.187356 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb28a39-9e7c-47e6-9c21-f013cae934e9 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:30:59.187629 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb28a39-9e7c-47e6-9c21-f013cae934e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:30:59.187895 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb28a39-9e7c-47e6-9c21-f013cae934e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:30:59.189488 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3bb28a39-9e7c-47e6-9c21-f013cae934e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:30:59.239536 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:59.285261 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb28a39-9e7c-47e6-9c21-f013cae934e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:30:59.287805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb28a39-9e7c-47e6-9c21-f013cae934e9 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:30:59.312140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 705/1385] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:30:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:31:01.252236 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aca324-1032-4914-a58a-afe1415b364e None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:01.252938 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aca324-1032-4914-a58a-afe1415b364e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:01.252938 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aca324-1032-4914-a58a-afe1415b364e None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:01.254172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 681/1386] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:31:01.260388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f53b48-cc37-44cb-a109-04088beaf44d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:01.260855 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f53b48-cc37-44cb-a109-04088beaf44d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:01.261115 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f53b48-cc37-44cb-a109-04088beaf44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:01.339490 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-31f53b48-cc37-44cb-a109-04088beaf44d None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:31:01.340753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-31f53b48-cc37-44cb-a109-04088beaf44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:01.446923 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 706/1387] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:31:01.744678 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aca324-1032-4914-a58a-afe1415b364e None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:31:01.746502 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f4aca324-1032-4914-a58a-afe1415b364e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:01.832631 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:01.921140 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aca324-1032-4914-a58a-afe1415b364e None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:31:02.053509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9273a-189e-4595-aca8-129538f983d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:31:02.054295 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9273a-189e-4595-aca8-129538f983d0 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:02.054651 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9273a-189e-4595-aca8-129538f983d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:02.054997 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9273a-189e-4595-aca8-129538f983d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:02.057154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-24a9273a-189e-4595-aca8-129538f983d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:02.097881 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:02.150695 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9273a-189e-4595-aca8-129538f983d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:31:02.152295 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9273a-189e-4595-aca8-129538f983d0 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:31:02.170643 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 682/1388] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:31:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:31:04.233937 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8ef4b-902e-4d30-a800-1894566a9263 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:04.234501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8ef4b-902e-4d30-a800-1894566a9263 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:04.234501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8ef4b-902e-4d30-a800-1894566a9263 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:04.235991 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 707/1389] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:31:04.241189 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde23af-ef6c-4b27-9d88-c7c2cfd06c91 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:04.241611 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde23af-ef6c-4b27-9d88-c7c2cfd06c91 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:04.241797 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde23af-ef6c-4b27-9d88-c7c2cfd06c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:04.313070 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-2bde23af-ef6c-4b27-9d88-c7c2cfd06c91 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:31:04.314322 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2bde23af-ef6c-4b27-9d88-c7c2cfd06c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:04.411935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 683/1390] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:31:04.430774 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dac594-7383-4f1e-9e74-af30fbd05293 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:04.431058 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dac594-7383-4f1e-9e74-af30fbd05293 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:04.431332 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dac594-7383-4f1e-9e74-af30fbd05293 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:04.432673 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 708/1391] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:31:04.439045 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81982d56-c871-4d3e-9e0a-a6ea8c4e97a1 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:04.439323 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81982d56-c871-4d3e-9e0a-a6ea8c4e97a1 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:04.439597 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81982d56-c871-4d3e-9e0a-a6ea8c4e97a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:04.455585 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:04.506674 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-81982d56-c871-4d3e-9e0a-a6ea8c4e97a1 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:31:04.507883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-81982d56-c871-4d3e-9e0a-a6ea8c4e97a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:04.602860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 684/1392] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:31:04.721061 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dac594-7383-4f1e-9e74-af30fbd05293 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:31:04.722859 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-16dac594-7383-4f1e-9e74-af30fbd05293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:04.763614 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:04.899637 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dac594-7383-4f1e-9e74-af30fbd05293 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:31:04.919344 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607ab93-1e12-4ee6-91e3-cf6f672948c1 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:04.919633 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607ab93-1e12-4ee6-91e3-cf6f672948c1 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:04.919907 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607ab93-1e12-4ee6-91e3-cf6f672948c1 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:04.921405 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 685/1393] 10.222.0.65 () {54 vars in 967 bytes} [Wed Aug 24 14:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:31:04.926469 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63e412-968e-4980-bb7b-f6e7a670b796 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:04.926755 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63e412-968e-4980-bb7b-f6e7a670b796 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:04.927053 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63e412-968e-4980-bb7b-f6e7a670b796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:05.008168 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-6a63e412-968e-4980-bb7b-f6e7a670b796 None None] MFA Rules not processed for user `78745f9dbf544ab291acfa7a063c1493`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:31:05.009571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6a63e412-968e-4980-bb7b-f6e7a670b796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:05.011109 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:05.023618 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf783d7-0810-4f06-b311-5f2ea4d99a40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:31:05.026843 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf783d7-0810-4f06-b311-5f2ea4d99a40 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:05.026843 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf783d7-0810-4f06-b311-5f2ea4d99a40 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:05.026843 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf783d7-0810-4f06-b311-5f2ea4d99a40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:05.026843 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8bf783d7-0810-4f06-b311-5f2ea4d99a40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:05.045324 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:05.089376 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 686/1394] 10.222.0.65 () {58 vars in 1064 bytes} [Wed Aug 24 14:31:04 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:31:05.097027 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63e412-968e-4980-bb7b-f6e7a670b796 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:31:05.105794 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63e412-968e-4980-bb7b-f6e7a670b796 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:31:05.124912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf783d7-0810-4f06-b311-5f2ea4d99a40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:31:05.126650 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf783d7-0810-4f06-b311-5f2ea4d99a40 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:31:05.147283 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 709/1395] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:31:05.183749 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934d4a5-f4b0-435d-88c1-34b80c87a40c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78745f9dbf544ab291acfa7a063c1493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:31:05.184350 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934d4a5-f4b0-435d-88c1-34b80c87a40c service glance] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:05.184632 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934d4a5-f4b0-435d-88c1-34b80c87a40c service glance] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:05.184903 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934d4a5-f4b0-435d-88c1-34b80c87a40c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:05.186564 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1934d4a5-f4b0-435d-88c1-34b80c87a40c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:05.298615 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:05.302113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934d4a5-f4b0-435d-88c1-34b80c87a40c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:31:05.304185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934d4a5-f4b0-435d-88c1-34b80c87a40c service glance] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:31:05.322644 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 687/1396] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:31:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:31:06.261950 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c7d6b-ccb5-4b44-93f7-8e8a0d721996 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:06.262413 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c7d6b-ccb5-4b44-93f7-8e8a0d721996 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:06.262502 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c7d6b-ccb5-4b44-93f7-8e8a0d721996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:06.329273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-033c7d6b-ccb5-4b44-93f7-8e8a0d721996 None None] MFA Rules not processed for user `477ab357d285415e8c0c82d414d242ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:31:06.330510 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-033c7d6b-ccb5-4b44-93f7-8e8a0d721996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:06.390661 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:06.419657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 710/1397] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 14:31:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:31:06.463742 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208d701-7692-4968-aa59-a4edf401b89f None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:06.464286 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208d701-7692-4968-aa59-a4edf401b89f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:06.464286 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208d701-7692-4968-aa59-a4edf401b89f None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:06.465719 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 688/1398] 10.222.0.65 () {54 vars in 943 bytes} [Wed Aug 24 14:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:31:06.472165 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352dca14-9f9f-4d25-ba44-70492f1d8562 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:06.472548 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352dca14-9f9f-4d25-ba44-70492f1d8562 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:06.472887 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352dca14-9f9f-4d25-ba44-70492f1d8562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:06.550679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-352dca14-9f9f-4d25-ba44-70492f1d8562 None None] MFA Rules not processed for user `6b3c32ecfdcf40629f09a7f52b2b5fa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:31:06.551875 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-352dca14-9f9f-4d25-ba44-70492f1d8562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:06.659449 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 711/1399] 10.222.0.65 () {58 vars in 1040 bytes} [Wed Aug 24 14:31:06 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:31:06.669156 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208d701-7692-4968-aa59-a4edf401b89f None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:31:06.670766 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3208d701-7692-4968-aa59-a4edf401b89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:06.810112 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208d701-7692-4968-aa59-a4edf401b89f None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:31:06.880244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:06.916130 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf89396-153c-4e35-a548-cde6528e7074 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b3c32ecfdcf40629f09a7f52b2b5fa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:31:06.916651 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf89396-153c-4e35-a548-cde6528e7074 service swift] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:06.916930 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf89396-153c-4e35-a548-cde6528e7074 service swift] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:06.917203 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf89396-153c-4e35-a548-cde6528e7074 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:06.918880 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0bf89396-153c-4e35-a548-cde6528e7074 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:07.002836 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf89396-153c-4e35-a548-cde6528e7074 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:31:07.004460 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf89396-153c-4e35-a548-cde6528e7074 service swift] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:31:07.012962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 689/1400] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 14:31:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 14:31:07.308042 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fac60d-aa5f-421a-8d90-f75f18fd20e3 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:07.308584 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fac60d-aa5f-421a-8d90-f75f18fd20e3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:07.308584 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fac60d-aa5f-421a-8d90-f75f18fd20e3 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:07.310157 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 712/1401] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:31:07.315693 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f52471-a272-4bdb-bf95-7c97f58ab091 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:07.315986 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f52471-a272-4bdb-bf95-7c97f58ab091 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:07.316268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f52471-a272-4bdb-bf95-7c97f58ab091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:07.399346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-30f52471-a272-4bdb-bf95-7c97f58ab091 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:31:07.400881 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-30f52471-a272-4bdb-bf95-7c97f58ab091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:07.465778 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:07.510717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 690/1402] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:31:07.813271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fac60d-aa5f-421a-8d90-f75f18fd20e3 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:31:07.815073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a8fac60d-aa5f-421a-8d90-f75f18fd20e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:07.858490 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:07.980146 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fac60d-aa5f-421a-8d90-f75f18fd20e3 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:31:08.112494 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:08.116010 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f3ea3-05a4-45ea-b60e-8efd97acac04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:31:08.116626 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f3ea3-05a4-45ea-b60e-8efd97acac04 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:08.116910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f3ea3-05a4-45ea-b60e-8efd97acac04 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:08.117224 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f3ea3-05a4-45ea-b60e-8efd97acac04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:08.119444 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ce8f3ea3-05a4-45ea-b60e-8efd97acac04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:08.228029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f3ea3-05a4-45ea-b60e-8efd97acac04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:31:08.229937 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f3ea3-05a4-45ea-b60e-8efd97acac04 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:31:08.248774 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 713/1403] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:31:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:31:10.389510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bb7bb-bdfc-493c-9953-f2c540119c7f None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:10.390072 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bb7bb-bdfc-493c-9953-f2c540119c7f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:10.390179 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bb7bb-bdfc-493c-9953-f2c540119c7f None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:10.401293 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 691/1404] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:31:10 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:31:10.407131 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0a069-0bd8-424c-a736-bd9c25f63406 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:10.407617 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0a069-0bd8-424c-a736-bd9c25f63406 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:10.407807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0a069-0bd8-424c-a736-bd9c25f63406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:10.500543 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c1f0a069-0bd8-424c-a736-bd9c25f63406 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:31:10.502232 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c1f0a069-0bd8-424c-a736-bd9c25f63406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:10.597189 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:10.635316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 714/1405] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:31:10.964696 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bb7bb-bdfc-493c-9953-f2c540119c7f None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:31:10.964696 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-eb4bb7bb-bdfc-493c-9953-f2c540119c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:11.132215 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bb7bb-bdfc-493c-9953-f2c540119c7f None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:31:11.185455 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:11.266683 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc25291-5b88-4130-b76d-aada648ebf5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:31:11.267293 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc25291-5b88-4130-b76d-aada648ebf5c service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:11.267568 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc25291-5b88-4130-b76d-aada648ebf5c service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:11.267834 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc25291-5b88-4130-b76d-aada648ebf5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:11.269434 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2cc25291-5b88-4130-b76d-aada648ebf5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:11.378757 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc25291-5b88-4130-b76d-aada648ebf5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:31:11.380572 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc25291-5b88-4130-b76d-aada648ebf5c service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:31:11.400382 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 692/1406] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:31:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:31:13.533526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7795ac-a294-4295-a3bb-69f48b5d3f87 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:13.534091 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7795ac-a294-4295-a3bb-69f48b5d3f87 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:13.534091 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7795ac-a294-4295-a3bb-69f48b5d3f87 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:13.535370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 715/1407] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:31:13.541039 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c616530-99e9-4610-bb27-32f4f8c3dad0 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:13.541496 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c616530-99e9-4610-bb27-32f4f8c3dad0 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:13.541610 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c616530-99e9-4610-bb27-32f4f8c3dad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:13.610739 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:13.619484 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-8c616530-99e9-4610-bb27-32f4f8c3dad0 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:31:13.630389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-8c616530-99e9-4610-bb27-32f4f8c3dad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:13.729047 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 693/1408] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:31:14.025607 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7795ac-a294-4295-a3bb-69f48b5d3f87 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:31:14.027209 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8d7795ac-a294-4295-a3bb-69f48b5d3f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:14.200883 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7795ac-a294-4295-a3bb-69f48b5d3f87 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:31:14.264771 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:14.333688 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fb82b-6cc5-4756-a53e-cd505db6b888 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:31:14.334515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fb82b-6cc5-4756-a53e-cd505db6b888 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:14.334900 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fb82b-6cc5-4756-a53e-cd505db6b888 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:14.335260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fb82b-6cc5-4756-a53e-cd505db6b888 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:14.336872 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e22fb82b-6cc5-4756-a53e-cd505db6b888 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:14.438194 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22fb82b-6cc5-4756-a53e-cd505db6b888 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:31:14.440021 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22fb82b-6cc5-4756-a53e-cd505db6b888 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:31:14.460031 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 716/1409] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:31:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:31:23.727051 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=44 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:24.456909 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=73 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:30.417049 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed2d22-7d72-4a55-a51d-c78fa3f3b2f6 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:30.417583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed2d22-7d72-4a55-a51d-c78fa3f3b2f6 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:30.417583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed2d22-7d72-4a55-a51d-c78fa3f3b2f6 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:30.419039 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 694/1410] 10.222.0.65 () {54 vars in 918 bytes} [Wed Aug 24 14:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:31:30.424289 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e2df0-13ab-43ed-be55-06f4a98b8f49 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:30.424704 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e2df0-13ab-43ed-be55-06f4a98b8f49 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:30.424838 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e2df0-13ab-43ed-be55-06f4a98b8f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:30.501495 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-8c2e2df0-13ab-43ed-be55-06f4a98b8f49 None None] MFA Rules not processed for user `63253cd786c04d6a9d099773198aee36`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:31:30.502751 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8c2e2df0-13ab-43ed-be55-06f4a98b8f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:30.608134 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 717/1411] 10.222.0.65 () {58 vars in 1015 bytes} [Wed Aug 24 14:31:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:31:30.622980 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b7ed7-8346-4968-8c0d-e66d32874b9a None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:30.623261 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b7ed7-8346-4968-8c0d-e66d32874b9a None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:30.623532 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b7ed7-8346-4968-8c0d-e66d32874b9a None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:30.624909 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 695/1412] 10.222.0.65 () {54 vars in 918 bytes} [Wed Aug 24 14:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:31:30.629402 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02422af-577d-4eba-b01f-9275165ffc76 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:30.629808 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02422af-577d-4eba-b01f-9275165ffc76 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:30.630081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02422af-577d-4eba-b01f-9275165ffc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:30.701592 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:30.704165 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b02422af-577d-4eba-b01f-9275165ffc76 None None] MFA Rules not processed for user `8d099678d6454f7eb494892a69feaf62`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:31:30.705367 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b02422af-577d-4eba-b01f-9275165ffc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:30.820581 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 718/1413] 10.222.0.65 () {58 vars in 1015 bytes} [Wed Aug 24 14:31:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:31:33.211772 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610cf9f-1b60-4f50-bae3-fcbfb1326dfe None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:33.212308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610cf9f-1b60-4f50-bae3-fcbfb1326dfe None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:33.212308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610cf9f-1b60-4f50-bae3-fcbfb1326dfe None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:33.213583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 696/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 14:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:31:33.218958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff11e1c-36fa-43b6-9c26-5f1901d7d78d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:33.219420 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff11e1c-36fa-43b6-9c26-5f1901d7d78d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:33.219524 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff11e1c-36fa-43b6-9c26-5f1901d7d78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:33.286794 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-8ff11e1c-36fa-43b6-9c26-5f1901d7d78d None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:31:33.288005 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8ff11e1c-36fa-43b6-9c26-5f1901d7d78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:33.343086 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:33.502294 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 719/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 14:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:31:33.796358 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610cf9f-1b60-4f50-bae3-fcbfb1326dfe None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:31:33.797983 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f610cf9f-1b60-4f50-bae3-fcbfb1326dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:33.943207 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610cf9f-1b60-4f50-bae3-fcbfb1326dfe None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:31:34.014229 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:34.054633 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb3ad1-246f-4671-bdf6-4ed559de37ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:31:34.055260 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb3ad1-246f-4671-bdf6-4ed559de37ff service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:34.055540 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb3ad1-246f-4671-bdf6-4ed559de37ff service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:34.055814 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb3ad1-246f-4671-bdf6-4ed559de37ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:34.057418 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f5cb3ad1-246f-4671-bdf6-4ed559de37ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:34.147094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb3ad1-246f-4671-bdf6-4ed559de37ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:31:34.148702 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb3ad1-246f-4671-bdf6-4ed559de37ff service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:31:34.166535 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 697/1416] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:31:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:31:35.063649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52054343-903f-4868-ae10-0535b069d8d1 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:35.064218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52054343-903f-4868-ae10-0535b069d8d1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:35.064218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52054343-903f-4868-ae10-0535b069d8d1 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:35.065530 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 720/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 14:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:31:35.070694 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ec168-6a12-43d8-a868-0ab41e35bbb8 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:35.071154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ec168-6a12-43d8-a868-0ab41e35bbb8 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:35.071254 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ec168-6a12-43d8-a868-0ab41e35bbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:35.148559 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-777ec168-6a12-43d8-a868-0ab41e35bbb8 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:31:35.149740 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-777ec168-6a12-43d8-a868-0ab41e35bbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:35.176490 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:35.247508 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 698/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 14:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:31:35.402754 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52054343-903f-4868-ae10-0535b069d8d1 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:31:35.404277 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-52054343-903f-4868-ae10-0535b069d8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:35.548527 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52054343-903f-4868-ae10-0535b069d8d1 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:31:35.587769 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:35.659256 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b443e-90c5-4153-b9b7-216eae30d9fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:31:35.659847 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b443e-90c5-4153-b9b7-216eae30d9fd service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:35.660121 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b443e-90c5-4153-b9b7-216eae30d9fd service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:35.660388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b443e-90c5-4153-b9b7-216eae30d9fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:35.662495 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-306b443e-90c5-4153-b9b7-216eae30d9fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:35.750162 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b443e-90c5-4153-b9b7-216eae30d9fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:31:35.751758 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b443e-90c5-4153-b9b7-216eae30d9fd service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:31:35.769483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 721/1419] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:31:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:31:36.684411 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc92360-ab4e-4dfe-82ff-1fd2a4f47e72 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:36.685584 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc92360-ab4e-4dfe-82ff-1fd2a4f47e72 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:36.685584 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc92360-ab4e-4dfe-82ff-1fd2a4f47e72 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:36.686437 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 699/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 14:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:31:36.691456 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ceb24-8448-4a6e-a5eb-b837292fd820 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:36.691948 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ceb24-8448-4a6e-a5eb-b837292fd820 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:36.692073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ceb24-8448-4a6e-a5eb-b837292fd820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:36.747874 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:36.772689 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a82ceb24-8448-4a6e-a5eb-b837292fd820 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:31:36.773964 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a82ceb24-8448-4a6e-a5eb-b837292fd820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:36.870247 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 722/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 14:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:31:37.026661 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc92360-ab4e-4dfe-82ff-1fd2a4f47e72 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:31:37.028111 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-edc92360-ab4e-4dfe-82ff-1fd2a4f47e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:37.176204 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc92360-ab4e-4dfe-82ff-1fd2a4f47e72 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:31:37.189135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:37.291634 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13506959-621c-49e3-a40d-96e31d904a9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:31:37.292226 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13506959-621c-49e3-a40d-96e31d904a9d service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:37.292501 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13506959-621c-49e3-a40d-96e31d904a9d service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:37.292769 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13506959-621c-49e3-a40d-96e31d904a9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:37.294387 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-13506959-621c-49e3-a40d-96e31d904a9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:37.385539 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13506959-621c-49e3-a40d-96e31d904a9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:31:37.387179 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13506959-621c-49e3-a40d-96e31d904a9d service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:31:37.405082 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 700/1422] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:31:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:31:38.266513 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761e83a-d9f2-455c-81b8-a2593e6ec7a7 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:38.266992 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761e83a-d9f2-455c-81b8-a2593e6ec7a7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:38.267116 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761e83a-d9f2-455c-81b8-a2593e6ec7a7 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:38.268453 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 723/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 14:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:31:38.274163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed4d99-6bfd-4e50-98ef-0dbbd2ceee0d None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:38.274611 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed4d99-6bfd-4e50-98ef-0dbbd2ceee0d None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:38.274717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed4d99-6bfd-4e50-98ef-0dbbd2ceee0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:38.294743 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:38.352112 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-66ed4d99-6bfd-4e50-98ef-0dbbd2ceee0d None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:31:38.353314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-66ed4d99-6bfd-4e50-98ef-0dbbd2ceee0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:38.449171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 701/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 14:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:31:38.600658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761e83a-d9f2-455c-81b8-a2593e6ec7a7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:31:38.602206 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e761e83a-d9f2-455c-81b8-a2593e6ec7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:38.709081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:38.745158 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761e83a-d9f2-455c-81b8-a2593e6ec7a7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:31:38.856661 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a4ea4-2404-4661-a548-f8df15292237 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:31:38.857176 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a4ea4-2404-4661-a548-f8df15292237 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:38.857447 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a4ea4-2404-4661-a548-f8df15292237 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:38.857708 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a4ea4-2404-4661-a548-f8df15292237 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:38.859307 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-bc6a4ea4-2404-4661-a548-f8df15292237 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:38.932922 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:38.946126 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a4ea4-2404-4661-a548-f8df15292237 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:31:38.947735 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a4ea4-2404-4661-a548-f8df15292237 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:31:38.967202 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 724/1425] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:31:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:31:39.838076 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f084031-78cf-4be4-9ada-8c76376bb536 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:39.838659 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f084031-78cf-4be4-9ada-8c76376bb536 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:39.838659 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f084031-78cf-4be4-9ada-8c76376bb536 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:39.840014 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 702/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 14:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:31:39.845016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2ec3a-e5be-4532-bbc6-a9bf23c490e6 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:39.845462 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2ec3a-e5be-4532-bbc6-a9bf23c490e6 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:39.845560 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2ec3a-e5be-4532-bbc6-a9bf23c490e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:39.922284 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e6a2ec3a-e5be-4532-bbc6-a9bf23c490e6 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:31:39.923490 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e6a2ec3a-e5be-4532-bbc6-a9bf23c490e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:40.018385 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 725/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 14:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:31:40.173374 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f084031-78cf-4be4-9ada-8c76376bb536 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:31:40.174874 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4f084031-78cf-4be4-9ada-8c76376bb536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:40.263083 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:40.325481 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f084031-78cf-4be4-9ada-8c76376bb536 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:31:40.440550 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c5f73-fbb6-4ab0-9e7c-6d80516a3b4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:31:40.441053 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c5f73-fbb6-4ab0-9e7c-6d80516a3b4f service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:40.441334 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c5f73-fbb6-4ab0-9e7c-6d80516a3b4f service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:40.441604 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c5f73-fbb6-4ab0-9e7c-6d80516a3b4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:40.443533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-383c5f73-fbb6-4ab0-9e7c-6d80516a3b4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:40.491848 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:40.532447 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c5f73-fbb6-4ab0-9e7c-6d80516a3b4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:31:40.534039 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c5f73-fbb6-4ab0-9e7c-6d80516a3b4f service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:31:40.552175 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 703/1428] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:31:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:31:41.428326 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a638ecb-6c6b-44b8-9d39-4910409536d9 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:41.428891 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a638ecb-6c6b-44b8-9d39-4910409536d9 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:41.428891 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a638ecb-6c6b-44b8-9d39-4910409536d9 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:41.430294 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 726/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 14:31:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:31:41.435350 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2725eb-acb3-4b2a-b53a-ee0f0197dd70 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:41.435752 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2725eb-acb3-4b2a-b53a-ee0f0197dd70 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:41.435894 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2725eb-acb3-4b2a-b53a-ee0f0197dd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:41.510861 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-3b2725eb-acb3-4b2a-b53a-ee0f0197dd70 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:31:41.512116 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3b2725eb-acb3-4b2a-b53a-ee0f0197dd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:41.609572 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 704/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 14:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:31:41.767074 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a638ecb-6c6b-44b8-9d39-4910409536d9 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:31:41.768503 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9a638ecb-6c6b-44b8-9d39-4910409536d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:41.818349 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:41.913835 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a638ecb-6c6b-44b8-9d39-4910409536d9 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:31:42.024412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32046e1-b44e-4504-a1fc-f42ada5807bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:31:42.024925 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32046e1-b44e-4504-a1fc-f42ada5807bb service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:42.025197 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32046e1-b44e-4504-a1fc-f42ada5807bb service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:42.025459 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32046e1-b44e-4504-a1fc-f42ada5807bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:42.027068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e32046e1-b44e-4504-a1fc-f42ada5807bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:42.033816 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:42.115707 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32046e1-b44e-4504-a1fc-f42ada5807bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:31:42.117289 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32046e1-b44e-4504-a1fc-f42ada5807bb service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:31:42.135667 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 727/1431] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:31:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:31:43.002479 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b01ca6-cd7b-42db-bb2c-f117b141f2cb None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:43.003055 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b01ca6-cd7b-42db-bb2c-f117b141f2cb None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:43.003055 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b01ca6-cd7b-42db-bb2c-f117b141f2cb None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:43.004393 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 705/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 14:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:31:43.010268 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f62eb-dd97-488e-9d40-94c1dc8ce23c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:43.010716 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f62eb-dd97-488e-9d40-94c1dc8ce23c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:43.010826 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f62eb-dd97-488e-9d40-94c1dc8ce23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:43.086342 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-346f62eb-dd97-488e-9d40-94c1dc8ce23c None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:31:43.087552 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-346f62eb-dd97-488e-9d40-94c1dc8ce23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:43.155852 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:43.183436 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 728/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 14:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:31:43.336682 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b01ca6-cd7b-42db-bb2c-f117b141f2cb None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:31:43.338252 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-17b01ca6-cd7b-42db-bb2c-f117b141f2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:43.355970 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:43.483875 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b01ca6-cd7b-42db-bb2c-f117b141f2cb None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:31:43.570893 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:43.596636 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835dcf36-1e35-440c-8dff-d1d0276d42eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:31:43.597235 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835dcf36-1e35-440c-8dff-d1d0276d42eb service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:43.597517 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835dcf36-1e35-440c-8dff-d1d0276d42eb service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:43.597824 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835dcf36-1e35-440c-8dff-d1d0276d42eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:43.599536 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-835dcf36-1e35-440c-8dff-d1d0276d42eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:43.690825 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835dcf36-1e35-440c-8dff-d1d0276d42eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:31:43.692434 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835dcf36-1e35-440c-8dff-d1d0276d42eb service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:31:43.710260 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 706/1434] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:31:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:31:44.575237 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd149a97-2c88-463b-8dcc-291140d0be08 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:44.575795 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd149a97-2c88-463b-8dcc-291140d0be08 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:44.575795 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd149a97-2c88-463b-8dcc-291140d0be08 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:44.577146 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 729/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 14:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:31:44.582237 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1225d5-9c09-4530-826d-bcbe071b98b6 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:44.582673 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1225d5-9c09-4530-826d-bcbe071b98b6 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:44.582790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1225d5-9c09-4530-826d-bcbe071b98b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:44.657559 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-4f1225d5-9c09-4530-826d-bcbe071b98b6 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:31:44.658799 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4f1225d5-9c09-4530-826d-bcbe071b98b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:44.700036 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:44.755957 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 707/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 14:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:31:44.909248 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd149a97-2c88-463b-8dcc-291140d0be08 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:31:44.910724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fd149a97-2c88-463b-8dcc-291140d0be08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:45.054575 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd149a97-2c88-463b-8dcc-291140d0be08 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:31:45.107361 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:45.166626 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6aa8ee-ece1-4888-8359-2a919e144a4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:31:45.167275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6aa8ee-ece1-4888-8359-2a919e144a4d service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:45.167560 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6aa8ee-ece1-4888-8359-2a919e144a4d service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:45.167836 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6aa8ee-ece1-4888-8359-2a919e144a4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:45.169486 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ad6aa8ee-ece1-4888-8359-2a919e144a4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:45.260690 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6aa8ee-ece1-4888-8359-2a919e144a4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:31:45.262345 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6aa8ee-ece1-4888-8359-2a919e144a4d service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:31:45.280377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 730/1437] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:31:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:31:46.135656 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faada71d-dbb8-4130-b9aa-76d8e9a5dee1 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:46.136229 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faada71d-dbb8-4130-b9aa-76d8e9a5dee1 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:46.136229 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faada71d-dbb8-4130-b9aa-76d8e9a5dee1 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:46.137561 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 708/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 14:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:31:46.142545 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdad8e-1808-4c8e-907a-9d2ec5f94ab6 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:46.142955 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdad8e-1808-4c8e-907a-9d2ec5f94ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:46.143089 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdad8e-1808-4c8e-907a-9d2ec5f94ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:46.219320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d0fdad8e-1808-4c8e-907a-9d2ec5f94ab6 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:31:46.220513 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d0fdad8e-1808-4c8e-907a-9d2ec5f94ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:46.222512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:46.317406 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 731/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 14:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:31:46.472432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faada71d-dbb8-4130-b9aa-76d8e9a5dee1 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:31:46.474638 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-faada71d-dbb8-4130-b9aa-76d8e9a5dee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:46.622098 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faada71d-dbb8-4130-b9aa-76d8e9a5dee1 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:31:46.649505 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:46.735280 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916780a9-48c6-407e-a5ca-4da9ebd50884 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:31:46.735794 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916780a9-48c6-407e-a5ca-4da9ebd50884 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:46.736095 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916780a9-48c6-407e-a5ca-4da9ebd50884 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:46.736367 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916780a9-48c6-407e-a5ca-4da9ebd50884 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:46.738042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-916780a9-48c6-407e-a5ca-4da9ebd50884 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:46.825315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916780a9-48c6-407e-a5ca-4da9ebd50884 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:31:46.826922 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916780a9-48c6-407e-a5ca-4da9ebd50884 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:31:46.845207 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 709/1440] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:31:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:31:48.676181 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c22a86-b69e-4261-9ad3-9ea905adf385 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:48.677241 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c22a86-b69e-4261-9ad3-9ea905adf385 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:48.677380 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c22a86-b69e-4261-9ad3-9ea905adf385 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:48.679025 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 732/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 14:31:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:31:48.684390 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f00270-4f8b-45a8-85a3-e00097c1e3f1 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:48.684796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f00270-4f8b-45a8-85a3-e00097c1e3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:48.685023 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f00270-4f8b-45a8-85a3-e00097c1e3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:48.726011 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:48.751242 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-95f00270-4f8b-45a8-85a3-e00097c1e3f1 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:31:48.752463 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-95f00270-4f8b-45a8-85a3-e00097c1e3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:48.848534 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 710/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 14:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:31:49.135880 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c22a86-b69e-4261-9ad3-9ea905adf385 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:31:49.137405 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-85c22a86-b69e-4261-9ad3-9ea905adf385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:49.239255 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c22a86-b69e-4261-9ad3-9ea905adf385 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:31:49.273571 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:49.314836 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34435f-2e5b-45a5-bfcb-6c937a109360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:31:49.315433 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34435f-2e5b-45a5-bfcb-6c937a109360 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:49.315709 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34435f-2e5b-45a5-bfcb-6c937a109360 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:49.315978 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34435f-2e5b-45a5-bfcb-6c937a109360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:49.317722 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6c34435f-2e5b-45a5-bfcb-6c937a109360 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:49.424648 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34435f-2e5b-45a5-bfcb-6c937a109360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:31:49.426022 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34435f-2e5b-45a5-bfcb-6c937a109360 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:31:49.445531 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 733/1443] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:31:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:31:51.496375 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234ff94-a3d0-4eaf-bb23-cec45ba55fd1 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:51.496903 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234ff94-a3d0-4eaf-bb23-cec45ba55fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:51.496903 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234ff94-a3d0-4eaf-bb23-cec45ba55fd1 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:51.498301 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 711/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 14:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:31:51.503601 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8fdba-c395-47ea-b3d1-405d119788ed None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:51.504005 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8fdba-c395-47ea-b3d1-405d119788ed None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:51.504145 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8fdba-c395-47ea-b3d1-405d119788ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:51.570340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-32d8fdba-c395-47ea-b3d1-405d119788ed None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:31:51.571542 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-32d8fdba-c395-47ea-b3d1-405d119788ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:51.584923 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:51.668017 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 734/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 14:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:31:51.950523 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234ff94-a3d0-4eaf-bb23-cec45ba55fd1 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:31:51.952172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2234ff94-a3d0-4eaf-bb23-cec45ba55fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:52.055898 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234ff94-a3d0-4eaf-bb23-cec45ba55fd1 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:31:52.068279 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:52.129018 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeef0b1-2d86-4113-b183-a93cea61c44d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:31:52.129619 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeef0b1-2d86-4113-b183-a93cea61c44d service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:52.130609 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeef0b1-2d86-4113-b183-a93cea61c44d service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:52.130886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeef0b1-2d86-4113-b183-a93cea61c44d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:52.132521 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6aeef0b1-2d86-4113-b183-a93cea61c44d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:52.239981 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeef0b1-2d86-4113-b183-a93cea61c44d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:31:52.241358 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeef0b1-2d86-4113-b183-a93cea61c44d service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:31:52.261677 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 712/1446] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:31:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:31:54.525438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6c480-d816-4669-899a-46156f86dbf5 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:54.525984 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6c480-d816-4669-899a-46156f86dbf5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:54.525984 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6c480-d816-4669-899a-46156f86dbf5 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:54.527260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 735/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 14:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:31:54.532638 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab169bf0-c6a0-4469-a5a8-aa381dbc48b0 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:54.533042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab169bf0-c6a0-4469-a5a8-aa381dbc48b0 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:54.533188 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab169bf0-c6a0-4469-a5a8-aa381dbc48b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:54.581608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:54.598900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ab169bf0-c6a0-4469-a5a8-aa381dbc48b0 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:31:54.600211 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ab169bf0-c6a0-4469-a5a8-aa381dbc48b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:54.696038 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 713/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 14:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:31:54.981207 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6c480-d816-4669-899a-46156f86dbf5 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:31:54.982762 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-07b6c480-d816-4669-899a-46156f86dbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:55.084135 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6c480-d816-4669-899a-46156f86dbf5 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:31:55.124097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:55.157546 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb4350-f092-4476-9072-9292ed1734e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:31:55.158191 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb4350-f092-4476-9072-9292ed1734e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:55.158468 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb4350-f092-4476-9072-9292ed1734e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:55.158858 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb4350-f092-4476-9072-9292ed1734e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:55.160391 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-67fb4350-f092-4476-9072-9292ed1734e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:55.271834 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb4350-f092-4476-9072-9292ed1734e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:31:55.273864 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb4350-f092-4476-9072-9292ed1734e4 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:31:55.293769 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 736/1449] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:31:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:31:57.340089 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44287bf0-0f5d-4abe-8e80-f3d4476435dd None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:57.340469 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44287bf0-0f5d-4abe-8e80-f3d4476435dd None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:57.340683 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44287bf0-0f5d-4abe-8e80-f3d4476435dd None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:57.342066 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 714/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 14:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:31:57.347682 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb508307-85a9-4dbc-ba5a-d5408ca13bea None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:57.348164 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb508307-85a9-4dbc-ba5a-d5408ca13bea None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:57.348880 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb508307-85a9-4dbc-ba5a-d5408ca13bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:57.414485 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-bb508307-85a9-4dbc-ba5a-d5408ca13bea None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:31:57.415690 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-bb508307-85a9-4dbc-ba5a-d5408ca13bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:57.436578 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:57.513510 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 737/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 14:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:31:57.796814 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44287bf0-0f5d-4abe-8e80-f3d4476435dd None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:31:57.798436 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-44287bf0-0f5d-4abe-8e80-f3d4476435dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:57.902382 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44287bf0-0f5d-4abe-8e80-f3d4476435dd None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:31:57.922522 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:57.977590 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74eb922-f323-4b54-bd84-4713f2f183ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:31:57.978219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74eb922-f323-4b54-bd84-4713f2f183ba service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:31:57.978498 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74eb922-f323-4b54-bd84-4713f2f183ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:31:57.978772 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74eb922-f323-4b54-bd84-4713f2f183ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:31:57.980377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e74eb922-f323-4b54-bd84-4713f2f183ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:31:58.089994 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74eb922-f323-4b54-bd84-4713f2f183ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:31:58.091354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74eb922-f323-4b54-bd84-4713f2f183ba service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:31:58.109015 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 715/1452] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:31:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:32:00.078720 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397dfad-ed85-4a2f-9165-37f18f816453 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:00.079294 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397dfad-ed85-4a2f-9165-37f18f816453 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:00.079294 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397dfad-ed85-4a2f-9165-37f18f816453 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:00.080589 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 738/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 14:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:32:00.086567 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c504135-8ce4-4a65-b16c-fda205bd7c48 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:00.086981 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c504135-8ce4-4a65-b16c-fda205bd7c48 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:00.087116 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c504135-8ce4-4a65-b16c-fda205bd7c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:00.151489 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:00.154142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-4c504135-8ce4-4a65-b16c-fda205bd7c48 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:32:00.155353 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4c504135-8ce4-4a65-b16c-fda205bd7c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:00.250686 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 716/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 14:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:32:00.536904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397dfad-ed85-4a2f-9165-37f18f816453 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:32:00.538463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6397dfad-ed85-4a2f-9165-37f18f816453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:00.641286 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397dfad-ed85-4a2f-9165-37f18f816453 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:32:00.689472 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:00.714365 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1433b-2806-42ea-81ae-51d4b516aab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:32:00.714962 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1433b-2806-42ea-81ae-51d4b516aab1 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:00.715236 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1433b-2806-42ea-81ae-51d4b516aab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:00.715500 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1433b-2806-42ea-81ae-51d4b516aab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:00.717092 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-07e1433b-2806-42ea-81ae-51d4b516aab1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:00.824685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1433b-2806-42ea-81ae-51d4b516aab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:32:00.826168 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1433b-2806-42ea-81ae-51d4b516aab1 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:32:00.844939 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 739/1455] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:32:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:32:02.803353 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1026294-0c14-4c87-9d24-913b67daf7e6 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:02.803943 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1026294-0c14-4c87-9d24-913b67daf7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:02.803943 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1026294-0c14-4c87-9d24-913b67daf7e6 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:02.805285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 717/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 14:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:32:02.810709 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c414197-d224-4d6c-bf3d-e1a3e8809e52 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:02.811117 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c414197-d224-4d6c-bf3d-e1a3e8809e52 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:02.811259 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c414197-d224-4d6c-bf3d-e1a3e8809e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:02.876932 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-1c414197-d224-4d6c-bf3d-e1a3e8809e52 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:32:02.878178 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1c414197-d224-4d6c-bf3d-e1a3e8809e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:02.907486 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:02.974396 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 740/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 14:32:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:32:03.259396 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1026294-0c14-4c87-9d24-913b67daf7e6 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:32:03.260613 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a1026294-0c14-4c87-9d24-913b67daf7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:03.376691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1026294-0c14-4c87-9d24-913b67daf7e6 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:32:03.406022 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:03.454262 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e46711-e3df-457b-a45e-8ae94a3dfd4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:32:03.454862 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e46711-e3df-457b-a45e-8ae94a3dfd4c service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:03.455146 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e46711-e3df-457b-a45e-8ae94a3dfd4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:03.455419 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e46711-e3df-457b-a45e-8ae94a3dfd4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:03.457058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-05e46711-e3df-457b-a45e-8ae94a3dfd4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:03.571746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e46711-e3df-457b-a45e-8ae94a3dfd4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:32:03.573177 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e46711-e3df-457b-a45e-8ae94a3dfd4c service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:32:03.591037 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 718/1458] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:32:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:32:05.565854 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bceafb4-c072-4c4a-b124-d6dc265673e0 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:05.566401 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bceafb4-c072-4c4a-b124-d6dc265673e0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:05.566510 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bceafb4-c072-4c4a-b124-d6dc265673e0 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:05.567955 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 741/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 14:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:32:05.573644 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c6e72-e7d8-466f-92fd-cee40d3468b9 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:05.574102 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c6e72-e7d8-466f-92fd-cee40d3468b9 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:05.574236 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c6e72-e7d8-466f-92fd-cee40d3468b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:05.639878 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-377c6e72-e7d8-466f-92fd-cee40d3468b9 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:32:05.641141 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-377c6e72-e7d8-466f-92fd-cee40d3468b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:05.649661 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:05.740620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 719/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 14:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:32:06.031674 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bceafb4-c072-4c4a-b124-d6dc265673e0 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:32:06.033267 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0bceafb4-c072-4c4a-b124-d6dc265673e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:06.136289 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bceafb4-c072-4c4a-b124-d6dc265673e0 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:32:06.194680 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:06.213852 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56161d6e-0071-44f6-be6e-b2ba0ce3867d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:32:06.214451 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56161d6e-0071-44f6-be6e-b2ba0ce3867d service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:06.214724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56161d6e-0071-44f6-be6e-b2ba0ce3867d service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:06.214991 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56161d6e-0071-44f6-be6e-b2ba0ce3867d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:06.216568 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-56161d6e-0071-44f6-be6e-b2ba0ce3867d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:06.323274 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56161d6e-0071-44f6-be6e-b2ba0ce3867d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:32:06.324697 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56161d6e-0071-44f6-be6e-b2ba0ce3867d service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:32:06.343526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 742/1461] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:32:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:32:08.336121 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68470e71-a752-4070-a3f1-5f62220e52a7 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:08.336730 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68470e71-a752-4070-a3f1-5f62220e52a7 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:08.336730 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68470e71-a752-4070-a3f1-5f62220e52a7 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:08.338273 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 720/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 14:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:32:08.343660 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260c46b-d1f6-47a6-9645-1ba345d610ce None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:08.344123 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260c46b-d1f6-47a6-9645-1ba345d610ce None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:08.344239 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260c46b-d1f6-47a6-9645-1ba345d610ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:08.414930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-7260c46b-d1f6-47a6-9645-1ba345d610ce None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:32:08.416139 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7260c46b-d1f6-47a6-9645-1ba345d610ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:08.456380 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:08.515767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 743/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 14:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:32:08.801363 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68470e71-a752-4070-a3f1-5f62220e52a7 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:32:08.803350 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-68470e71-a752-4070-a3f1-5f62220e52a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:08.915463 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68470e71-a752-4070-a3f1-5f62220e52a7 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:32:08.955287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:08.994420 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d87c0-7696-4695-af3a-2fb3163ff509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:32:08.995021 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d87c0-7696-4695-af3a-2fb3163ff509 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:08.995304 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d87c0-7696-4695-af3a-2fb3163ff509 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:08.995577 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d87c0-7696-4695-af3a-2fb3163ff509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:08.997172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-052d87c0-7696-4695-af3a-2fb3163ff509 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:09.113055 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d87c0-7696-4695-af3a-2fb3163ff509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:32:09.114124 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d87c0-7696-4695-af3a-2fb3163ff509 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:32:09.135232 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 721/1464] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:32:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:32:11.099658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d06a0-fece-4144-977d-8c206fc276fc None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:11.100262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d06a0-fece-4144-977d-8c206fc276fc None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:11.100262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d06a0-fece-4144-977d-8c206fc276fc None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:11.101553 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 744/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 14:32:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:32:11.107338 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10d795-90f4-4682-8df2-022ee6ee96da None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:11.107786 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10d795-90f4-4682-8df2-022ee6ee96da None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:11.107886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10d795-90f4-4682-8df2-022ee6ee96da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:11.177480 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-3e10d795-90f4-4682-8df2-022ee6ee96da None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:32:11.178731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3e10d795-90f4-4682-8df2-022ee6ee96da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:11.198023 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:11.280565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 722/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 14:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:32:11.569240 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d06a0-fece-4144-977d-8c206fc276fc None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:32:11.570877 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a65d06a0-fece-4144-977d-8c206fc276fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:11.690911 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d06a0-fece-4144-977d-8c206fc276fc None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:32:11.767977 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:11.775834 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e7413-6e42-4787-8dc3-3969becd3e73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:32:11.776439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e7413-6e42-4787-8dc3-3969becd3e73 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:11.776714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e7413-6e42-4787-8dc3-3969becd3e73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:11.776983 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e7413-6e42-4787-8dc3-3969becd3e73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:11.778610 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-586e7413-6e42-4787-8dc3-3969becd3e73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:11.895058 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e7413-6e42-4787-8dc3-3969becd3e73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:32:11.896590 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e7413-6e42-4787-8dc3-3969becd3e73 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:32:11.916841 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 745/1467] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:32:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:32:13.867116 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758cc42-55b6-4da9-b4a1-a6d5d643706b None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:13.867645 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758cc42-55b6-4da9-b4a1-a6d5d643706b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:13.867645 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758cc42-55b6-4da9-b4a1-a6d5d643706b None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:13.869572 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 723/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 14:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:32:13.874763 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055b0fc-bc44-4d27-8696-02069c71664b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:13.875189 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055b0fc-bc44-4d27-8696-02069c71664b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:13.875385 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055b0fc-bc44-4d27-8696-02069c71664b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:13.945435 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-6055b0fc-bc44-4d27-8696-02069c71664b None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:32:13.946695 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6055b0fc-bc44-4d27-8696-02069c71664b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:13.996874 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:14.046100 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 746/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 14:32:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:32:14.334289 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758cc42-55b6-4da9-b4a1-a6d5d643706b None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:32:14.336028 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-7758cc42-55b6-4da9-b4a1-a6d5d643706b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:14.452809 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758cc42-55b6-4da9-b4a1-a6d5d643706b None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:32:14.501618 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:14.529082 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213645e-9baa-4e4e-83a2-1235042b6e45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:32:14.529643 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213645e-9baa-4e4e-83a2-1235042b6e45 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:14.529994 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213645e-9baa-4e4e-83a2-1235042b6e45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:14.530301 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213645e-9baa-4e4e-83a2-1235042b6e45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:14.531914 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3213645e-9baa-4e4e-83a2-1235042b6e45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:14.642899 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213645e-9baa-4e4e-83a2-1235042b6e45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:32:14.644295 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213645e-9baa-4e4e-83a2-1235042b6e45 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:32:14.663884 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 724/1470] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:32:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:32:24.044278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=22 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:24.661258 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=66 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:34.306030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a315a5f-1690-41b9-a3a6-c967b23565c7 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:34.306568 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a315a5f-1690-41b9-a3a6-c967b23565c7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:34.306568 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a315a5f-1690-41b9-a3a6-c967b23565c7 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:34.307910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 747/1471] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:32:34.313165 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da883b-9634-414e-b55d-4274307be9f8 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:34.313639 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da883b-9634-414e-b55d-4274307be9f8 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:34.313739 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da883b-9634-414e-b55d-4274307be9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:34.379440 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a5da883b-9634-414e-b55d-4274307be9f8 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:32:34.380649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a5da883b-9634-414e-b55d-4274307be9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:34.477489 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 725/1472] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:32:34.775157 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22e461-f7e0-42bc-b2ee-e9fe9b1495e1 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:34.775441 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22e461-f7e0-42bc-b2ee-e9fe9b1495e1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:34.775721 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22e461-f7e0-42bc-b2ee-e9fe9b1495e1 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:34.777057 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 748/1473] 10.222.0.65 () {54 vars in 967 bytes} [Wed Aug 24 14:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:32:34.781908 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77980c8f-9d80-42cd-9f43-cf968510466a None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:34.782201 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77980c8f-9d80-42cd-9f43-cf968510466a None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:34.782481 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77980c8f-9d80-42cd-9f43-cf968510466a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:34.857284 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-77980c8f-9d80-42cd-9f43-cf968510466a None None] MFA Rules not processed for user `78745f9dbf544ab291acfa7a063c1493`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:32:34.858537 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-77980c8f-9d80-42cd-9f43-cf968510466a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:34.879604 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:34.934937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 726/1474] 10.222.0.65 () {58 vars in 1064 bytes} [Wed Aug 24 14:32:34 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:32:34.942730 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22e461-f7e0-42bc-b2ee-e9fe9b1495e1 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:32:34.944249 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0f22e461-f7e0-42bc-b2ee-e9fe9b1495e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:35.047721 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22e461-f7e0-42bc-b2ee-e9fe9b1495e1 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:32:35.119337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c04ec-8656-4c4f-b8d3-923135759ff1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78745f9dbf544ab291acfa7a063c1493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:32:35.119931 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c04ec-8656-4c4f-b8d3-923135759ff1 service glance] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:35.120207 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c04ec-8656-4c4f-b8d3-923135759ff1 service glance] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:35.120471 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c04ec-8656-4c4f-b8d3-923135759ff1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:35.122091 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3d0c04ec-8656-4c4f-b8d3-923135759ff1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:35.176490 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:35.231345 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c04ec-8656-4c4f-b8d3-923135759ff1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:32:35.232778 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c04ec-8656-4c4f-b8d3-923135759ff1 service glance] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:32:35.251913 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 749/1475] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:32:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:32:37.257688 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701ed10-f756-4c7c-9177-5831e1a62b0a None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:37.258322 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701ed10-f756-4c7c-9177-5831e1a62b0a None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:37.258322 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701ed10-f756-4c7c-9177-5831e1a62b0a None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:37.259646 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 727/1476] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:32:37.264949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b819dc4-a220-4d22-90c2-9c8d77455ba9 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:37.265365 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b819dc4-a220-4d22-90c2-9c8d77455ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:37.265482 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b819dc4-a220-4d22-90c2-9c8d77455ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:37.329767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-6b819dc4-a220-4d22-90c2-9c8d77455ba9 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:32:37.331475 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6b819dc4-a220-4d22-90c2-9c8d77455ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:37.427216 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 750/1477] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:32:37.698344 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701ed10-f756-4c7c-9177-5831e1a62b0a None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:32:37.699881 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f701ed10-f756-4c7c-9177-5831e1a62b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:37.829723 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701ed10-f756-4c7c-9177-5831e1a62b0a None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:32:37.882611 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:37.927785 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2528975-a474-43c3-849c-bd55443ee375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:32:37.928386 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2528975-a474-43c3-849c-bd55443ee375 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:37.928658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2528975-a474-43c3-849c-bd55443ee375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:37.928924 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2528975-a474-43c3-849c-bd55443ee375 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:37.929558 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2528975-a474-43c3-849c-bd55443ee375 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:32:37.931385 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: WARNING py.warnings [None req-c2528975-a474-43c3-849c-bd55443ee375 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:32:37.931385 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: warnings.warn(msg) Aug 24 14:32:37.931385 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: Aug 24 14:32:37.932532 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2528975-a474-43c3-849c-bd55443ee375 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:32:37.952066 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 728/1478] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 14:32:37 2022] GET /identity/v3/projects => generated 2553 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:32:39.885013 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd569be0-bb34-4b80-afe4-6ad36762e458 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:39.885596 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd569be0-bb34-4b80-afe4-6ad36762e458 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:39.885596 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd569be0-bb34-4b80-afe4-6ad36762e458 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:39.886916 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 751/1479] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:32:39.892189 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed2077-6cf1-4d0e-b31f-a1faf148c8d3 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:39.892599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed2077-6cf1-4d0e-b31f-a1faf148c8d3 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:39.892705 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed2077-6cf1-4d0e-b31f-a1faf148c8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:39.959396 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-8aed2077-6cf1-4d0e-b31f-a1faf148c8d3 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:32:39.960595 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-8aed2077-6cf1-4d0e-b31f-a1faf148c8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:40.056585 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 729/1480] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:32:40.353573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd569be0-bb34-4b80-afe4-6ad36762e458 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:32:40.355199 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-dd569be0-bb34-4b80-afe4-6ad36762e458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:40.365726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:40.502296 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd569be0-bb34-4b80-afe4-6ad36762e458 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:32:40.583060 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:40.615305 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d63cd-92b4-4c1e-a37b-71a0353d6b0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:32:40.615908 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d63cd-92b4-4c1e-a37b-71a0353d6b0a service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:40.616190 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d63cd-92b4-4c1e-a37b-71a0353d6b0a service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:40.616461 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d63cd-92b4-4c1e-a37b-71a0353d6b0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:40.618345 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-995d63cd-92b4-4c1e-a37b-71a0353d6b0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:40.707580 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d63cd-92b4-4c1e-a37b-71a0353d6b0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:32:40.709167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d63cd-92b4-4c1e-a37b-71a0353d6b0a service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:32:40.727462 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 752/1481] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:32:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:32:42.811107 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c3fff-7d19-49bc-8a90-0e35bc103250 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:42.811681 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c3fff-7d19-49bc-8a90-0e35bc103250 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:42.811681 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c3fff-7d19-49bc-8a90-0e35bc103250 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:42.812995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 730/1482] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:32:42.818906 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d8b61-ca82-4493-b3f6-5bc644b7f9fc None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:42.819307 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d8b61-ca82-4493-b3f6-5bc644b7f9fc None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:42.819453 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d8b61-ca82-4493-b3f6-5bc644b7f9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:42.885226 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-701d8b61-ca82-4493-b3f6-5bc644b7f9fc None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:32:42.886909 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-701d8b61-ca82-4493-b3f6-5bc644b7f9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:42.934096 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:42.983822 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 753/1483] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:32:43.270549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c3fff-7d19-49bc-8a90-0e35bc103250 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:32:43.272133 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ae3c3fff-7d19-49bc-8a90-0e35bc103250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:43.295744 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:43.376494 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c3fff-7d19-49bc-8a90-0e35bc103250 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:32:43.449833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339f3dc-443c-40d1-a6ea-df23862abdac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:32:43.450436 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339f3dc-443c-40d1-a6ea-df23862abdac service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:43.450716 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339f3dc-443c-40d1-a6ea-df23862abdac service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:43.450987 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339f3dc-443c-40d1-a6ea-df23862abdac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:43.452611 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f339f3dc-443c-40d1-a6ea-df23862abdac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:43.525632 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:43.560448 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339f3dc-443c-40d1-a6ea-df23862abdac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:32:43.561909 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339f3dc-443c-40d1-a6ea-df23862abdac service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:32:43.580436 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 731/1484] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:32:45.567312 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978e0ba-7d45-4d2e-9aa7-16f86d574f80 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:45.567889 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978e0ba-7d45-4d2e-9aa7-16f86d574f80 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:45.567889 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978e0ba-7d45-4d2e-9aa7-16f86d574f80 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:45.569199 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 754/1485] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:32:45.574538 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2dbf0-3fc9-446c-b095-bf713b76aec7 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:45.574939 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2dbf0-3fc9-446c-b095-bf713b76aec7 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:45.575082 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2dbf0-3fc9-446c-b095-bf713b76aec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:45.641616 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-83c2dbf0-3fc9-446c-b095-bf713b76aec7 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:32:45.642848 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-83c2dbf0-3fc9-446c-b095-bf713b76aec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:45.740552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 732/1486] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:32:46.030720 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978e0ba-7d45-4d2e-9aa7-16f86d574f80 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:32:46.032265 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3978e0ba-7d45-4d2e-9aa7-16f86d574f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:46.136611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978e0ba-7d45-4d2e-9aa7-16f86d574f80 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:32:46.208099 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:46.209895 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c554b6c-c22e-4913-86e3-ead89ca1407e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:32:46.210516 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c554b6c-c22e-4913-86e3-ead89ca1407e service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:46.210784 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c554b6c-c22e-4913-86e3-ead89ca1407e service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:46.211057 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c554b6c-c22e-4913-86e3-ead89ca1407e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:46.212667 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9c554b6c-c22e-4913-86e3-ead89ca1407e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:46.323440 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c554b6c-c22e-4913-86e3-ead89ca1407e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:32:46.324874 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c554b6c-c22e-4913-86e3-ead89ca1407e service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:32:46.343244 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 755/1487] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:32:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:32:48.409634 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d67f8-cde2-4f92-97bc-f162bbb1d595 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:48.410243 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d67f8-cde2-4f92-97bc-f162bbb1d595 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:48.410243 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d67f8-cde2-4f92-97bc-f162bbb1d595 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:48.411583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 733/1488] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:32:48.416892 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97122d-addf-4351-b16e-f3d52190af55 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:48.417431 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97122d-addf-4351-b16e-f3d52190af55 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:48.417431 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97122d-addf-4351-b16e-f3d52190af55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:48.482533 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4e97122d-addf-4351-b16e-f3d52190af55 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:32:48.483742 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4e97122d-addf-4351-b16e-f3d52190af55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:48.535795 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:48.579403 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 756/1489] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:32:48.874127 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d67f8-cde2-4f92-97bc-f162bbb1d595 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:32:48.875677 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-041d67f8-cde2-4f92-97bc-f162bbb1d595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:48.912899 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:48.981245 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d67f8-cde2-4f92-97bc-f162bbb1d595 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:32:49.055001 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c13e6f-3fa4-4016-a419-1dee4e3f6f34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:32:49.055603 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c13e6f-3fa4-4016-a419-1dee4e3f6f34 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:49.055884 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c13e6f-3fa4-4016-a419-1dee4e3f6f34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:49.056195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c13e6f-3fa4-4016-a419-1dee4e3f6f34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:49.057873 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-20c13e6f-3fa4-4016-a419-1dee4e3f6f34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:49.136677 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:49.165278 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c13e6f-3fa4-4016-a419-1dee4e3f6f34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:32:49.166761 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c13e6f-3fa4-4016-a419-1dee4e3f6f34 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:32:49.184875 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 734/1490] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:32:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:32:51.522677 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad707b6b-83f9-4e19-9e05-edfa66912068 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:51.523229 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad707b6b-83f9-4e19-9e05-edfa66912068 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:51.523229 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad707b6b-83f9-4e19-9e05-edfa66912068 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:51.524482 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 757/1491] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 14:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:32:51.529661 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814aaa4-1332-447e-9f51-32777c7a319d None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:51.530095 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814aaa4-1332-447e-9f51-32777c7a319d None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:51.530238 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814aaa4-1332-447e-9f51-32777c7a319d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:51.595771 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a814aaa4-1332-447e-9f51-32777c7a319d None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:32:51.597320 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a814aaa4-1332-447e-9f51-32777c7a319d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:51.695811 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 735/1492] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 14:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:32:52.000554 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad707b6b-83f9-4e19-9e05-edfa66912068 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:32:52.002156 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ad707b6b-83f9-4e19-9e05-edfa66912068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:52.104899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad707b6b-83f9-4e19-9e05-edfa66912068 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:32:52.177174 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60af8ab-ce79-4244-8a6e-c9e418341dd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:32:52.177781 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60af8ab-ce79-4244-8a6e-c9e418341dd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:32:52.178058 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60af8ab-ce79-4244-8a6e-c9e418341dd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:32:52.178327 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60af8ab-ce79-4244-8a6e-c9e418341dd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:32:52.179898 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d60af8ab-ce79-4244-8a6e-c9e418341dd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:32:52.188833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:52.290260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60af8ab-ce79-4244-8a6e-c9e418341dd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:32:52.291692 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60af8ab-ce79-4244-8a6e-c9e418341dd2 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:32:52.309511 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 758/1493] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:33:01.694199 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=82 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:33:02.307314 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=50 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:19.288378 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b918790-598b-4cdc-941e-edc863cb7a6a None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:19.288888 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b918790-598b-4cdc-941e-edc863cb7a6a None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:19.288998 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b918790-598b-4cdc-941e-edc863cb7a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:19.482407 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-5b918790-598b-4cdc-941e-edc863cb7a6a None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:34:19.483625 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-5b918790-598b-4cdc-941e-edc863cb7a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:34:19.579793 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 736/1494] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:34:19.588058 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe0fca-5404-4a32-aaa4-df8e7aacb16b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:19.588549 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe0fca-5404-4a32-aaa4-df8e7aacb16b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:19.588662 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe0fca-5404-4a32-aaa4-df8e7aacb16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:19.665827 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-bfbe0fca-5404-4a32-aaa4-df8e7aacb16b None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:34:19.667041 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-bfbe0fca-5404-4a32-aaa4-df8e7aacb16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:34:19.762488 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 759/1495] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:34:19.767269 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b918790-598b-4cdc-941e-edc863cb7a6a None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:19.768484 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-5b918790-598b-4cdc-941e-edc863cb7a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:34:19.780156 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b918790-598b-4cdc-941e-edc863cb7a6a None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:19.841051 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:19.875232 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7cfab-68de-4d22-995f-ac55681e77fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:19.875978 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7cfab-68de-4d22-995f-ac55681e77fd admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:19.876262 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7cfab-68de-4d22-995f-ac55681e77fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:19.876535 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7cfab-68de-4d22-995f-ac55681e77fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:19.877172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7cfab-68de-4d22-995f-ac55681e77fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:34:19.877470 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7cfab-68de-4d22-995f-ac55681e77fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:19.878511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: WARNING py.warnings [None req-9ec7cfab-68de-4d22-995f-ac55681e77fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:34:19.878511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: warnings.warn(msg) Aug 24 14:34:19.878511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: Aug 24 14:34:19.884739 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7cfab-68de-4d22-995f-ac55681e77fd admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:19.890775 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 737/1496] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:34:19.899203 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe0fca-5404-4a32-aaa4-df8e7aacb16b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:19.909297 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe0fca-5404-4a32-aaa4-df8e7aacb16b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:19.970776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:20.005047 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1f1e2-ec13-4634-82e3-72ac8c9f63d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:20.005641 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1f1e2-ec13-4634-82e3-72ac8c9f63d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:20.005940 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1f1e2-ec13-4634-82e3-72ac8c9f63d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:20.006205 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1f1e2-ec13-4634-82e3-72ac8c9f63d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:20.006826 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1f1e2-ec13-4634-82e3-72ac8c9f63d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:20.008544 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: WARNING py.warnings [None req-ede1f1e2-ec13-4634-82e3-72ac8c9f63d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:34:20.008544 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: warnings.warn(msg) Aug 24 14:34:20.008544 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: Aug 24 14:34:20.009741 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1f1e2-ec13-4634-82e3-72ac8c9f63d7 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:20.124355 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 760/1497] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:34:19 2022] POST /identity/v3/projects => generated 377 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:34:20.128732 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7cfab-68de-4d22-995f-ac55681e77fd admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:20.130279 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9ec7cfab-68de-4d22-995f-ac55681e77fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:34:20.164814 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7cfab-68de-4d22-995f-ac55681e77fd admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:20.258734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb79e2c-8853-42ef-8cf5-4c4f570a310f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:20.258734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb79e2c-8853-42ef-8cf5-4c4f570a310f admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:20.258734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb79e2c-8853-42ef-8cf5-4c4f570a310f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:20.259142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb79e2c-8853-42ef-8cf5-4c4f570a310f admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:20.259577 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb79e2c-8853-42ef-8cf5-4c4f570a310f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:20.260791 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: WARNING py.warnings [None req-edb79e2c-8853-42ef-8cf5-4c4f570a310f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:34:20.260791 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: warnings.warn(msg) Aug 24 14:34:20.260791 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: Aug 24 14:34:20.262044 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb79e2c-8853-42ef-8cf5-4c4f570a310f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:20.357413 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 738/1498] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:34:20 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:34:20.362190 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1f1e2-ec13-4634-82e3-72ac8c9f63d7 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:20.363706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ede1f1e2-ec13-4634-82e3-72ac8c9f63d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:34:20.427683 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1f1e2-ec13-4634-82e3-72ac8c9f63d7 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:20.511480 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:20.521605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d50ac-6e2f-4620-9164-84632438d6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:20.522361 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d50ac-6e2f-4620-9164-84632438d6cf admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:20.522641 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d50ac-6e2f-4620-9164-84632438d6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:20.522913 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d50ac-6e2f-4620-9164-84632438d6cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:20.523554 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d50ac-6e2f-4620-9164-84632438d6cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:20.524561 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: WARNING py.warnings [None req-ca0d50ac-6e2f-4620-9164-84632438d6cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:34:20.524561 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: warnings.warn(msg) Aug 24 14:34:20.524561 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: Aug 24 14:34:20.525450 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d50ac-6e2f-4620-9164-84632438d6cf admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:20.538370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 761/1499] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:34:20.542992 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb79e2c-8853-42ef-8cf5-4c4f570a310f admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:20.544201 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-edb79e2c-8853-42ef-8cf5-4c4f570a310f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:34:20.556704 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb79e2c-8853-42ef-8cf5-4c4f570a310f admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:20.581807 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:20.652363 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f0846-ba0f-4780-9e8d-5dc09409e96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:20.652955 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f0846-ba0f-4780-9e8d-5dc09409e96e admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:20.653489 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f0846-ba0f-4780-9e8d-5dc09409e96e admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:20.653998 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f0846-ba0f-4780-9e8d-5dc09409e96e admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:20.655091 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f0846-ba0f-4780-9e8d-5dc09409e96e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:20.656131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: WARNING py.warnings [None req-217f0846-ba0f-4780-9e8d-5dc09409e96e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:34:20.656131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: warnings.warn(msg) Aug 24 14:34:20.656131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: Aug 24 14:34:20.657537 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f0846-ba0f-4780-9e8d-5dc09409e96e admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:20.669880 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 739/1500] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:34:20.674905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d50ac-6e2f-4620-9164-84632438d6cf admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:20.676725 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ca0d50ac-6e2f-4620-9164-84632438d6cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:34:20.709714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d50ac-6e2f-4620-9164-84632438d6cf admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:20.803043 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81448689-6030-497a-be88-83373a16b344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:20.803687 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81448689-6030-497a-be88-83373a16b344 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:20.803963 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81448689-6030-497a-be88-83373a16b344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:20.804230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81448689-6030-497a-be88-83373a16b344 admin admin] PATH_INFO: `/v3/projects/ab335fc6050d4b1b97c82f5af9217518/users/435a1a9ceb8e4013aaadb6a3005aed81/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:20.825485 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81448689-6030-497a-be88-83373a16b344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab335fc6050d4b1b97c82f5af9217518, user_id=435a1a9ceb8e4013aaadb6a3005aed81, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:20.826533 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: WARNING py.warnings [None req-81448689-6030-497a-be88-83373a16b344 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:34:20.826533 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: warnings.warn(msg) Aug 24 14:34:20.826533 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: Aug 24 14:34:20.829041 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81448689-6030-497a-be88-83373a16b344 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:20.934937 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 762/1501] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:34:20 2022] PUT /identity/v3/projects/ab335fc6050d4b1b97c82f5af9217518/users/435a1a9ceb8e4013aaadb6a3005aed81/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:34:20.947481 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad52a4-1f2f-4b9f-ae78-7295201fa251 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:20.947762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad52a4-1f2f-4b9f-ae78-7295201fa251 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:20.948035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad52a4-1f2f-4b9f-ae78-7295201fa251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:21.004951 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-2dad52a4-1f2f-4b9f-ae78-7295201fa251 None None] MFA Rules not processed for user `435a1a9ceb8e4013aaadb6a3005aed81`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:34:21.006110 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2dad52a4-1f2f-4b9f-ae78-7295201fa251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:34:21.083712 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 740/1502] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:34:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:34:21.097381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bd355-0cd1-46ae-9647-c5a89bf4933d None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:21.097667 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bd355-0cd1-46ae-9647-c5a89bf4933d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:21.097970 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bd355-0cd1-46ae-9647-c5a89bf4933d None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:21.099310 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 763/1503] 10.222.0.65 () {54 vars in 964 bytes} [Wed Aug 24 14:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:34:21.104144 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735c3b2-c5fa-45f2-8b20-64b164766e9c None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:21.104426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735c3b2-c5fa-45f2-8b20-64b164766e9c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:21.104721 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735c3b2-c5fa-45f2-8b20-64b164766e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:21.136273 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:21.182268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-6735c3b2-c5fa-45f2-8b20-64b164766e9c None None] MFA Rules not processed for user `d03ddcf4bcc24f86be508345ad63ab5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:34:21.183485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6735c3b2-c5fa-45f2-8b20-64b164766e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:34:21.259071 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 741/1504] 10.222.0.65 () {58 vars in 1061 bytes} [Wed Aug 24 14:34:21 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:34:21.266664 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bd355-0cd1-46ae-9647-c5a89bf4933d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:21.268203 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f74bd355-0cd1-46ae-9647-c5a89bf4933d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:34:21.318618 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:21.372252 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bd355-0cd1-46ae-9647-c5a89bf4933d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:21.445457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97006fc-dce9-4625-9aae-fd3c738f9ef1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:21.446086 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97006fc-dce9-4625-9aae-fd3c738f9ef1 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:21.446359 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97006fc-dce9-4625-9aae-fd3c738f9ef1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:21.446624 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97006fc-dce9-4625-9aae-fd3c738f9ef1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:21.448203 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f97006fc-dce9-4625-9aae-fd3c738f9ef1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:34:21.544965 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97006fc-dce9-4625-9aae-fd3c738f9ef1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:21.546423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97006fc-dce9-4625-9aae-fd3c738f9ef1 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:21.550178 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:21.564018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 764/1505] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:34:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:34:21.610480 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e83f70-fd73-4af4-ba0d-5c7cca27190d None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:21.610896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e83f70-fd73-4af4-ba0d-5c7cca27190d None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:21.611032 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e83f70-fd73-4af4-ba0d-5c7cca27190d None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:21.612296 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 742/1506] 10.222.0.65 () {52 vars in 830 bytes} [Wed Aug 24 14:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:34:21.616118 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97006fc-dce9-4625-9aae-fd3c738f9ef1 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:21.617316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f97006fc-dce9-4625-9aae-fd3c738f9ef1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:34:21.720205 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97006fc-dce9-4625-9aae-fd3c738f9ef1 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:21.815323 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5059dd-da1b-4aec-a88d-5c7098f5fbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:21.815870 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5059dd-da1b-4aec-a88d-5c7098f5fbe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:21.816150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5059dd-da1b-4aec-a88d-5c7098f5fbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:21.816423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5059dd-da1b-4aec-a88d-5c7098f5fbe1 admin admin] PATH_INFO: `/v3/users/435a1a9ceb8e4013aaadb6a3005aed81` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:21.829420 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5059dd-da1b-4aec-a88d-5c7098f5fbe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=435a1a9ceb8e4013aaadb6a3005aed81)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:21.830483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: WARNING py.warnings [None req-8b5059dd-da1b-4aec-a88d-5c7098f5fbe1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:34:21.830483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: warnings.warn(msg) Aug 24 14:34:21.830483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: Aug 24 14:34:21.831777 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5059dd-da1b-4aec-a88d-5c7098f5fbe1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:21.841535 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:22.041298 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8b5059dd-da1b-4aec-a88d-5c7098f5fbe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435a1a9ceb8e4013aaadb6a3005aed81'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:34:22.041735 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8b5059dd-da1b-4aec-a88d-5c7098f5fbe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435a1a9ceb8e4013aaadb6a3005aed81'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:34:22.042292 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8b5059dd-da1b-4aec-a88d-5c7098f5fbe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435a1a9ceb8e4013aaadb6a3005aed81'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:34:22.065898 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8b5059dd-da1b-4aec-a88d-5c7098f5fbe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435a1a9ceb8e4013aaadb6a3005aed81'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:34:22.128329 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8b5059dd-da1b-4aec-a88d-5c7098f5fbe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435a1a9ceb8e4013aaadb6a3005aed81'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:34:22.147953 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 765/1507] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:34:21 2022] DELETE /identity/v3/users/435a1a9ceb8e4013aaadb6a3005aed81 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:34:22.152321 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300394b-7a3c-4b3b-b1a8-341991e9e0aa None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:22.152696 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300394b-7a3c-4b3b-b1a8-341991e9e0aa None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:22.152972 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300394b-7a3c-4b3b-b1a8-341991e9e0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:22.209893 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a300394b-7a3c-4b3b-b1a8-341991e9e0aa None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:34:22.211113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a300394b-7a3c-4b3b-b1a8-341991e9e0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:34:22.287622 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:22.300069 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 743/1508] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:34:22.309725 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5059dd-da1b-4aec-a88d-5c7098f5fbe1 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:22.313479 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8b5059dd-da1b-4aec-a88d-5c7098f5fbe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:34:22.411056 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5059dd-da1b-4aec-a88d-5c7098f5fbe1 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:22.464731 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:22.483634 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3a950-59ca-4800-ae5d-e9b9f4e02849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:22.485014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3a950-59ca-4800-ae5d-e9b9f4e02849 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:22.485014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3a950-59ca-4800-ae5d-e9b9f4e02849 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:22.485014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3a950-59ca-4800-ae5d-e9b9f4e02849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:22.486420 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f5e3a950-59ca-4800-ae5d-e9b9f4e02849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:34:22.596535 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3a950-59ca-4800-ae5d-e9b9f4e02849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:22.598002 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3a950-59ca-4800-ae5d-e9b9f4e02849 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:22.616835 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 766/1509] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:34:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:34:23.124756 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300394b-7a3c-4b3b-b1a8-341991e9e0aa None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:23.126930 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a300394b-7a3c-4b3b-b1a8-341991e9e0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:34:23.138905 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300394b-7a3c-4b3b-b1a8-341991e9e0aa None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:23.236633 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241fb02-6a6c-4142-8a5a-1c8eb6e54236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:23.237256 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241fb02-6a6c-4142-8a5a-1c8eb6e54236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:23.237529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241fb02-6a6c-4142-8a5a-1c8eb6e54236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:23.237823 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241fb02-6a6c-4142-8a5a-1c8eb6e54236 admin admin] PATH_INFO: `/v3/projects/ab335fc6050d4b1b97c82f5af9217518` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:23.247712 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241fb02-6a6c-4142-8a5a-1c8eb6e54236 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab335fc6050d4b1b97c82f5af9217518)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:23.248722 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: WARNING py.warnings [None req-0241fb02-6a6c-4142-8a5a-1c8eb6e54236 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:34:23.248722 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: warnings.warn(msg) Aug 24 14:34:23.248722 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: Aug 24 14:34:23.249931 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241fb02-6a6c-4142-8a5a-1c8eb6e54236 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:23.367465 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0241fb02-6a6c-4142-8a5a-1c8eb6e54236 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab335fc6050d4b1b97c82f5af9217518', 'request_id': 'req-0241fb02-6a6c-4142-8a5a-1c8eb6e54236'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:34:23.431094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0241fb02-6a6c-4142-8a5a-1c8eb6e54236 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab335fc6050d4b1b97c82f5af9217518', 'request_id': 'req-0241fb02-6a6c-4142-8a5a-1c8eb6e54236'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:34:23.444879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0241fb02-6a6c-4142-8a5a-1c8eb6e54236 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab335fc6050d4b1b97c82f5af9217518', 'request_id': 'req-0241fb02-6a6c-4142-8a5a-1c8eb6e54236'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:34:23.466849 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0241fb02-6a6c-4142-8a5a-1c8eb6e54236 admin admin] The token cache is being invalidate because project ab335fc6050d4b1b97c82f5af9217518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:34:23.467134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0241fb02-6a6c-4142-8a5a-1c8eb6e54236 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:34:23.467655 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0241fb02-6a6c-4142-8a5a-1c8eb6e54236 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:34:23.469461 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 744/1510] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:34:23 2022] DELETE /identity/v3/projects/ab335fc6050d4b1b97c82f5af9217518 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:34:32.614290 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=62 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:33.464821 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:54.572431 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b37ef0-8ba3-4773-a968-90842ce3ea18 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:54.573062 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b37ef0-8ba3-4773-a968-90842ce3ea18 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:54.573062 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b37ef0-8ba3-4773-a968-90842ce3ea18 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:54.574411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 767/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 14:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:54.579102 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2115af-0cc1-4b17-aada-c35010643d93 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:54.579557 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2115af-0cc1-4b17-aada-c35010643d93 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:54.579666 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2115af-0cc1-4b17-aada-c35010643d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:54.660638 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-af2115af-0cc1-4b17-aada-c35010643d93 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:54.661886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-af2115af-0cc1-4b17-aada-c35010643d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:54.767912 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 745/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 14:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:35:54.922430 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b37ef0-8ba3-4773-a968-90842ce3ea18 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:54.924562 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-49b37ef0-8ba3-4773-a968-90842ce3ea18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:55.043159 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b37ef0-8ba3-4773-a968-90842ce3ea18 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:55.048589 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e12cb-5dea-4aa1-981b-3313f68e369f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:55.049191 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e12cb-5dea-4aa1-981b-3313f68e369f service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:55.049472 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e12cb-5dea-4aa1-981b-3313f68e369f service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:55.049764 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e12cb-5dea-4aa1-981b-3313f68e369f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:55.058572 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e12cb-5dea-4aa1-981b-3313f68e369f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:55.060157 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e12cb-5dea-4aa1-981b-3313f68e369f service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:55.070309 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 768/1513] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:35:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:35:55.905061 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409c0d1-d31b-4aae-8f56-d2c1e6d50b5f None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:55.905633 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409c0d1-d31b-4aae-8f56-d2c1e6d50b5f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:55.905633 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409c0d1-d31b-4aae-8f56-d2c1e6d50b5f None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:55.906977 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 746/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 14:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:55.911836 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec438ffe-837e-4a41-9ef9-7387d097f341 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:55.912244 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec438ffe-837e-4a41-9ef9-7387d097f341 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:55.912456 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec438ffe-837e-4a41-9ef9-7387d097f341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:55.931727 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ec438ffe-837e-4a41-9ef9-7387d097f341 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:55.932922 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ec438ffe-837e-4a41-9ef9-7387d097f341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:55.940701 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 769/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 14:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:35:56.092550 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409c0d1-d31b-4aae-8f56-d2c1e6d50b5f None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:56.106889 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409c0d1-d31b-4aae-8f56-d2c1e6d50b5f None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:56.112227 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c78629-f009-45bd-8fdf-7760b60ef036 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:56.112879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c78629-f009-45bd-8fdf-7760b60ef036 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:56.113413 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c78629-f009-45bd-8fdf-7760b60ef036 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:56.113775 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c78629-f009-45bd-8fdf-7760b60ef036 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:56.121711 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c78629-f009-45bd-8fdf-7760b60ef036 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:56.123298 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c78629-f009-45bd-8fdf-7760b60ef036 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:56.133115 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 747/1516] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:35:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:35:56.645895 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298a9f6-3176-4a8b-9679-9802645d368a None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:56.646182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298a9f6-3176-4a8b-9679-9802645d368a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:56.646456 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298a9f6-3176-4a8b-9679-9802645d368a None None] PATH_INFO: `/v3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:56.647803 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 770/1517] 10.222.0.17 () {54 vars in 925 bytes} [Wed Aug 24 14:35:56 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:56.654003 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef522de2-7ebc-4736-8f35-0363a108abb6 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:56.654287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef522de2-7ebc-4736-8f35-0363a108abb6 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:56.654558 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef522de2-7ebc-4736-8f35-0363a108abb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:56.713108 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ef522de2-7ebc-4736-8f35-0363a108abb6 None None] MFA Rules not processed for user `63253cd786c04d6a9d099773198aee36`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:56.714352 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ef522de2-7ebc-4736-8f35-0363a108abb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:56.731353 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:56.787447 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 748/1518] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Aug 24 14:35:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:36:05.926944 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=56 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:05.984129 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7016335-8f57-4e76-9b55-a3e0b7649bc9 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:05.984337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7016335-8f57-4e76-9b55-a3e0b7649bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:05.984615 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7016335-8f57-4e76-9b55-a3e0b7649bc9 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:05.986617 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 771/1519] 10.222.0.65 () {54 vars in 961 bytes} [Wed Aug 24 14:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:05.992877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e65c03-fe1e-463e-80ab-dd6865dd948e None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:05.993343 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e65c03-fe1e-463e-80ab-dd6865dd948e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:05.993573 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e65c03-fe1e-463e-80ab-dd6865dd948e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:06.013229 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-f9e65c03-fe1e-463e-80ab-dd6865dd948e None None] MFA Rules not processed for user `63253cd786c04d6a9d099773198aee36`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:06.014459 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f9e65c03-fe1e-463e-80ab-dd6865dd948e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:06.023606 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 749/1520] 10.222.0.65 () {58 vars in 1058 bytes} [Wed Aug 24 14:36:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:36:06.031001 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7016335-8f57-4e76-9b55-a3e0b7649bc9 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:06.044697 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7016335-8f57-4e76-9b55-a3e0b7649bc9 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:06.049559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1e6ba-c8f9-4001-a08a-6eb95862de6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63253cd786c04d6a9d099773198aee36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:06.050172 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1e6ba-c8f9-4001-a08a-6eb95862de6d service placement] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:06.050448 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1e6ba-c8f9-4001-a08a-6eb95862de6d service placement] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:06.050715 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1e6ba-c8f9-4001-a08a-6eb95862de6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:06.059069 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1e6ba-c8f9-4001-a08a-6eb95862de6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:06.060634 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1e6ba-c8f9-4001-a08a-6eb95862de6d service placement] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:06.070152 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 772/1521] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:36:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:36:07.368617 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037a17a-9da7-43e9-800e-10c1a21c7116 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:07.369174 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037a17a-9da7-43e9-800e-10c1a21c7116 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:07.369174 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037a17a-9da7-43e9-800e-10c1a21c7116 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:07.370552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 750/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 14:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:07.375376 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a8b57-ba95-4c88-a6f0-91561de9233e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:07.375806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a8b57-ba95-4c88-a6f0-91561de9233e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:07.375926 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a8b57-ba95-4c88-a6f0-91561de9233e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:07.394999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-cd4a8b57-ba95-4c88-a6f0-91561de9233e None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:07.396205 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-cd4a8b57-ba95-4c88-a6f0-91561de9233e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:07.404165 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 773/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 14:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:36:07.559384 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037a17a-9da7-43e9-800e-10c1a21c7116 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:07.573867 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037a17a-9da7-43e9-800e-10c1a21c7116 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:07.579195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a0234-2e98-4d08-a8e4-d0855d8bb873 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:07.582649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a0234-2e98-4d08-a8e4-d0855d8bb873 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:07.582649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a0234-2e98-4d08-a8e4-d0855d8bb873 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:07.582649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a0234-2e98-4d08-a8e4-d0855d8bb873 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:07.588819 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a0234-2e98-4d08-a8e4-d0855d8bb873 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:07.590430 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a0234-2e98-4d08-a8e4-d0855d8bb873 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:07.600163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 751/1524] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:36:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:36:08.426508 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2f6dd-7ea6-473f-a5b5-05fc24d1702f None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:08.427077 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2f6dd-7ea6-473f-a5b5-05fc24d1702f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:08.427077 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2f6dd-7ea6-473f-a5b5-05fc24d1702f None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:08.428926 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 774/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 14:36:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:08.433645 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993ff86-e707-4066-bd6c-47f9494383ee None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:08.434081 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993ff86-e707-4066-bd6c-47f9494383ee None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:08.434220 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993ff86-e707-4066-bd6c-47f9494383ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:08.453967 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-f993ff86-e707-4066-bd6c-47f9494383ee None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:08.455239 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f993ff86-e707-4066-bd6c-47f9494383ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:08.463150 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 752/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 14:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:36:08.617113 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2f6dd-7ea6-473f-a5b5-05fc24d1702f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:08.631702 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2f6dd-7ea6-473f-a5b5-05fc24d1702f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:08.637567 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe807d-b81e-4d45-8d96-cc279000f540 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:08.638195 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe807d-b81e-4d45-8d96-cc279000f540 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:08.638471 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe807d-b81e-4d45-8d96-cc279000f540 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:08.638736 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe807d-b81e-4d45-8d96-cc279000f540 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:08.647070 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe807d-b81e-4d45-8d96-cc279000f540 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:08.648691 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe807d-b81e-4d45-8d96-cc279000f540 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:08.658076 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 775/1527] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:36:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:36:12.570837 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74de71-4feb-40ce-8d71-cd30c6387e01 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:12.571419 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74de71-4feb-40ce-8d71-cd30c6387e01 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:12.571419 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74de71-4feb-40ce-8d71-cd30c6387e01 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:12.572729 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 753/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 14:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:12.578251 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584005f-6abe-4cee-9fd6-9cae6adeed0c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:12.578657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584005f-6abe-4cee-9fd6-9cae6adeed0c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:12.578801 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584005f-6abe-4cee-9fd6-9cae6adeed0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:12.598416 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-7584005f-6abe-4cee-9fd6-9cae6adeed0c None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:12.599904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7584005f-6abe-4cee-9fd6-9cae6adeed0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:12.607688 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 776/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 14:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:36:12.903152 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74de71-4feb-40ce-8d71-cd30c6387e01 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:12.904903 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-cc74de71-4feb-40ce-8d71-cd30c6387e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:12.983741 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74de71-4feb-40ce-8d71-cd30c6387e01 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:12.987389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a21ca-fd93-4d4a-9b0e-e7f78fa94472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:12.988302 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a21ca-fd93-4d4a-9b0e-e7f78fa94472 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:12.988541 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a21ca-fd93-4d4a-9b0e-e7f78fa94472 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:12.988813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a21ca-fd93-4d4a-9b0e-e7f78fa94472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:12.997990 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a21ca-fd93-4d4a-9b0e-e7f78fa94472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:12.999407 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a21ca-fd93-4d4a-9b0e-e7f78fa94472 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:13.009069 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 754/1530] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:36:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:36:14.908863 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e842c49-ab39-4377-b18e-f3b9e99742e3 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:14.909425 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e842c49-ab39-4377-b18e-f3b9e99742e3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:14.909425 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e842c49-ab39-4377-b18e-f3b9e99742e3 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:14.910797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 777/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 14:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:14.916073 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9ce11-4b4b-4fad-b42b-0dfaf236d72f None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:14.916526 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9ce11-4b4b-4fad-b42b-0dfaf236d72f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:14.916645 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9ce11-4b4b-4fad-b42b-0dfaf236d72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:14.936349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-c6a9ce11-4b4b-4fad-b42b-0dfaf236d72f None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:14.937547 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c6a9ce11-4b4b-4fad-b42b-0dfaf236d72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:14.946173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 755/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 14:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:36:15.235580 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e842c49-ab39-4377-b18e-f3b9e99742e3 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:15.247204 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e842c49-ab39-4377-b18e-f3b9e99742e3 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:15.251080 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46241d-fa30-41be-bfa1-a6e08ab0338b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:15.251666 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46241d-fa30-41be-bfa1-a6e08ab0338b service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:15.251941 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46241d-fa30-41be-bfa1-a6e08ab0338b service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:15.252210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46241d-fa30-41be-bfa1-a6e08ab0338b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:15.262230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46241d-fa30-41be-bfa1-a6e08ab0338b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:15.263672 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46241d-fa30-41be-bfa1-a6e08ab0338b service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:15.273404 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 778/1533] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:36:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:36:18.678628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed06ec-1f38-4e7a-8382-fc63a0902167 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:18.679180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed06ec-1f38-4e7a-8382-fc63a0902167 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:18.679180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed06ec-1f38-4e7a-8382-fc63a0902167 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:18.680525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 756/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 14:36:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:18.685895 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1c5d9-02bf-480f-8a4f-d694f4e00109 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:18.686348 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1c5d9-02bf-480f-8a4f-d694f4e00109 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:18.686449 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1c5d9-02bf-480f-8a4f-d694f4e00109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:18.706105 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-94a1c5d9-02bf-480f-8a4f-d694f4e00109 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:18.707311 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-94a1c5d9-02bf-480f-8a4f-d694f4e00109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:18.715152 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 779/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 14:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:36:19.270054 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed06ec-1f38-4e7a-8382-fc63a0902167 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:19.272153 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-08ed06ec-1f38-4e7a-8382-fc63a0902167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:19.337083 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:19.350471 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed06ec-1f38-4e7a-8382-fc63a0902167 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:19.354249 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9355e3-48b0-450d-ab00-84a9348ec701 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:19.354718 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9355e3-48b0-450d-ab00-84a9348ec701 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:19.354992 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9355e3-48b0-450d-ab00-84a9348ec701 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:19.355268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9355e3-48b0-450d-ab00-84a9348ec701 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:19.365178 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9355e3-48b0-450d-ab00-84a9348ec701 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:19.367118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9355e3-48b0-450d-ab00-84a9348ec701 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:19.376754 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 757/1536] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:36:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:36:21.296860 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac435a9-8e9b-4701-b7c9-0d8c95ae6904 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:21.297397 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac435a9-8e9b-4701-b7c9-0d8c95ae6904 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:21.297397 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac435a9-8e9b-4701-b7c9-0d8c95ae6904 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:21.298828 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 780/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 14:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:21.304142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d02ed-1436-43ad-ad4e-9f77088cba16 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:21.304610 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d02ed-1436-43ad-ad4e-9f77088cba16 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:21.304727 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d02ed-1436-43ad-ad4e-9f77088cba16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:21.324570 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-1c1d02ed-1436-43ad-ad4e-9f77088cba16 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:21.325802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1c1d02ed-1436-43ad-ad4e-9f77088cba16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:21.334548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 758/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 14:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:36:21.894315 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac435a9-8e9b-4701-b7c9-0d8c95ae6904 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:21.896806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2ac435a9-8e9b-4701-b7c9-0d8c95ae6904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:21.909176 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac435a9-8e9b-4701-b7c9-0d8c95ae6904 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:21.913047 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8980fbc-41b6-42c9-b30e-e2001ca226df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:21.913707 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8980fbc-41b6-42c9-b30e-e2001ca226df service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:21.914007 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8980fbc-41b6-42c9-b30e-e2001ca226df service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:21.914273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8980fbc-41b6-42c9-b30e-e2001ca226df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:21.923279 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8980fbc-41b6-42c9-b30e-e2001ca226df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:21.924709 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8980fbc-41b6-42c9-b30e-e2001ca226df service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:21.934817 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 781/1539] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:36:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:36:31.319420 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=11 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:31.930608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=33 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:46.453870 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e02d68-708b-4d15-aefb-11c7069bdf0c None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:46.459566 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e02d68-708b-4d15-aefb-11c7069bdf0c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:46.459566 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e02d68-708b-4d15-aefb-11c7069bdf0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:46.464625 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629eacf6-34f1-42e4-9c96-151a26b19b84 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:46.465179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629eacf6-34f1-42e4-9c96-151a26b19b84 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:46.465179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629eacf6-34f1-42e4-9c96-151a26b19b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:46.495870 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-e2e02d68-708b-4d15-aefb-11c7069bdf0c None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:46.497131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e2e02d68-708b-4d15-aefb-11c7069bdf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:46.507440 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-629eacf6-34f1-42e4-9c96-151a26b19b84 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:46.508653 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-629eacf6-34f1-42e4-9c96-151a26b19b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:46.516364 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 759/1540] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:46.517539 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274eceb-541a-4389-92ce-462529b73680 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:46.522013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274eceb-541a-4389-92ce-462529b73680 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:46.525344 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274eceb-541a-4389-92ce-462529b73680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:46.530854 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 782/1541] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:37:46.532119 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6818bb6-c171-42ee-99ba-ac48101ba8f1 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:46.532442 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6818bb6-c171-42ee-99ba-ac48101ba8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:46.532725 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6818bb6-c171-42ee-99ba-ac48101ba8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:46.565890 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-6274eceb-541a-4389-92ce-462529b73680 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:46.568217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6274eceb-541a-4389-92ce-462529b73680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:46.578009 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a6818bb6-c171-42ee-99ba-ac48101ba8f1 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:46.579233 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a6818bb6-c171-42ee-99ba-ac48101ba8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:46.584025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 760/1542] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:46.585348 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b6f18-538a-48f7-8953-973c04fa2004 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:46.585644 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b6f18-538a-48f7-8953-973c04fa2004 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:46.585932 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b6f18-538a-48f7-8953-973c04fa2004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:46.592762 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 783/1543] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:46.594090 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f0913-e7d7-44ae-9bcb-7fa68f874893 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:46.594377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f0913-e7d7-44ae-9bcb-7fa68f874893 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:46.594649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f0913-e7d7-44ae-9bcb-7fa68f874893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:46.613356 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-e44b6f18-538a-48f7-8953-973c04fa2004 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:46.615270 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e44b6f18-538a-48f7-8953-973c04fa2004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:46.617616 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-0e2f0913-e7d7-44ae-9bcb-7fa68f874893 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:46.618886 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0e2f0913-e7d7-44ae-9bcb-7fa68f874893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:46.623629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 761/1544] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:46.624817 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79f208-ba1b-4a80-9eed-c589fe3015c9 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:46.625101 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79f208-ba1b-4a80-9eed-c589fe3015c9 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:46.625379 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79f208-ba1b-4a80-9eed-c589fe3015c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:46.627034 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 784/1545] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:46.628183 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bd1ac-d51b-44b8-9435-83ea9f2ba770 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:46.628457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bd1ac-d51b-44b8-9435-83ea9f2ba770 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:46.628730 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bd1ac-d51b-44b8-9435-83ea9f2ba770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:46.645928 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-df79f208-ba1b-4a80-9eed-c589fe3015c9 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:46.647139 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-df79f208-ba1b-4a80-9eed-c589fe3015c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:46.650120 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-605bd1ac-d51b-44b8-9435-83ea9f2ba770 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:46.651289 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-605bd1ac-d51b-44b8-9435-83ea9f2ba770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:46.655605 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 762/1546] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:46.656652 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba844aff-8a8b-4e29-801b-d8368e94fd5a None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:46.656939 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba844aff-8a8b-4e29-801b-d8368e94fd5a None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:46.657215 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba844aff-8a8b-4e29-801b-d8368e94fd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:46.665617 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 785/1547] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:46.666768 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf5ab3-3a1b-48cc-856b-3f48f60e60dd None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:46.667049 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf5ab3-3a1b-48cc-856b-3f48f60e60dd None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:46.667321 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf5ab3-3a1b-48cc-856b-3f48f60e60dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:46.677878 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ba844aff-8a8b-4e29-801b-d8368e94fd5a None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:46.679102 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ba844aff-8a8b-4e29-801b-d8368e94fd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:46.686528 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-21bf5ab3-3a1b-48cc-856b-3f48f60e60dd None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:46.687445 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 763/1548] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:46.687694 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-21bf5ab3-3a1b-48cc-856b-3f48f60e60dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:46.689046 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd2e77-2844-429b-a524-6da1b8c2fa43 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:46.689339 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd2e77-2844-429b-a524-6da1b8c2fa43 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:46.689850 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd2e77-2844-429b-a524-6da1b8c2fa43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:46.697470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 786/1549] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:46.698694 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fc096-2e77-49ae-91f7-a0d9b66e4479 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:46.698983 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fc096-2e77-49ae-91f7-a0d9b66e4479 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:46.699257 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fc096-2e77-49ae-91f7-a0d9b66e4479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:46.711061 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-9fbd2e77-2844-429b-a524-6da1b8c2fa43 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:46.712272 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9fbd2e77-2844-429b-a524-6da1b8c2fa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:46.719332 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d23fc096-2e77-49ae-91f7-a0d9b66e4479 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:46.720298 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 764/1550] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:46.720547 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d23fc096-2e77-49ae-91f7-a0d9b66e4479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:46.721140 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd2e77-2844-429b-a524-6da1b8c2fa43 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:46.730826 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd2e77-2844-429b-a524-6da1b8c2fa43 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:46.731647 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 787/1551] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:46.732447 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fc096-2e77-49ae-91f7-a0d9b66e4479 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:46.735796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad8374-c196-40a2-a462-0f58b7e22325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:46.736386 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad8374-c196-40a2-a462-0f58b7e22325 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:46.736666 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad8374-c196-40a2-a462-0f58b7e22325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:46.736940 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad8374-c196-40a2-a462-0f58b7e22325 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:46.737584 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad8374-c196-40a2-a462-0f58b7e22325 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:46.737915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad8374-c196-40a2-a462-0f58b7e22325 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:46.740199 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad8374-c196-40a2-a462-0f58b7e22325 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:46.748398 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fc096-2e77-49ae-91f7-a0d9b66e4479 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:46.753783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 765/1552] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:46.753783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d278c-d006-4c11-8a46-aeb6c4d156fa None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:46.753783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d278c-d006-4c11-8a46-aeb6c4d156fa None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:46.754092 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d278c-d006-4c11-8a46-aeb6c4d156fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:46.755767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979726e-67dd-455f-8493-cc49c0efa82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:46.756384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979726e-67dd-455f-8493-cc49c0efa82b admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:46.756666 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979726e-67dd-455f-8493-cc49c0efa82b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:46.756945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979726e-67dd-455f-8493-cc49c0efa82b admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:46.757597 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979726e-67dd-455f-8493-cc49c0efa82b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:46.757932 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979726e-67dd-455f-8493-cc49c0efa82b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:46.758937 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: WARNING py.warnings [None req-0979726e-67dd-455f-8493-cc49c0efa82b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:37:46.758937 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: warnings.warn(msg) Aug 24 14:37:46.758937 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: Aug 24 14:37:46.759911 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979726e-67dd-455f-8493-cc49c0efa82b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:46.779177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 788/1553] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:46.779177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0b1f4-768d-4573-a84d-3c4b774bf65e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:46.779177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0b1f4-768d-4573-a84d-3c4b774bf65e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:46.779177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0b1f4-768d-4573-a84d-3c4b774bf65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:46.779610 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-509d278c-d006-4c11-8a46-aeb6c4d156fa None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:46.779610 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-509d278c-d006-4c11-8a46-aeb6c4d156fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:46.783757 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 766/1554] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:46.788014 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d278c-d006-4c11-8a46-aeb6c4d156fa None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:46.793624 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-5ab0b1f4-768d-4573-a84d-3c4b774bf65e None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:46.794792 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5ab0b1f4-768d-4573-a84d-3c4b774bf65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:46.794918 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d278c-d006-4c11-8a46-aeb6c4d156fa None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:46.799488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b2146-54f0-4470-8757-503021b2f976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:46.800079 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b2146-54f0-4470-8757-503021b2f976 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:46.800367 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b2146-54f0-4470-8757-503021b2f976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:46.800640 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b2146-54f0-4470-8757-503021b2f976 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:46.801979 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b2146-54f0-4470-8757-503021b2f976 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:46.802294 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b2146-54f0-4470-8757-503021b2f976 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:46.803202 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 789/1555] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:46.803902 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b2146-54f0-4470-8757-503021b2f976 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:46.804370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df6ccc-bf39-4a24-87bf-c60ad652dec3 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:46.804655 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df6ccc-bf39-4a24-87bf-c60ad652dec3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:46.804931 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df6ccc-bf39-4a24-87bf-c60ad652dec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:46.823415 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 767/1556] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:46.823415 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b2146-54f0-4470-8757-503021b2f976 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:46.827259 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b2146-54f0-4470-8757-503021b2f976 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:46.829835 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-56df6ccc-bf39-4a24-87bf-c60ad652dec3 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:46.831039 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-56df6ccc-bf39-4a24-87bf-c60ad652dec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:46.831991 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fa813-b3ae-4019-b32d-b73d899805cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:46.833114 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fa813-b3ae-4019-b32d-b73d899805cc admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:46.833391 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fa813-b3ae-4019-b32d-b73d899805cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:46.833666 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fa813-b3ae-4019-b32d-b73d899805cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:46.834339 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fa813-b3ae-4019-b32d-b73d899805cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:46.834644 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fa813-b3ae-4019-b32d-b73d899805cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:46.836231 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fa813-b3ae-4019-b32d-b73d899805cc admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:46.840210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 790/1557] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:46.841508 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac13dc-0a1e-4bfb-a214-bb35cf80bdf7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:46.841831 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac13dc-0a1e-4bfb-a214-bb35cf80bdf7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:46.842109 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac13dc-0a1e-4bfb-a214-bb35cf80bdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:46.848755 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 768/1558] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:46.849547 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fa813-b3ae-4019-b32d-b73d899805cc admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:46.861131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fa813-b3ae-4019-b32d-b73d899805cc admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:46.862659 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-33ac13dc-0a1e-4bfb-a214-bb35cf80bdf7 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:46.863892 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-33ac13dc-0a1e-4bfb-a214-bb35cf80bdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:46.866132 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4ebb9-d2a9-476c-a05e-d541840dcc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:46.866728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4ebb9-d2a9-476c-a05e-d541840dcc2d admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:46.867016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4ebb9-d2a9-476c-a05e-d541840dcc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:46.867287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4ebb9-d2a9-476c-a05e-d541840dcc2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:46.867907 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4ebb9-d2a9-476c-a05e-d541840dcc2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:46.868914 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: WARNING py.warnings [None req-fcf4ebb9-d2a9-476c-a05e-d541840dcc2d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:37:46.868914 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: warnings.warn(msg) Aug 24 14:37:46.868914 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: Aug 24 14:37:46.870197 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4ebb9-d2a9-476c-a05e-d541840dcc2d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:46.872481 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 791/1559] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:46.873313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac13dc-0a1e-4bfb-a214-bb35cf80bdf7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:46.885146 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac13dc-0a1e-4bfb-a214-bb35cf80bdf7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:46.889720 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626b411-0644-4050-b1ca-36540ec5c9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:46.890342 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626b411-0644-4050-b1ca-36540ec5c9c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:46.890625 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626b411-0644-4050-b1ca-36540ec5c9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:46.890904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626b411-0644-4050-b1ca-36540ec5c9c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:46.891524 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626b411-0644-4050-b1ca-36540ec5c9c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:46.893431 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626b411-0644-4050-b1ca-36540ec5c9c4 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:47.021682 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 769/1560] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:37:46 2022] POST /identity/v3/projects => generated 387 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:37:47.022553 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4ebb9-d2a9-476c-a05e-d541840dcc2d admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:47.044896 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 792/1561] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:37:46 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:37:47.044896 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626b411-0644-4050-b1ca-36540ec5c9c4 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:47.085507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4ebb9-d2a9-476c-a05e-d541840dcc2d admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:47.107572 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626b411-0644-4050-b1ca-36540ec5c9c4 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:47.112798 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f266a0-ab27-4107-8bb5-20b9078f2616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:47.113428 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f266a0-ab27-4107-8bb5-20b9078f2616 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:47.113738 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f266a0-ab27-4107-8bb5-20b9078f2616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:47.114046 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f266a0-ab27-4107-8bb5-20b9078f2616 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:47.114700 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f266a0-ab27-4107-8bb5-20b9078f2616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:47.115007 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f266a0-ab27-4107-8bb5-20b9078f2616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:47.116618 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f266a0-ab27-4107-8bb5-20b9078f2616 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:47.128783 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 793/1562] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:47.135172 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f266a0-ab27-4107-8bb5-20b9078f2616 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:47.138823 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:47.141470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f266a0-ab27-4107-8bb5-20b9078f2616 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:47.146757 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73725497-9fba-4b41-ac1c-fc32a205ce3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:47.147348 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73725497-9fba-4b41-ac1c-fc32a205ce3b admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:47.147626 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73725497-9fba-4b41-ac1c-fc32a205ce3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:47.147924 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73725497-9fba-4b41-ac1c-fc32a205ce3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:47.148539 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73725497-9fba-4b41-ac1c-fc32a205ce3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:47.149239 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9dfe35-7894-48a4-a50c-71a8a74911ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:47.149971 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9dfe35-7894-48a4-a50c-71a8a74911ac admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:47.154710 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9dfe35-7894-48a4-a50c-71a8a74911ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:47.154819 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73725497-9fba-4b41-ac1c-fc32a205ce3b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:47.154917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9dfe35-7894-48a4-a50c-71a8a74911ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:47.154917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9dfe35-7894-48a4-a50c-71a8a74911ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:47.154917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9dfe35-7894-48a4-a50c-71a8a74911ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:47.154917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9dfe35-7894-48a4-a50c-71a8a74911ac admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:47.165223 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 770/1563] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:47.166125 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9dfe35-7894-48a4-a50c-71a8a74911ac admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:47.176005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9dfe35-7894-48a4-a50c-71a8a74911ac admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:47.181219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdcf341-3c3a-4305-a943-ad6bc78f3199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:47.181835 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcf341-3c3a-4305-a943-ad6bc78f3199 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:47.182116 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcf341-3c3a-4305-a943-ad6bc78f3199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:47.182386 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcf341-3c3a-4305-a943-ad6bc78f3199 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:47.183018 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdcf341-3c3a-4305-a943-ad6bc78f3199 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:47.183324 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdcf341-3c3a-4305-a943-ad6bc78f3199 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:47.184895 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdcf341-3c3a-4305-a943-ad6bc78f3199 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:47.197183 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 771/1564] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:47.197975 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdcf341-3c3a-4305-a943-ad6bc78f3199 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:47.210027 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdcf341-3c3a-4305-a943-ad6bc78f3199 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:47.212434 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6214f-7b30-4c52-a844-d949e6203d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:47.212993 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6214f-7b30-4c52-a844-d949e6203d6d admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:47.213274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6214f-7b30-4c52-a844-d949e6203d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:47.213547 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6214f-7b30-4c52-a844-d949e6203d6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:47.214170 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6214f-7b30-4c52-a844-d949e6203d6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:47.216027 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6214f-7b30-4c52-a844-d949e6203d6d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:47.246833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 794/1565] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:37:47 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:37:47.247679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73725497-9fba-4b41-ac1c-fc32a205ce3b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:47.289222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:47.296990 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 772/1566] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:37:47 2022] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:37:47.296990 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6214f-7b30-4c52-a844-d949e6203d6d admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:47.310693 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73725497-9fba-4b41-ac1c-fc32a205ce3b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:47.360790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6214f-7b30-4c52-a844-d949e6203d6d admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:47.367526 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244f2bf-826d-4e2a-bb00-57a958632802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:47.368138 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244f2bf-826d-4e2a-bb00-57a958632802 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:47.368448 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244f2bf-826d-4e2a-bb00-57a958632802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:47.368722 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244f2bf-826d-4e2a-bb00-57a958632802 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:47.369343 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244f2bf-826d-4e2a-bb00-57a958632802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:47.371308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244f2bf-826d-4e2a-bb00-57a958632802 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:47.372753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76e192-05c9-4f19-bf4e-8a399398d7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:47.373359 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76e192-05c9-4f19-bf4e-8a399398d7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:47.373636 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76e192-05c9-4f19-bf4e-8a399398d7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:47.373937 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76e192-05c9-4f19-bf4e-8a399398d7e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:47.374579 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76e192-05c9-4f19-bf4e-8a399398d7e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:47.374876 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76e192-05c9-4f19-bf4e-8a399398d7e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:47.376446 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76e192-05c9-4f19-bf4e-8a399398d7e0 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:47.387951 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 795/1567] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:47.388729 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76e192-05c9-4f19-bf4e-8a399398d7e0 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:47.398682 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76e192-05c9-4f19-bf4e-8a399398d7e0 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:47.403744 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0a26a-6efb-46ee-966e-012b058029c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:47.404317 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0a26a-6efb-46ee-966e-012b058029c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:47.404593 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0a26a-6efb-46ee-966e-012b058029c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:47.404863 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0a26a-6efb-46ee-966e-012b058029c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:47.405466 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0a26a-6efb-46ee-966e-012b058029c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:47.411566 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: WARNING py.warnings [None req-04e0a26a-6efb-46ee-966e-012b058029c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:37:47.411566 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: warnings.warn(msg) Aug 24 14:37:47.411566 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: Aug 24 14:37:47.412927 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0a26a-6efb-46ee-966e-012b058029c3 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:47.478016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 773/1568] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:37:47 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:37:47.478827 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244f2bf-826d-4e2a-bb00-57a958632802 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:47.488438 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244f2bf-826d-4e2a-bb00-57a958632802 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:47.493721 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5ac4c-fd18-4363-8022-832d530c969c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:47.494315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5ac4c-fd18-4363-8022-832d530c969c admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:47.494592 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5ac4c-fd18-4363-8022-832d530c969c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:47.494864 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5ac4c-fd18-4363-8022-832d530c969c admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:47.495463 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5ac4c-fd18-4363-8022-832d530c969c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:47.497339 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5ac4c-fd18-4363-8022-832d530c969c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:47.512142 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 796/1569] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:37:47 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:37:47.513233 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0a26a-6efb-46ee-966e-012b058029c3 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:47.523704 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0a26a-6efb-46ee-966e-012b058029c3 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:47.528330 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb343c77-313e-41e0-90ce-7fbe946ce8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:47.528919 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb343c77-313e-41e0-90ce-7fbe946ce8b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:47.529193 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb343c77-313e-41e0-90ce-7fbe946ce8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:47.529462 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb343c77-313e-41e0-90ce-7fbe946ce8b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:47.530104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb343c77-313e-41e0-90ce-7fbe946ce8b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:47.532004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb343c77-313e-41e0-90ce-7fbe946ce8b1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:47.605332 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 774/1570] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:37:47 2022] POST /identity/v3/projects => generated 405 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:37:47.606127 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5ac4c-fd18-4363-8022-832d530c969c admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:47.648084 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 797/1571] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:37:47 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:37:47.648084 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb343c77-313e-41e0-90ce-7fbe946ce8b1 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:47.669404 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5ac4c-fd18-4363-8022-832d530c969c admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:47.689727 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:47.711659 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb343c77-313e-41e0-90ce-7fbe946ce8b1 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:47.716272 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6857b-5612-4ddd-a328-bcf3e082461e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:47.716872 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6857b-5612-4ddd-a328-bcf3e082461e admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:47.717182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6857b-5612-4ddd-a328-bcf3e082461e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:47.717436 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6857b-5612-4ddd-a328-bcf3e082461e admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:47.718098 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6857b-5612-4ddd-a328-bcf3e082461e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:47.720036 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6857b-5612-4ddd-a328-bcf3e082461e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:47.727212 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509cd2a-8de8-4dfd-bbe6-54de8948bcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:47.727991 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509cd2a-8de8-4dfd-bbe6-54de8948bcb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:47.730251 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509cd2a-8de8-4dfd-bbe6-54de8948bcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:47.730251 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509cd2a-8de8-4dfd-bbe6-54de8948bcb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:47.730251 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509cd2a-8de8-4dfd-bbe6-54de8948bcb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:47.731534 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509cd2a-8de8-4dfd-bbe6-54de8948bcb5 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:47.798521 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 798/1572] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:37:47 2022] POST /identity/v3/users => generated 290 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:37:47.799326 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6857b-5612-4ddd-a328-bcf3e082461e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:47.809474 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6857b-5612-4ddd-a328-bcf3e082461e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:47.810634 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 775/1573] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:37:47 2022] POST /identity/v3/projects => generated 391 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:37:47.811444 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509cd2a-8de8-4dfd-bbe6-54de8948bcb5 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:47.839438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:47.874485 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25704f55-fc44-4541-8f47-884a970e3e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:47.875012 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25704f55-fc44-4541-8f47-884a970e3e0d admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:47.875287 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25704f55-fc44-4541-8f47-884a970e3e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:47.875384 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509cd2a-8de8-4dfd-bbe6-54de8948bcb5 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:47.875676 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25704f55-fc44-4541-8f47-884a970e3e0d admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:47.876329 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25704f55-fc44-4541-8f47-884a970e3e0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:47.878379 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25704f55-fc44-4541-8f47-884a970e3e0d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:47.880094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889da2d-eedb-45a3-a49a-f93b6e10d850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:47.880774 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889da2d-eedb-45a3-a49a-f93b6e10d850 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:47.881057 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889da2d-eedb-45a3-a49a-f93b6e10d850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:47.881332 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889da2d-eedb-45a3-a49a-f93b6e10d850 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:47.881982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889da2d-eedb-45a3-a49a-f93b6e10d850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:47.883937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889da2d-eedb-45a3-a49a-f93b6e10d850 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:47.968373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 799/1574] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:37:47 2022] POST /identity/v3/users => generated 284 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:37:47.969351 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25704f55-fc44-4541-8f47-884a970e3e0d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:47.980398 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25704f55-fc44-4541-8f47-884a970e3e0d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:47.982982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 776/1575] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:37:47 2022] POST /identity/v3/projects => generated 401 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:37:47.982982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889da2d-eedb-45a3-a49a-f93b6e10d850 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:48.038745 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23768a7f-8402-42a6-a695-aea0f8be728f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:48.039350 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23768a7f-8402-42a6-a695-aea0f8be728f admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.039622 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23768a7f-8402-42a6-a695-aea0f8be728f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.039913 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23768a7f-8402-42a6-a695-aea0f8be728f admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.040548 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23768a7f-8402-42a6-a695-aea0f8be728f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:48.042171 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23768a7f-8402-42a6-a695-aea0f8be728f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:48.045213 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889da2d-eedb-45a3-a49a-f93b6e10d850 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:48.049927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d2c4d-2dc4-4a73-96e7-43f24240f3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:48.050545 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d2c4d-2dc4-4a73-96e7-43f24240f3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.050813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d2c4d-2dc4-4a73-96e7-43f24240f3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.051074 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d2c4d-2dc4-4a73-96e7-43f24240f3b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.051720 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d2c4d-2dc4-4a73-96e7-43f24240f3b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:48.051874 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 800/1576] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:37:48.053181 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23768a7f-8402-42a6-a695-aea0f8be728f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:48.054238 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d2c4d-2dc4-4a73-96e7-43f24240f3b3 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:48.062787 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23768a7f-8402-42a6-a695-aea0f8be728f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:48.067379 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 777/1577] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:37:48.067379 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d2c4d-2dc4-4a73-96e7-43f24240f3b3 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:48.067674 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe901d-29e0-4c97-9b74-d2795c004265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:48.068129 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe901d-29e0-4c97-9b74-d2795c004265 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.068402 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe901d-29e0-4c97-9b74-d2795c004265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.068673 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe901d-29e0-4c97-9b74-d2795c004265 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.069275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe901d-29e0-4c97-9b74-d2795c004265 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:48.071193 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe901d-29e0-4c97-9b74-d2795c004265 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:48.075039 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d2c4d-2dc4-4a73-96e7-43f24240f3b3 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:48.079595 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7511a-d154-44d9-8130-787f1beee2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:48.080174 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7511a-d154-44d9-8130-787f1beee2f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.080452 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7511a-d154-44d9-8130-787f1beee2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.080727 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7511a-d154-44d9-8130-787f1beee2f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.081332 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7511a-d154-44d9-8130-787f1beee2f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:48.083278 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7511a-d154-44d9-8130-787f1beee2f1 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:48.141594 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 801/1578] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:37:48 2022] POST /identity/v3/users => generated 303 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:37:48.142570 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe901d-29e0-4c97-9b74-d2795c004265 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:48.152385 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe901d-29e0-4c97-9b74-d2795c004265 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:48.156951 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080d669-7a54-44bb-aa2c-860fe61f1a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:48.157527 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080d669-7a54-44bb-aa2c-860fe61f1a09 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.157830 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080d669-7a54-44bb-aa2c-860fe61f1a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.158101 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080d669-7a54-44bb-aa2c-860fe61f1a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.158730 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5080d669-7a54-44bb-aa2c-860fe61f1a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:48.160304 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5080d669-7a54-44bb-aa2c-860fe61f1a09 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:48.166100 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 778/1579] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:37:48 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:37:48.167063 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7511a-d154-44d9-8130-787f1beee2f1 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:48.175144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 802/1580] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:37:48.175144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080d669-7a54-44bb-aa2c-860fe61f1a09 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:48.179695 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7511a-d154-44d9-8130-787f1beee2f1 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:48.183936 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080d669-7a54-44bb-aa2c-860fe61f1a09 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:48.184325 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f320d7a-55d8-4748-a861-1bb1a3950e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:48.184900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f320d7a-55d8-4748-a861-1bb1a3950e97 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.185176 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f320d7a-55d8-4748-a861-1bb1a3950e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.185446 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f320d7a-55d8-4748-a861-1bb1a3950e97 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.186198 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f320d7a-55d8-4748-a861-1bb1a3950e97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:48.188116 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f320d7a-55d8-4748-a861-1bb1a3950e97 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:48.188509 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43751bca-dd05-4e3d-8de5-e758f87cff59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:48.189095 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43751bca-dd05-4e3d-8de5-e758f87cff59 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.189371 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43751bca-dd05-4e3d-8de5-e758f87cff59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.189642 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43751bca-dd05-4e3d-8de5-e758f87cff59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.190300 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43751bca-dd05-4e3d-8de5-e758f87cff59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:48.191862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43751bca-dd05-4e3d-8de5-e758f87cff59 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:48.199555 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:48.201901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 803/1581] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:37:48.202744 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43751bca-dd05-4e3d-8de5-e758f87cff59 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:48.213852 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43751bca-dd05-4e3d-8de5-e758f87cff59 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:48.218416 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d1ed8-303a-4afb-b2e7-102b5f913d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:48.218986 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d1ed8-303a-4afb-b2e7-102b5f913d51 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.219264 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d1ed8-303a-4afb-b2e7-102b5f913d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.219536 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d1ed8-303a-4afb-b2e7-102b5f913d51 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.220143 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d1ed8-303a-4afb-b2e7-102b5f913d51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:48.222067 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d1ed8-303a-4afb-b2e7-102b5f913d51 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:48.268594 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 779/1582] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:37:48 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:37:48.269578 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f320d7a-55d8-4748-a861-1bb1a3950e97 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:48.280017 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f320d7a-55d8-4748-a861-1bb1a3950e97 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:48.284738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998aa65-d43b-4372-a2b3-7eff2c765183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:48.285329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998aa65-d43b-4372-a2b3-7eff2c765183 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.285611 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998aa65-d43b-4372-a2b3-7eff2c765183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.285917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998aa65-d43b-4372-a2b3-7eff2c765183 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.287218 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998aa65-d43b-4372-a2b3-7eff2c765183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:48.288912 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998aa65-d43b-4372-a2b3-7eff2c765183 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:48.296123 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 804/1583] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:37:48 2022] POST /identity/v3/users => generated 301 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:37:48.296123 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d1ed8-303a-4afb-b2e7-102b5f913d51 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:48.302329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 780/1584] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:37:48.302329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998aa65-d43b-4372-a2b3-7eff2c765183 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:48.308556 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d1ed8-303a-4afb-b2e7-102b5f913d51 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:48.310265 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998aa65-d43b-4372-a2b3-7eff2c765183 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:48.313342 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bb615-59ae-4c4a-bf5d-948e9c7b1e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:48.313970 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bb615-59ae-4c4a-bf5d-948e9c7b1e58 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.314248 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bb615-59ae-4c4a-bf5d-948e9c7b1e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.314518 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bb615-59ae-4c4a-bf5d-948e9c7b1e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.314856 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535c41a-7e08-415f-a0ff-95f209ab9990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:48.315204 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3bb615-59ae-4c4a-bf5d-948e9c7b1e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:48.315431 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535c41a-7e08-415f-a0ff-95f209ab9990 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.315730 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535c41a-7e08-415f-a0ff-95f209ab9990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.315984 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535c41a-7e08-415f-a0ff-95f209ab9990 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.316613 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535c41a-7e08-415f-a0ff-95f209ab9990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:48.316788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3bb615-59ae-4c4a-bf5d-948e9c7b1e58 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:48.318291 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535c41a-7e08-415f-a0ff-95f209ab9990 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:48.327995 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 805/1585] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:37:48.328904 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 781/1586] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:37:48.328904 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535c41a-7e08-415f-a0ff-95f209ab9990 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:48.329071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bb615-59ae-4c4a-bf5d-948e9c7b1e58 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:48.339600 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bb615-59ae-4c4a-bf5d-948e9c7b1e58 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:48.340622 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535c41a-7e08-415f-a0ff-95f209ab9990 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:48.344473 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1d4ec-d0f7-4e20-909d-b5ee9059a168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:48.345074 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1d4ec-d0f7-4e20-909d-b5ee9059a168 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.345233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2763d-4427-4c4b-8d4b-4396d9e6bbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:48.345351 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1d4ec-d0f7-4e20-909d-b5ee9059a168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.345613 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1d4ec-d0f7-4e20-909d-b5ee9059a168 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.345794 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2763d-4427-4c4b-8d4b-4396d9e6bbf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.346091 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2763d-4427-4c4b-8d4b-4396d9e6bbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.346276 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1d4ec-d0f7-4e20-909d-b5ee9059a168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:48.346740 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2763d-4427-4c4b-8d4b-4396d9e6bbf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.347539 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2763d-4427-4c4b-8d4b-4396d9e6bbf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:48.347864 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1d4ec-d0f7-4e20-909d-b5ee9059a168 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:48.350226 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2763d-4427-4c4b-8d4b-4396d9e6bbf1 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:48.358568 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 806/1587] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:37:48.359366 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1d4ec-d0f7-4e20-909d-b5ee9059a168 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:48.364050 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 782/1588] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:37:48.364050 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2763d-4427-4c4b-8d4b-4396d9e6bbf1 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:48.370658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1d4ec-d0f7-4e20-909d-b5ee9059a168 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:48.371555 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2763d-4427-4c4b-8d4b-4396d9e6bbf1 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:48.375272 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f7034-4904-40d9-b090-fba9522a8c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:48.375859 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f7034-4904-40d9-b090-fba9522a8c07 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.376094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05993309-6323-488a-982c-f97f9d221e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:48.376212 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f7034-4904-40d9-b090-fba9522a8c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.376391 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f7034-4904-40d9-b090-fba9522a8c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.376666 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05993309-6323-488a-982c-f97f9d221e26 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.376947 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05993309-6323-488a-982c-f97f9d221e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.377063 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f7034-4904-40d9-b090-fba9522a8c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:48.377218 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05993309-6323-488a-982c-f97f9d221e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.377870 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05993309-6323-488a-982c-f97f9d221e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:48.378616 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f7034-4904-40d9-b090-fba9522a8c07 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:48.379432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05993309-6323-488a-982c-f97f9d221e26 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:48.388766 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 807/1589] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:37:48.389345 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 783/1590] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:37:48.389568 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f7034-4904-40d9-b090-fba9522a8c07 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:48.392843 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05993309-6323-488a-982c-f97f9d221e26 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:48.399793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f7034-4904-40d9-b090-fba9522a8c07 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:48.402738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05993309-6323-488a-982c-f97f9d221e26 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:48.404410 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bb22f-5950-4d95-8eff-c39a15c5a861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:48.405015 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bb22f-5950-4d95-8eff-c39a15c5a861 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.405293 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bb22f-5950-4d95-8eff-c39a15c5a861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.405564 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bb22f-5950-4d95-8eff-c39a15c5a861 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.406221 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23bb22f-5950-4d95-8eff-c39a15c5a861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:48.407278 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4a351-8ae2-4437-8a24-a23eadef1ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:48.407796 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23bb22f-5950-4d95-8eff-c39a15c5a861 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:48.407906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4a351-8ae2-4437-8a24-a23eadef1ffa admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.408171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4a351-8ae2-4437-8a24-a23eadef1ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.408444 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4a351-8ae2-4437-8a24-a23eadef1ffa admin admin] PATH_INFO: `/v3/projects/25aaf7039f994f4a83bf8ce6db68f3a1/users/fbdf19910c234794b8aeb480dba50d85/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.418608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 808/1591] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:37:48.419371 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bb22f-5950-4d95-8eff-c39a15c5a861 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:48.423859 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4a351-8ae2-4437-8a24-a23eadef1ffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=25aaf7039f994f4a83bf8ce6db68f3a1, user_id=fbdf19910c234794b8aeb480dba50d85, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:48.424872 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: WARNING py.warnings [None req-f6a4a351-8ae2-4437-8a24-a23eadef1ffa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:37:48.424872 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: warnings.warn(msg) Aug 24 14:37:48.424872 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: Aug 24 14:37:48.426853 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4a351-8ae2-4437-8a24-a23eadef1ffa admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:48.429741 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bb22f-5950-4d95-8eff-c39a15c5a861 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:48.434478 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503db8d-9c20-421e-b052-92b3034456da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:48.435123 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503db8d-9c20-421e-b052-92b3034456da admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.435430 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503db8d-9c20-421e-b052-92b3034456da admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.435702 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503db8d-9c20-421e-b052-92b3034456da admin admin] PATH_INFO: `/v3/projects/d2659c6241284e89b2acf6cfd8ae24f0/users/31fba1b1ca7f412aa374a6e7298e32b7/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.447303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:48.451032 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b503db8d-9c20-421e-b052-92b3034456da admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2659c6241284e89b2acf6cfd8ae24f0, user_id=31fba1b1ca7f412aa374a6e7298e32b7, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:48.453674 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b503db8d-9c20-421e-b052-92b3034456da admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:48.496576 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 784/1592] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:37:48 2022] PUT /identity/v3/projects/25aaf7039f994f4a83bf8ce6db68f3a1/users/fbdf19910c234794b8aeb480dba50d85/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:37:48.497394 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4a351-8ae2-4437-8a24-a23eadef1ffa admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:48.526973 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 809/1593] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:37:48 2022] PUT /identity/v3/projects/d2659c6241284e89b2acf6cfd8ae24f0/users/31fba1b1ca7f412aa374a6e7298e32b7/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:37:48.527544 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503db8d-9c20-421e-b052-92b3034456da admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:48.573034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4a351-8ae2-4437-8a24-a23eadef1ffa admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:48.590626 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503db8d-9c20-421e-b052-92b3034456da admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:48.595251 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5401948-6ffb-4aa2-b5ad-9ef0923befd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:48.595908 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5401948-6ffb-4aa2-b5ad-9ef0923befd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.596192 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5401948-6ffb-4aa2-b5ad-9ef0923befd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.596473 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5401948-6ffb-4aa2-b5ad-9ef0923befd9 admin admin] PATH_INFO: `/v3/projects/3afce3a011534835893040caf18b19a5/users/7b0a0a0664744f378ca4e17e914f4259/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.612812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5401948-6ffb-4aa2-b5ad-9ef0923befd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3afce3a011534835893040caf18b19a5, user_id=7b0a0a0664744f378ca4e17e914f4259, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:48.616419 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5401948-6ffb-4aa2-b5ad-9ef0923befd9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:48.629305 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1160aea-7566-49ee-9e42-65f135af84ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:48.629935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1160aea-7566-49ee-9e42-65f135af84ac admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.630510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1160aea-7566-49ee-9e42-65f135af84ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.630790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1160aea-7566-49ee-9e42-65f135af84ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.631426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1160aea-7566-49ee-9e42-65f135af84ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:48.632995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1160aea-7566-49ee-9e42-65f135af84ac admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:48.642509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 785/1594] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:37:48.643720 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1160aea-7566-49ee-9e42-65f135af84ac admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:48.652536 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1160aea-7566-49ee-9e42-65f135af84ac admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:48.657379 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786c79e-dc76-4843-ac36-16d762bbfd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:48.657945 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786c79e-dc76-4843-ac36-16d762bbfd89 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.658225 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786c79e-dc76-4843-ac36-16d762bbfd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.658492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786c79e-dc76-4843-ac36-16d762bbfd89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.659087 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a786c79e-dc76-4843-ac36-16d762bbfd89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:48.660776 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a786c79e-dc76-4843-ac36-16d762bbfd89 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:48.670915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 786/1595] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:37:48.671677 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786c79e-dc76-4843-ac36-16d762bbfd89 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:48.681629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786c79e-dc76-4843-ac36-16d762bbfd89 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:48.686247 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81031d-8da9-4208-b6dd-56ba8e01f4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:48.686788 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81031d-8da9-4208-b6dd-56ba8e01f4be admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.687066 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81031d-8da9-4208-b6dd-56ba8e01f4be admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.687337 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81031d-8da9-4208-b6dd-56ba8e01f4be admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.687936 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81031d-8da9-4208-b6dd-56ba8e01f4be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:48.689610 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81031d-8da9-4208-b6dd-56ba8e01f4be admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:48.696534 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 810/1596] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:37:48 2022] PUT /identity/v3/projects/3afce3a011534835893040caf18b19a5/users/7b0a0a0664744f378ca4e17e914f4259/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:37:48.697423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5401948-6ffb-4aa2-b5ad-9ef0923befd9 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:48.706460 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 787/1597] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:37:48.706460 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81031d-8da9-4208-b6dd-56ba8e01f4be admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:48.714256 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81031d-8da9-4208-b6dd-56ba8e01f4be admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:48.718797 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:48.761011 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5401948-6ffb-4aa2-b5ad-9ef0923befd9 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:48.765705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66204842-9b86-405c-8cc0-00bbac3fd3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:48.766655 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66204842-9b86-405c-8cc0-00bbac3fd3ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.766770 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66204842-9b86-405c-8cc0-00bbac3fd3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.766949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66204842-9b86-405c-8cc0-00bbac3fd3ba admin admin] PATH_INFO: `/v3/projects/75b83442ad4441d49b02d7ff3df9fe1b/users/a9daaf6a88b74bb4a11ab8e3f122fa82/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.769128 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659ceb7-a8e7-40aa-957f-61d9f0f71a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:48.769728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659ceb7-a8e7-40aa-957f-61d9f0f71a8e admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.770032 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659ceb7-a8e7-40aa-957f-61d9f0f71a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.770304 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659ceb7-a8e7-40aa-957f-61d9f0f71a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.770972 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a659ceb7-a8e7-40aa-957f-61d9f0f71a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:48.772557 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a659ceb7-a8e7-40aa-957f-61d9f0f71a8e admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:48.781846 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66204842-9b86-405c-8cc0-00bbac3fd3ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=75b83442ad4441d49b02d7ff3df9fe1b, user_id=a9daaf6a88b74bb4a11ab8e3f122fa82, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:48.782162 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 788/1598] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:37:48.783359 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fedbe-1acd-409e-a172-bf5356e4b27f None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.783645 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fedbe-1acd-409e-a172-bf5356e4b27f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.784034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fedbe-1acd-409e-a172-bf5356e4b27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.784709 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66204842-9b86-405c-8cc0-00bbac3fd3ba admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:48.803846 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-835fedbe-1acd-409e-a172-bf5356e4b27f None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:48.805066 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-835fedbe-1acd-409e-a172-bf5356e4b27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:48.812712 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 789/1599] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:48.814030 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c6d58-6f42-434a-a775-e72e2d799718 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.814316 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c6d58-6f42-434a-a775-e72e2d799718 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.814592 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c6d58-6f42-434a-a775-e72e2d799718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.841327 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-de9c6d58-6f42-434a-a775-e72e2d799718 None None] MFA Rules not processed for user `31fba1b1ca7f412aa374a6e7298e32b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:48.842560 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-de9c6d58-6f42-434a-a775-e72e2d799718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:48.883368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 811/1600] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:37:48 2022] PUT /identity/v3/projects/75b83442ad4441d49b02d7ff3df9fe1b/users/a9daaf6a88b74bb4a11ab8e3f122fa82/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:37:48.884262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66204842-9b86-405c-8cc0-00bbac3fd3ba admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:48.908180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 790/1601] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:48.908918 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c6d58-6f42-434a-a775-e72e2d799718 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:48.922455 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c6d58-6f42-434a-a775-e72e2d799718 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:48.957228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:48.961737 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66204842-9b86-405c-8cc0-00bbac3fd3ba admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:48.966422 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2835e-ea4a-467d-ae25-1558f08e6acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:48.967072 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2835e-ea4a-467d-ae25-1558f08e6acc admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.967380 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2835e-ea4a-467d-ae25-1558f08e6acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.967678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2835e-ea4a-467d-ae25-1558f08e6acc admin admin] PATH_INFO: `/v3/projects/4c499faddb204af092900c6319dbe425/users/34a6ee60b33c416e82decddaa8d1aba9/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.983194 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2835e-ea4a-467d-ae25-1558f08e6acc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c499faddb204af092900c6319dbe425, user_id=34a6ee60b33c416e82decddaa8d1aba9, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:48.986329 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2835e-ea4a-467d-ae25-1558f08e6acc admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:48.989178 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e195ab7-e74f-4097-b29b-387dc5cb71fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:48.990416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e195ab7-e74f-4097-b29b-387dc5cb71fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.990878 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e195ab7-e74f-4097-b29b-387dc5cb71fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.991305 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e195ab7-e74f-4097-b29b-387dc5cb71fc admin admin] PATH_INFO: `/v3/projects/2395c1dafb6a4174a7dd095c4809c181/users/556b3a886df740cda4a94e55d2fcc08a/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:49.006323 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e195ab7-e74f-4097-b29b-387dc5cb71fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2395c1dafb6a4174a7dd095c4809c181, user_id=556b3a886df740cda4a94e55d2fcc08a, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:49.008982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e195ab7-e74f-4097-b29b-387dc5cb71fc admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:49.062033 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 812/1602] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:37:48 2022] PUT /identity/v3/projects/4c499faddb204af092900c6319dbe425/users/34a6ee60b33c416e82decddaa8d1aba9/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:37:49.063471 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef735c-ffca-4306-ae88-d838d523f275 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:49.063758 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef735c-ffca-4306-ae88-d838d523f275 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:49.064029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef735c-ffca-4306-ae88-d838d523f275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:49.082928 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f5ef735c-ffca-4306-ae88-d838d523f275 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:49.084384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f5ef735c-ffca-4306-ae88-d838d523f275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:49.091082 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 791/1603] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:37:48 2022] PUT /identity/v3/projects/2395c1dafb6a4174a7dd095c4809c181/users/556b3a886df740cda4a94e55d2fcc08a/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:37:49.094068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e195ab7-e74f-4097-b29b-387dc5cb71fc admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:49.104135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:49.148197 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 813/1604] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:49.149024 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef735c-ffca-4306-ae88-d838d523f275 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:49.154729 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e195ab7-e74f-4097-b29b-387dc5cb71fc admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:49.158393 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef735c-ffca-4306-ae88-d838d523f275 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:49.159771 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc45ffa-a1a4-4da6-8bb1-a53f40b554bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:49.160417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc45ffa-a1a4-4da6-8bb1-a53f40b554bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:49.160699 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc45ffa-a1a4-4da6-8bb1-a53f40b554bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:49.160974 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc45ffa-a1a4-4da6-8bb1-a53f40b554bf admin admin] PATH_INFO: `/v3/projects/6c5abfb715e14ddf84e0b4519a3d724b/users/3acc0010e3f54283934b75f58bb6ec93/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:49.163296 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3f845-dcb5-48a5-b081-958badb788f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:49.163954 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3f845-dcb5-48a5-b081-958badb788f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:49.164221 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3f845-dcb5-48a5-b081-958badb788f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:49.164496 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3f845-dcb5-48a5-b081-958badb788f8 admin admin] PATH_INFO: `/v3/projects/e96f8f39127f41a4ada132a0e55c34e9/users/ed623918834e479b800c53b40e17e7de/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:49.175977 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc45ffa-a1a4-4da6-8bb1-a53f40b554bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c5abfb715e14ddf84e0b4519a3d724b, user_id=3acc0010e3f54283934b75f58bb6ec93, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:49.179302 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc45ffa-a1a4-4da6-8bb1-a53f40b554bf admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:49.180415 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3f845-dcb5-48a5-b081-958badb788f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e96f8f39127f41a4ada132a0e55c34e9, user_id=ed623918834e479b800c53b40e17e7de, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:49.183162 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3f845-dcb5-48a5-b081-958badb788f8 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:49.284632 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 792/1605] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:37:49 2022] PUT /identity/v3/projects/6c5abfb715e14ddf84e0b4519a3d724b/users/3acc0010e3f54283934b75f58bb6ec93/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:37:49.287207 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc45ffa-a1a4-4da6-8bb1-a53f40b554bf admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:49.308893 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 814/1606] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:37:49 2022] PUT /identity/v3/projects/e96f8f39127f41a4ada132a0e55c34e9/users/ed623918834e479b800c53b40e17e7de/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:37:49.310452 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d65ed-c57b-4ed0-8e04-471fc8843269 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:49.310735 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d65ed-c57b-4ed0-8e04-471fc8843269 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:49.311006 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d65ed-c57b-4ed0-8e04-471fc8843269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:49.339480 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c98d65ed-c57b-4ed0-8e04-471fc8843269 None None] MFA Rules not processed for user `a9daaf6a88b74bb4a11ab8e3f122fa82`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:49.340710 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c98d65ed-c57b-4ed0-8e04-471fc8843269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:49.344197 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc45ffa-a1a4-4da6-8bb1-a53f40b554bf admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:49.395989 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29345ef4-e39d-4b2b-9c34-67a978dc694d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:49.396598 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29345ef4-e39d-4b2b-9c34-67a978dc694d service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:49.396885 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29345ef4-e39d-4b2b-9c34-67a978dc694d service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:49.397239 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29345ef4-e39d-4b2b-9c34-67a978dc694d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:49.407212 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 815/1607] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:49.408605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e458e-8923-4c00-9d69-e75a9ecffa1b None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:49.408853 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e458e-8923-4c00-9d69-e75a9ecffa1b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:49.409132 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e458e-8923-4c00-9d69-e75a9ecffa1b None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:49.410502 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 816/1608] 10.222.0.65 () {54 vars in 962 bytes} [Wed Aug 24 14:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:37:49.412240 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cd4d7-d4a6-4826-a90b-15dec2170479 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:49.412524 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cd4d7-d4a6-4826-a90b-15dec2170479 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:49.412859 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cd4d7-d4a6-4826-a90b-15dec2170479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:49.432884 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-555cd4d7-d4a6-4826-a90b-15dec2170479 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:49.434193 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-555cd4d7-d4a6-4826-a90b-15dec2170479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:49.462620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29345ef4-e39d-4b2b-9c34-67a978dc694d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:49.464072 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29345ef4-e39d-4b2b-9c34-67a978dc694d service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:49.469092 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:49.473638 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:49.475135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 793/1609] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:37:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:37:49.476553 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ae8d1-3902-4ab6-8395-0ed231779f00 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:49.476847 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ae8d1-3902-4ab6-8395-0ed231779f00 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:49.490317 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ae8d1-3902-4ab6-8395-0ed231779f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:49.493440 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 817/1610] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:49.496742 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cd4d7-d4a6-4826-a90b-15dec2170479 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:49.498260 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ea2ae8d1-3902-4ab6-8395-0ed231779f00 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:49.499674 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ea2ae8d1-3902-4ab6-8395-0ed231779f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:49.503606 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cd4d7-d4a6-4826-a90b-15dec2170479 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:49.512262 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 794/1611] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:49.512448 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976b1cd-2a91-4fed-8712-8f78637cc0a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:49.512448 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976b1cd-2a91-4fed-8712-8f78637cc0a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:49.512448 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976b1cd-2a91-4fed-8712-8f78637cc0a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:49.517868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3527da4-9c28-4006-899f-304d49ecc9f2 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:49.518078 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976b1cd-2a91-4fed-8712-8f78637cc0a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:49.518191 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3527da4-9c28-4006-899f-304d49ecc9f2 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:49.518191 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3527da4-9c28-4006-899f-304d49ecc9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:49.522568 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d976b1cd-2a91-4fed-8712-8f78637cc0a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:49.524098 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d976b1cd-2a91-4fed-8712-8f78637cc0a4 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:49.531113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-e3527da4-9c28-4006-899f-304d49ecc9f2 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:49.532112 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e3527da4-9c28-4006-899f-304d49ecc9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:49.535267 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 818/1612] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:37:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:37:49.537155 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f7c8b-a248-4aaf-86bd-cbe133f94e77 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:49.537517 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f7c8b-a248-4aaf-86bd-cbe133f94e77 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:49.538002 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f7c8b-a248-4aaf-86bd-cbe133f94e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:49.546143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 795/1613] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:49.546143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71b25f-00c7-40a6-9b5d-26364a4cdcf8 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:49.546143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71b25f-00c7-40a6-9b5d-26364a4cdcf8 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:49.546143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71b25f-00c7-40a6-9b5d-26364a4cdcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:49.575017 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-cb7f7c8b-a248-4aaf-86bd-cbe133f94e77 None None] MFA Rules not processed for user `ed623918834e479b800c53b40e17e7de`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:49.576230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-cb7f7c8b-a248-4aaf-86bd-cbe133f94e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:49.584898 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-df71b25f-00c7-40a6-9b5d-26364a4cdcf8 None None] MFA Rules not processed for user `8d099678d6454f7eb494892a69feaf62`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:49.586145 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-df71b25f-00c7-40a6-9b5d-26364a4cdcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:49.652043 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 819/1614] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:49 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:49.653025 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f7c8b-a248-4aaf-86bd-cbe133f94e77 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:49.666457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 796/1615] 10.222.0.65 () {58 vars in 1059 bytes} [Wed Aug 24 14:37:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:49.667856 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71b25f-00c7-40a6-9b5d-26364a4cdcf8 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:49.670166 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-df71b25f-00c7-40a6-9b5d-26364a4cdcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:49.683008 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71b25f-00c7-40a6-9b5d-26364a4cdcf8 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:49.687220 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b2f16-b93c-47ee-b85c-a5008664cedf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:49.688641 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b2f16-b93c-47ee-b85c-a5008664cedf service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:49.688870 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b2f16-b93c-47ee-b85c-a5008664cedf service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:49.689324 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b2f16-b93c-47ee-b85c-a5008664cedf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:49.703119 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b2f16-b93c-47ee-b85c-a5008664cedf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:49.704587 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b2f16-b93c-47ee-b85c-a5008664cedf service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:49.715912 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 797/1616] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:37:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:37:49.716741 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b2f16-b93c-47ee-b85c-a5008664cedf service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:49.726693 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b2f16-b93c-47ee-b85c-a5008664cedf service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:49.730904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f7c8b-a248-4aaf-86bd-cbe133f94e77 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:49.731332 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158af4e2-bff7-4a9f-afde-a19ed7d5fd5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:49.740340 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158af4e2-bff7-4a9f-afde-a19ed7d5fd5c service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:49.740340 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158af4e2-bff7-4a9f-afde-a19ed7d5fd5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:49.740340 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158af4e2-bff7-4a9f-afde-a19ed7d5fd5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:49.740717 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebb3b3-3a9e-40eb-aba3-151d067ad1c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:49.740717 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebb3b3-3a9e-40eb-aba3-151d067ad1c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:49.740717 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebb3b3-3a9e-40eb-aba3-151d067ad1c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:49.740717 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebb3b3-3a9e-40eb-aba3-151d067ad1c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:49.747934 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ebb3b3-3a9e-40eb-aba3-151d067ad1c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:49.748278 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158af4e2-bff7-4a9f-afde-a19ed7d5fd5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:49.749574 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ebb3b3-3a9e-40eb-aba3-151d067ad1c7 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:49.749734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158af4e2-bff7-4a9f-afde-a19ed7d5fd5c service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:49.760062 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 820/1617] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:37:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:37:49.760947 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebb3b3-3a9e-40eb-aba3-151d067ad1c7 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:49.761236 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 798/1618] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:37:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:37:49.762255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158af4e2-bff7-4a9f-afde-a19ed7d5fd5c service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:49.770091 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebb3b3-3a9e-40eb-aba3-151d067ad1c7 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:49.773405 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158af4e2-bff7-4a9f-afde-a19ed7d5fd5c service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:49.774918 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b331698-064a-4363-a7ca-c8e4888ffefe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:49.775537 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b331698-064a-4363-a7ca-c8e4888ffefe service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:49.775890 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b331698-064a-4363-a7ca-c8e4888ffefe service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:49.776260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b331698-064a-4363-a7ca-c8e4888ffefe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:49.787404 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146c9e8-3274-450a-9e22-391d139f93de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:49.788234 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146c9e8-3274-450a-9e22-391d139f93de admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:49.788593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146c9e8-3274-450a-9e22-391d139f93de admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:49.788939 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146c9e8-3274-450a-9e22-391d139f93de admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:49.790135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146c9e8-3274-450a-9e22-391d139f93de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:49.790453 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b331698-064a-4363-a7ca-c8e4888ffefe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:49.792322 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b331698-064a-4363-a7ca-c8e4888ffefe service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:49.792694 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146c9e8-3274-450a-9e22-391d139f93de admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:49.804346 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 821/1619] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:37:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:37:49.805254 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b331698-064a-4363-a7ca-c8e4888ffefe service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:49.818048 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b331698-064a-4363-a7ca-c8e4888ffefe service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:49.829560 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a2558-4574-44da-aa5d-3d2723da5862 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:49.830451 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a2558-4574-44da-aa5d-3d2723da5862 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:49.830451 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a2558-4574-44da-aa5d-3d2723da5862 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:49.830684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a2558-4574-44da-aa5d-3d2723da5862 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:49.901480 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:49.913518 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a2558-4574-44da-aa5d-3d2723da5862 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:49.916962 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a2558-4574-44da-aa5d-3d2723da5862 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:49.925250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 799/1620] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:37:49 2022] POST /identity/v3/projects => generated 405 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:37:49.929809 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146c9e8-3274-450a-9e22-391d139f93de admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:49.933209 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 822/1621] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:37:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:37:50.054575 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146c9e8-3274-450a-9e22-391d139f93de admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:50.059976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bfb44-9e7e-4624-b9d5-3d2bcfb824c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:50.060607 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bfb44-9e7e-4624-b9d5-3d2bcfb824c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:50.061464 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bfb44-9e7e-4624-b9d5-3d2bcfb824c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:50.061886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bfb44-9e7e-4624-b9d5-3d2bcfb824c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:50.062459 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31bfb44-9e7e-4624-b9d5-3d2bcfb824c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:50.064598 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31bfb44-9e7e-4624-b9d5-3d2bcfb824c3 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:50.171754 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 800/1622] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:37:49 2022] POST /identity/v3/users => generated 309 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:37:50.174551 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a2558-4574-44da-aa5d-3d2723da5862 service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:50.188799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a2558-4574-44da-aa5d-3d2723da5862 service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:50.196492 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a76c37-ff09-4f0a-9001-71dfd8fb8dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:50.198001 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a76c37-ff09-4f0a-9001-71dfd8fb8dea admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:50.198458 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a76c37-ff09-4f0a-9001-71dfd8fb8dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:50.198901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a76c37-ff09-4f0a-9001-71dfd8fb8dea admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:50.202950 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a76c37-ff09-4f0a-9001-71dfd8fb8dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:50.202950 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a76c37-ff09-4f0a-9001-71dfd8fb8dea admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:50.220088 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 823/1623] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:37:50.221939 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bfb44-9e7e-4624-b9d5-3d2bcfb824c3 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:50.258800 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bfb44-9e7e-4624-b9d5-3d2bcfb824c3 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:50.266532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d012c88-4a13-4c3b-9c92-221b7456f27a None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:50.266532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d012c88-4a13-4c3b-9c92-221b7456f27a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:50.266532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d012c88-4a13-4c3b-9c92-221b7456f27a None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:50.266532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 824/1624] 10.222.0.65 () {54 vars in 912 bytes} [Wed Aug 24 14:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:37:50.268594 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd11520-f1e3-4671-9a96-5964bddff347 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:50.269261 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd11520-f1e3-4671-9a96-5964bddff347 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:50.269261 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd11520-f1e3-4671-9a96-5964bddff347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:50.271668 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97628498-fbb8-4608-ad8a-08bd3f51be93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:50.273151 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97628498-fbb8-4608-ad8a-08bd3f51be93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:50.273669 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97628498-fbb8-4608-ad8a-08bd3f51be93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:50.273894 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97628498-fbb8-4608-ad8a-08bd3f51be93 admin admin] PATH_INFO: `/v3/projects/a125df27de0a47338bc3428ac5fd047d/users/74e7668674c84459b783e56f9cbe70ad/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:50.284105 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:50.291377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-9bd11520-f1e3-4671-9a96-5964bddff347 None None] MFA Rules not processed for user `8d099678d6454f7eb494892a69feaf62`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:50.295071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9bd11520-f1e3-4671-9a96-5964bddff347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:50.312854 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97628498-fbb8-4608-ad8a-08bd3f51be93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a125df27de0a47338bc3428ac5fd047d, user_id=74e7668674c84459b783e56f9cbe70ad, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:50.318161 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97628498-fbb8-4608-ad8a-08bd3f51be93 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:50.410716 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 801/1625] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:37:50 2022] PUT /identity/v3/projects/a125df27de0a47338bc3428ac5fd047d/users/74e7668674c84459b783e56f9cbe70ad/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:37:50.415779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97628498-fbb8-4608-ad8a-08bd3f51be93 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:50.432473 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 825/1626] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 14:37:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:37:50.448305 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd11520-f1e3-4671-9a96-5964bddff347 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:50.554680 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97628498-fbb8-4608-ad8a-08bd3f51be93 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:50.584309 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c532fa-9928-4e78-948b-24d8ec12c404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:50.586365 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c532fa-9928-4e78-948b-24d8ec12c404 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:50.586613 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c532fa-9928-4e78-948b-24d8ec12c404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:50.586971 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c532fa-9928-4e78-948b-24d8ec12c404 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:50.588168 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c532fa-9928-4e78-948b-24d8ec12c404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:50.591421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c532fa-9928-4e78-948b-24d8ec12c404 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:50.609548 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd11520-f1e3-4671-9a96-5964bddff347 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:50.619059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 802/1627] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:37:50.622917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c532fa-9928-4e78-948b-24d8ec12c404 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:50.649164 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c532fa-9928-4e78-948b-24d8ec12c404 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:50.659254 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83269f9a-b454-4fdc-a657-4b67ac255d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:50.660929 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83269f9a-b454-4fdc-a657-4b67ac255d7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:50.662791 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83269f9a-b454-4fdc-a657-4b67ac255d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:50.663740 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83269f9a-b454-4fdc-a657-4b67ac255d7f admin admin] PATH_INFO: `/v3/projects/a125df27de0a47338bc3428ac5fd047d/users/74e7668674c84459b783e56f9cbe70ad/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:50.666315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83269f9a-b454-4fdc-a657-4b67ac255d7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a125df27de0a47338bc3428ac5fd047d, user_id=74e7668674c84459b783e56f9cbe70ad, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:50.670763 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83269f9a-b454-4fdc-a657-4b67ac255d7f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:50.700860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 803/1628] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:37:50 2022] PUT /identity/v3/projects/a125df27de0a47338bc3428ac5fd047d/users/74e7668674c84459b783e56f9cbe70ad/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:37:50.706136 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9bc21-b781-4131-90d8-82ca159d4ad8 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:50.706435 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9bc21-b781-4131-90d8-82ca159d4ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:50.707697 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9bc21-b781-4131-90d8-82ca159d4ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:50.722027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968377e-d181-4222-8115-60379f9bf204 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:50.722861 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968377e-d181-4222-8115-60379f9bf204 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:50.723204 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968377e-d181-4222-8115-60379f9bf204 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:50.723598 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968377e-d181-4222-8115-60379f9bf204 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:50.774384 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a8e9bc21-b781-4131-90d8-82ca159d4ad8 None None] MFA Rules not processed for user `74e7668674c84459b783e56f9cbe70ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:50.775637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a8e9bc21-b781-4131-90d8-82ca159d4ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:50.805604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:50.869453 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968377e-d181-4222-8115-60379f9bf204 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:50.871524 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968377e-d181-4222-8115-60379f9bf204 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:50.889215 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 804/1629] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:50 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:50.889426 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 826/1630] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:37:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:37:50.958091 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9bc21-b781-4131-90d8-82ca159d4ad8 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:51.070693 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9bc21-b781-4131-90d8-82ca159d4ad8 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:51.075681 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e98ce-65a3-4d9d-b3dd-5569f2072167 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:51.076299 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e98ce-65a3-4d9d-b3dd-5569f2072167 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:51.076576 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e98ce-65a3-4d9d-b3dd-5569f2072167 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:51.076848 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e98ce-65a3-4d9d-b3dd-5569f2072167 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:51.086952 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:51.091274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e98ce-65a3-4d9d-b3dd-5569f2072167 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:51.094310 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e98ce-65a3-4d9d-b3dd-5569f2072167 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:51.109613 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 805/1631] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:37:50 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:37:51.488149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968377e-d181-4222-8115-60379f9bf204 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:51.500881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968377e-d181-4222-8115-60379f9bf204 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:51.609538 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb017e-4692-488f-8ed3-f77906749725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:51.614553 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb017e-4692-488f-8ed3-f77906749725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:51.614553 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb017e-4692-488f-8ed3-f77906749725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:51.614553 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb017e-4692-488f-8ed3-f77906749725 admin admin] PATH_INFO: `/v3/users/ed623918834e479b800c53b40e17e7de` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:51.614553 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb017e-4692-488f-8ed3-f77906749725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed623918834e479b800c53b40e17e7de)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:51.620006 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb017e-4692-488f-8ed3-f77906749725 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:51.913486 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-39bb017e-4692-488f-8ed3-f77906749725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed623918834e479b800c53b40e17e7de'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:37:51.914142 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-39bb017e-4692-488f-8ed3-f77906749725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed623918834e479b800c53b40e17e7de'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:37:51.915359 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-39bb017e-4692-488f-8ed3-f77906749725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed623918834e479b800c53b40e17e7de'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:37:51.939344 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6cff9-aaa3-4813-bc41-5bae2a34c995 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:51.939835 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6cff9-aaa3-4813-bc41-5bae2a34c995 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:51.939926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6cff9-aaa3-4813-bc41-5bae2a34c995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:51.949203 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-39bb017e-4692-488f-8ed3-f77906749725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed623918834e479b800c53b40e17e7de'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:37:51.985628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-88a6cff9-aaa3-4813-bc41-5bae2a34c995 None None] MFA Rules not processed for user `34a6ee60b33c416e82decddaa8d1aba9`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:51.987210 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-88a6cff9-aaa3-4813-bc41-5bae2a34c995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:52.073930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-39bb017e-4692-488f-8ed3-f77906749725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed623918834e479b800c53b40e17e7de'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:37:52.096215 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 827/1632] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:37:51 2022] DELETE /identity/v3/users/ed623918834e479b800c53b40e17e7de => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:37:52.101147 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f03ee-5b8e-4666-85c1-6eac0b3ac5dd None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:52.101499 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f03ee-5b8e-4666-85c1-6eac0b3ac5dd None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:52.107525 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f03ee-5b8e-4666-85c1-6eac0b3ac5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:52.110827 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 806/1633] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:51 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:52.115288 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6cff9-aaa3-4813-bc41-5bae2a34c995 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:52.120510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-88a6cff9-aaa3-4813-bc41-5bae2a34c995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:52.146824 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-da9f03ee-5b8e-4666-85c1-6eac0b3ac5dd None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:52.148053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-da9f03ee-5b8e-4666-85c1-6eac0b3ac5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:52.153996 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6cff9-aaa3-4813-bc41-5bae2a34c995 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:52.246433 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:52.321796 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 828/1634] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:52.338963 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f03ee-5b8e-4666-85c1-6eac0b3ac5dd None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:52.340576 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-da9f03ee-5b8e-4666-85c1-6eac0b3ac5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:52.366945 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483cdeb1-7ba1-4b8e-a72a-c4bc4df79496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:52.367743 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cdeb1-7ba1-4b8e-a72a-c4bc4df79496 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:52.367949 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cdeb1-7ba1-4b8e-a72a-c4bc4df79496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:52.368220 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cdeb1-7ba1-4b8e-a72a-c4bc4df79496 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:52.370636 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483cdeb1-7ba1-4b8e-a72a-c4bc4df79496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:52.372661 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483cdeb1-7ba1-4b8e-a72a-c4bc4df79496 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:52.436271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f03ee-5b8e-4666-85c1-6eac0b3ac5dd None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:52.441088 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43deca2-b2af-4bd1-b0b4-1549998bcf5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:52.441710 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43deca2-b2af-4bd1-b0b4-1549998bcf5b service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:52.442021 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43deca2-b2af-4bd1-b0b4-1549998bcf5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:52.442298 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43deca2-b2af-4bd1-b0b4-1549998bcf5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:52.459480 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43deca2-b2af-4bd1-b0b4-1549998bcf5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:52.462380 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43deca2-b2af-4bd1-b0b4-1549998bcf5b service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:52.489080 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 829/1635] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:37:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:37:52.532136 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 807/1636] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:37:52 2022] POST /identity/v3/projects => generated 405 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:37:52.539901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43deca2-b2af-4bd1-b0b4-1549998bcf5b service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:52.551412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43deca2-b2af-4bd1-b0b4-1549998bcf5b service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:52.663113 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b86df-7ea2-4dc0-a5db-4d389ee2f1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:52.663919 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b86df-7ea2-4dc0-a5db-4d389ee2f1e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:52.664355 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b86df-7ea2-4dc0-a5db-4d389ee2f1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:52.664635 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b86df-7ea2-4dc0-a5db-4d389ee2f1e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:52.665270 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b86df-7ea2-4dc0-a5db-4d389ee2f1e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:52.667299 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b86df-7ea2-4dc0-a5db-4d389ee2f1e6 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:52.776062 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51812e-ba37-4d54-b7fd-deb63c2886d9 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:52.776833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51812e-ba37-4d54-b7fd-deb63c2886d9 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:52.777722 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51812e-ba37-4d54-b7fd-deb63c2886d9 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:52.780220 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 808/1637] 10.222.0.65 () {54 vars in 962 bytes} [Wed Aug 24 14:37:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:37:52.793975 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 830/1638] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:37:52 2022] POST /identity/v3/users => generated 309 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:37:52.796988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f9a10-76b5-42ac-90b1-02c8f89ba0a3 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:52.797500 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f9a10-76b5-42ac-90b1-02c8f89ba0a3 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:52.797798 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b86df-7ea2-4dc0-a5db-4d389ee2f1e6 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:52.799114 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f9a10-76b5-42ac-90b1-02c8f89ba0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:52.810215 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b86df-7ea2-4dc0-a5db-4d389ee2f1e6 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:52.818131 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d68e1-03c9-4af5-ae28-2d605692842f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:52.819060 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d68e1-03c9-4af5-ae28-2d605692842f admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:52.819722 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d68e1-03c9-4af5-ae28-2d605692842f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:52.820002 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d68e1-03c9-4af5-ae28-2d605692842f admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:52.820661 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d68e1-03c9-4af5-ae28-2d605692842f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:52.822317 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d68e1-03c9-4af5-ae28-2d605692842f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:53.081424 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-335f9a10-76b5-42ac-90b1-02c8f89ba0a3 None None] MFA Rules not processed for user `8d099678d6454f7eb494892a69feaf62`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:53.085099 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 831/1639] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:37:53.085522 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-335f9a10-76b5-42ac-90b1-02c8f89ba0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:53.086173 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d68e1-03c9-4af5-ae28-2d605692842f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:53.086173 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d68e1-03c9-4af5-ae28-2d605692842f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:53.086173 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe63d1-940c-443c-bf3c-6aea99820b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:53.086173 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe63d1-940c-443c-bf3c-6aea99820b2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:53.086765 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe63d1-940c-443c-bf3c-6aea99820b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:53.086765 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe63d1-940c-443c-bf3c-6aea99820b2d admin admin] PATH_INFO: `/v3/projects/966d61f09a32466093ade22b35c01917/users/5a425aca2b064455baa360d51bc7337e/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:53.086765 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe63d1-940c-443c-bf3c-6aea99820b2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=966d61f09a32466093ade22b35c01917, user_id=5a425aca2b064455baa360d51bc7337e, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:53.086765 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe63d1-940c-443c-bf3c-6aea99820b2d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:53.087254 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:53.087254 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 809/1640] 10.222.0.65 () {58 vars in 1059 bytes} [Wed Aug 24 14:37:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:53.087254 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e66393-a889-4ed7-81f0-c569d8aec0d7 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:53.087254 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e66393-a889-4ed7-81f0-c569d8aec0d7 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:53.087254 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e66393-a889-4ed7-81f0-c569d8aec0d7 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:53.087254 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 810/1641] 10.222.0.65 () {54 vars in 912 bytes} [Wed Aug 24 14:37:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:37:53.087254 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0284c82-fb02-42a0-b50c-074e5742a209 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:53.088007 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0284c82-fb02-42a0-b50c-074e5742a209 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:53.088007 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0284c82-fb02-42a0-b50c-074e5742a209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:53.088220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 832/1642] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:37:52 2022] PUT /identity/v3/projects/966d61f09a32466093ade22b35c01917/users/5a425aca2b064455baa360d51bc7337e/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:37:53.088220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe63d1-940c-443c-bf3c-6aea99820b2d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:53.088464 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-c0284c82-fb02-42a0-b50c-074e5742a209 None None] MFA Rules not processed for user `8d099678d6454f7eb494892a69feaf62`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:53.088464 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c0284c82-fb02-42a0-b50c-074e5742a209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:53.176328 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe63d1-940c-443c-bf3c-6aea99820b2d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:53.185495 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b244707-9eb0-4906-81db-b66039638dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:53.186737 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b244707-9eb0-4906-81db-b66039638dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:53.187842 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b244707-9eb0-4906-81db-b66039638dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:53.188356 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b244707-9eb0-4906-81db-b66039638dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:53.189280 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b244707-9eb0-4906-81db-b66039638dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:53.191949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b244707-9eb0-4906-81db-b66039638dd4 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:53.209242 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 811/1643] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 14:37:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:37:53.210217 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 833/1644] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:37:53.215294 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0284c82-fb02-42a0-b50c-074e5742a209 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:53.225380 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b244707-9eb0-4906-81db-b66039638dd4 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:53.231508 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3b244707-9eb0-4906-81db-b66039638dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:53.249438 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0284c82-fb02-42a0-b50c-074e5742a209 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:53.265275 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6fe7c-6cf0-4cb6-8914-6f9d260545fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:53.268500 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6fe7c-6cf0-4cb6-8914-6f9d260545fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:53.271979 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6fe7c-6cf0-4cb6-8914-6f9d260545fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:53.271979 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6fe7c-6cf0-4cb6-8914-6f9d260545fc admin admin] PATH_INFO: `/v3/projects/966d61f09a32466093ade22b35c01917/users/5a425aca2b064455baa360d51bc7337e/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:53.277532 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6fe7c-6cf0-4cb6-8914-6f9d260545fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=966d61f09a32466093ade22b35c01917, user_id=5a425aca2b064455baa360d51bc7337e, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:53.295511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6fe7c-6cf0-4cb6-8914-6f9d260545fc admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:53.338554 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 812/1645] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:37:53 2022] PUT /identity/v3/projects/966d61f09a32466093ade22b35c01917/users/5a425aca2b064455baa360d51bc7337e/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:37:53.394283 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b244707-9eb0-4906-81db-b66039638dd4 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:53.466023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ef466-daee-4074-b4a0-282f2e368a9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:53.467313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ef466-daee-4074-b4a0-282f2e368a9e service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:53.467764 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ef466-daee-4074-b4a0-282f2e368a9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:53.468100 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ef466-daee-4074-b4a0-282f2e368a9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:53.583063 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ef466-daee-4074-b4a0-282f2e368a9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:53.585522 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ef466-daee-4074-b4a0-282f2e368a9e service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:53.602254 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 834/1646] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:37:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:37:54.111384 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6fe7c-6cf0-4cb6-8914-6f9d260545fc admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:54.115022 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-abf6fe7c-6cf0-4cb6-8914-6f9d260545fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:54.234870 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6fe7c-6cf0-4cb6-8914-6f9d260545fc admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:54.241447 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6e905-c1ab-489d-ae04-a685008460f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:54.242409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6e905-c1ab-489d-ae04-a685008460f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:54.243147 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6e905-c1ab-489d-ae04-a685008460f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:54.243622 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6e905-c1ab-489d-ae04-a685008460f5 admin admin] PATH_INFO: `/v3/projects/e96f8f39127f41a4ada132a0e55c34e9` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:54.244876 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6e905-c1ab-489d-ae04-a685008460f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e96f8f39127f41a4ada132a0e55c34e9)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:54.247470 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6e905-c1ab-489d-ae04-a685008460f5 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:54.384489 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-3fc6e905-c1ab-489d-ae04-a685008460f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e96f8f39127f41a4ada132a0e55c34e9', 'request_id': 'req-3fc6e905-c1ab-489d-ae04-a685008460f5'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:37:54.444577 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-3fc6e905-c1ab-489d-ae04-a685008460f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e96f8f39127f41a4ada132a0e55c34e9', 'request_id': 'req-3fc6e905-c1ab-489d-ae04-a685008460f5'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:37:54.451788 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-3fc6e905-c1ab-489d-ae04-a685008460f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e96f8f39127f41a4ada132a0e55c34e9', 'request_id': 'req-3fc6e905-c1ab-489d-ae04-a685008460f5'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:37:54.465653 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-3fc6e905-c1ab-489d-ae04-a685008460f5 admin admin] The token cache is being invalidate because project e96f8f39127f41a4ada132a0e55c34e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:37:54.466509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-3fc6e905-c1ab-489d-ae04-a685008460f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:37:54.466880 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-3fc6e905-c1ab-489d-ae04-a685008460f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:37:54.468736 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 813/1647] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:37:54 2022] DELETE /identity/v3/projects/e96f8f39127f41a4ada132a0e55c34e9 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:37:54.473322 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ef466-daee-4074-b4a0-282f2e368a9e service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:54.487308 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ef466-daee-4074-b4a0-282f2e368a9e service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:54.632089 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c131e0-7d2d-4efb-93f8-fa809d101e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:54.632813 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c131e0-7d2d-4efb-93f8-fa809d101e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:54.633090 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c131e0-7d2d-4efb-93f8-fa809d101e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:54.633372 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c131e0-7d2d-4efb-93f8-fa809d101e45 admin admin] PATH_INFO: `/v3/users/74e7668674c84459b783e56f9cbe70ad` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:54.634627 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c131e0-7d2d-4efb-93f8-fa809d101e45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74e7668674c84459b783e56f9cbe70ad)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:54.636586 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c131e0-7d2d-4efb-93f8-fa809d101e45 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:54.663683 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:54.857353 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-74c131e0-7d2d-4efb-93f8-fa809d101e45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74e7668674c84459b783e56f9cbe70ad'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:37:54.858260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-74c131e0-7d2d-4efb-93f8-fa809d101e45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74e7668674c84459b783e56f9cbe70ad'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:37:54.859039 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-74c131e0-7d2d-4efb-93f8-fa809d101e45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74e7668674c84459b783e56f9cbe70ad'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:37:54.877178 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-74c131e0-7d2d-4efb-93f8-fa809d101e45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74e7668674c84459b783e56f9cbe70ad'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:37:54.954495 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-74c131e0-7d2d-4efb-93f8-fa809d101e45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74e7668674c84459b783e56f9cbe70ad'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:37:54.974504 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 835/1648] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:37:54 2022] DELETE /identity/v3/users/74e7668674c84459b783e56f9cbe70ad => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:37:55.297604 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6e905-c1ab-489d-ae04-a685008460f5 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:55.299925 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3fc6e905-c1ab-489d-ae04-a685008460f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:55.376770 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6e905-c1ab-489d-ae04-a685008460f5 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:55.392882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:55.600775 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad21d4-2e9e-4d81-a2d8-97de45e4e609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:55.601463 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad21d4-2e9e-4d81-a2d8-97de45e4e609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:55.601803 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad21d4-2e9e-4d81-a2d8-97de45e4e609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:55.602063 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad21d4-2e9e-4d81-a2d8-97de45e4e609 admin admin] PATH_INFO: `/v3/users/31fba1b1ca7f412aa374a6e7298e32b7` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:55.603366 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad21d4-2e9e-4d81-a2d8-97de45e4e609 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31fba1b1ca7f412aa374a6e7298e32b7)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:55.604409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: WARNING py.warnings [None req-f2ad21d4-2e9e-4d81-a2d8-97de45e4e609 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:37:55.604409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: warnings.warn(msg) Aug 24 14:37:55.604409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: Aug 24 14:37:55.605623 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad21d4-2e9e-4d81-a2d8-97de45e4e609 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:55.934071 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f2ad21d4-2e9e-4d81-a2d8-97de45e4e609 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31fba1b1ca7f412aa374a6e7298e32b7'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:37:55.934849 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f2ad21d4-2e9e-4d81-a2d8-97de45e4e609 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31fba1b1ca7f412aa374a6e7298e32b7'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:37:56.019239 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:56.051527 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f2ad21d4-2e9e-4d81-a2d8-97de45e4e609 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31fba1b1ca7f412aa374a6e7298e32b7'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:37:56.052444 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f2ad21d4-2e9e-4d81-a2d8-97de45e4e609 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31fba1b1ca7f412aa374a6e7298e32b7'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:37:56.154314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f2ad21d4-2e9e-4d81-a2d8-97de45e4e609 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31fba1b1ca7f412aa374a6e7298e32b7'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:37:56.203758 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 814/1649] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:37:55 2022] DELETE /identity/v3/users/31fba1b1ca7f412aa374a6e7298e32b7 => generated 0 bytes in 910 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:37:56.207117 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e40889-93af-4339-a1f2-267e540747e9 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:56.207480 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e40889-93af-4339-a1f2-267e540747e9 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:56.207853 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e40889-93af-4339-a1f2-267e540747e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:56.281703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-46e40889-93af-4339-a1f2-267e540747e9 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:56.284889 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-46e40889-93af-4339-a1f2-267e540747e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:56.408487 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 836/1650] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:56.435113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad21d4-2e9e-4d81-a2d8-97de45e4e609 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:56.438811 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f2ad21d4-2e9e-4d81-a2d8-97de45e4e609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:56.455404 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e40889-93af-4339-a1f2-267e540747e9 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:56.457539 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-46e40889-93af-4339-a1f2-267e540747e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:56.495127 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad21d4-2e9e-4d81-a2d8-97de45e4e609 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:56.533321 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c6a61-c5ea-42bf-bb83-b287daccbf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:56.535985 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c6a61-c5ea-42bf-bb83-b287daccbf62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:56.537250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c6a61-c5ea-42bf-bb83-b287daccbf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:56.539606 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c6a61-c5ea-42bf-bb83-b287daccbf62 admin admin] PATH_INFO: `/v3/projects/a125df27de0a47338bc3428ac5fd047d` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:56.544474 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c6a61-c5ea-42bf-bb83-b287daccbf62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a125df27de0a47338bc3428ac5fd047d)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:56.549150 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c6a61-c5ea-42bf-bb83-b287daccbf62 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:56.698645 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e40889-93af-4339-a1f2-267e540747e9 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:56.728627 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-890c6a61-c5ea-42bf-bb83-b287daccbf62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a125df27de0a47338bc3428ac5fd047d', 'request_id': 'req-890c6a61-c5ea-42bf-bb83-b287daccbf62'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:37:56.740055 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:56.818863 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86394f-558c-41ff-a31b-3a9b31c59456 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:56.819496 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86394f-558c-41ff-a31b-3a9b31c59456 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:56.819845 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86394f-558c-41ff-a31b-3a9b31c59456 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:56.820124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86394f-558c-41ff-a31b-3a9b31c59456 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:56.838950 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-890c6a61-c5ea-42bf-bb83-b287daccbf62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a125df27de0a47338bc3428ac5fd047d', 'request_id': 'req-890c6a61-c5ea-42bf-bb83-b287daccbf62'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:37:56.848032 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-890c6a61-c5ea-42bf-bb83-b287daccbf62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a125df27de0a47338bc3428ac5fd047d', 'request_id': 'req-890c6a61-c5ea-42bf-bb83-b287daccbf62'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:37:56.874115 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-890c6a61-c5ea-42bf-bb83-b287daccbf62 admin admin] The token cache is being invalidate because project a125df27de0a47338bc3428ac5fd047d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:37:56.874507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-890c6a61-c5ea-42bf-bb83-b287daccbf62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:37:56.875278 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-890c6a61-c5ea-42bf-bb83-b287daccbf62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:37:56.877133 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 815/1651] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:37:56 2022] DELETE /identity/v3/projects/a125df27de0a47338bc3428ac5fd047d => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:37:56.878274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b60fe7-91f1-4866-9176-aa4c9a8b90e1 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:56.883075 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b60fe7-91f1-4866-9176-aa4c9a8b90e1 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:56.894018 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b60fe7-91f1-4866-9176-aa4c9a8b90e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:56.943228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86394f-558c-41ff-a31b-3a9b31c59456 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:56.945095 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86394f-558c-41ff-a31b-3a9b31c59456 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:56.954757 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-f4b60fe7-91f1-4866-9176-aa4c9a8b90e1 None None] MFA Rules not processed for user `5a425aca2b064455baa360d51bc7337e`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:56.956328 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f4b60fe7-91f1-4866-9176-aa4c9a8b90e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:56.965271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 837/1652] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:37:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:37:56.966769 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94008edb-92da-4018-8f2f-1794d35d16b0 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:56.990953 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94008edb-92da-4018-8f2f-1794d35d16b0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:56.991279 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94008edb-92da-4018-8f2f-1794d35d16b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:57.093244 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-94008edb-92da-4018-8f2f-1794d35d16b0 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:57.100365 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-94008edb-92da-4018-8f2f-1794d35d16b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:57.118048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:57.152178 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 838/1653] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:57.160951 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e26f3-4a8e-4b44-92d0-b51cb15eaca0 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:57.172018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e26f3-4a8e-4b44-92d0-b51cb15eaca0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:57.178189 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e26f3-4a8e-4b44-92d0-b51cb15eaca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:57.228351 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-407e26f3-4a8e-4b44-92d0-b51cb15eaca0 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:57.229711 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-407e26f3-4a8e-4b44-92d0-b51cb15eaca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:57.233616 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 816/1654] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:56 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:57.249474 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 839/1655] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:57.262190 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b60fe7-91f1-4866-9176-aa4c9a8b90e1 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:57.301227 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b60fe7-91f1-4866-9176-aa4c9a8b90e1 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:57.328980 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ef25d-000b-4b1c-b818-7c3bc627a4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:57.331206 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ef25d-000b-4b1c-b818-7c3bc627a4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:57.331501 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ef25d-000b-4b1c-b818-7c3bc627a4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:57.335899 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ef25d-000b-4b1c-b818-7c3bc627a4f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:57.337960 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ef25d-000b-4b1c-b818-7c3bc627a4f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:57.338287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ef25d-000b-4b1c-b818-7c3bc627a4f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:57.347110 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ef25d-000b-4b1c-b818-7c3bc627a4f6 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:57.388377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 817/1656] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:57.392701 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e26f3-4a8e-4b44-92d0-b51cb15eaca0 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:57.417844 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e26f3-4a8e-4b44-92d0-b51cb15eaca0 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:57.432390 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1a703-08af-464f-a00a-6dac4e146898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:57.433391 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1a703-08af-464f-a00a-6dac4e146898 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:57.433674 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1a703-08af-464f-a00a-6dac4e146898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:57.433970 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1a703-08af-464f-a00a-6dac4e146898 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:57.434615 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1a703-08af-464f-a00a-6dac4e146898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:57.438295 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1a703-08af-464f-a00a-6dac4e146898 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:57.580193 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 840/1657] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:37:57 2022] POST /identity/v3/projects => generated 369 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:37:57.581400 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ef25d-000b-4b1c-b818-7c3bc627a4f6 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:57.604292 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ef25d-000b-4b1c-b818-7c3bc627a4f6 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:57.861571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715c664-bb4b-46c1-a04f-de226e9c20ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:57.863609 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715c664-bb4b-46c1-a04f-de226e9c20ea admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:57.864034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715c664-bb4b-46c1-a04f-de226e9c20ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:57.865460 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715c664-bb4b-46c1-a04f-de226e9c20ea admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:57.867904 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715c664-bb4b-46c1-a04f-de226e9c20ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:57.874571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715c664-bb4b-46c1-a04f-de226e9c20ea admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:58.026232 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 818/1658] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:37:57 2022] POST /identity/v3/users => generated 285 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:37:58.028278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1a703-08af-464f-a00a-6dac4e146898 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:58.045193 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1a703-08af-464f-a00a-6dac4e146898 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:58.072882 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63281936-cad8-46b2-a771-7f663718ede5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:58.073625 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63281936-cad8-46b2-a771-7f663718ede5 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:58.076189 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63281936-cad8-46b2-a771-7f663718ede5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:58.076508 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63281936-cad8-46b2-a771-7f663718ede5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:58.077213 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63281936-cad8-46b2-a771-7f663718ede5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:58.078928 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63281936-cad8-46b2-a771-7f663718ede5 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:58.106772 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 841/1659] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:37:58.112243 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715c664-bb4b-46c1-a04f-de226e9c20ea admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:58.147272 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715c664-bb4b-46c1-a04f-de226e9c20ea admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:58.168548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7211dd-8ac9-4247-9025-5037edd6083f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:58.168548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7211dd-8ac9-4247-9025-5037edd6083f admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:58.168548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7211dd-8ac9-4247-9025-5037edd6083f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:58.168850 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7211dd-8ac9-4247-9025-5037edd6083f admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:58.169390 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7211dd-8ac9-4247-9025-5037edd6083f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:58.171075 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7211dd-8ac9-4247-9025-5037edd6083f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:58.219777 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 819/1660] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:37:58.222706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63281936-cad8-46b2-a771-7f663718ede5 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:58.241504 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63281936-cad8-46b2-a771-7f663718ede5 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:58.261420 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ae115-34d0-4847-a091-0b3aad49a90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:58.264424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ae115-34d0-4847-a091-0b3aad49a90d admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:58.275649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ae115-34d0-4847-a091-0b3aad49a90d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:58.276123 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ae115-34d0-4847-a091-0b3aad49a90d admin admin] PATH_INFO: `/v3/projects/6b3dfdfdfbd547a5bd83b7a7deb3727e/users/b7a15d6a11f84256bfc1c7a28aa35203/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:58.329674 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ae115-34d0-4847-a091-0b3aad49a90d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b3dfdfdfbd547a5bd83b7a7deb3727e, user_id=b7a15d6a11f84256bfc1c7a28aa35203, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:58.333553 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ae115-34d0-4847-a091-0b3aad49a90d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:58.458245 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 842/1661] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:37:58 2022] PUT /identity/v3/projects/6b3dfdfdfbd547a5bd83b7a7deb3727e/users/b7a15d6a11f84256bfc1c7a28aa35203/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:37:58.472681 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de3887-2208-4638-991a-1c7258bc9a04 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:58.472976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de3887-2208-4638-991a-1c7258bc9a04 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:58.473264 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de3887-2208-4638-991a-1c7258bc9a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:58.528285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-e6de3887-2208-4638-991a-1c7258bc9a04 None None] MFA Rules not processed for user `b7a15d6a11f84256bfc1c7a28aa35203`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:58.529561 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e6de3887-2208-4638-991a-1c7258bc9a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:58.600269 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:58.644727 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 820/1662] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:37:58.646174 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ae115-34d0-4847-a091-0b3aad49a90d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:58.748238 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:58.764214 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ae115-34d0-4847-a091-0b3aad49a90d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:58.778993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50d9dd-4714-43a0-8b01-a2574d906c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:58.779328 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50d9dd-4714-43a0-8b01-a2574d906c50 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:58.779603 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50d9dd-4714-43a0-8b01-a2574d906c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:58.779876 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50d9dd-4714-43a0-8b01-a2574d906c50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:58.780514 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50d9dd-4714-43a0-8b01-a2574d906c50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:58.782505 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50d9dd-4714-43a0-8b01-a2574d906c50 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:58.969064 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 843/1663] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:37:58 2022] POST /identity/v3/projects => generated 367 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:37:58.973299 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de3887-2208-4638-991a-1c7258bc9a04 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:58.993316 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de3887-2208-4638-991a-1c7258bc9a04 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:59.119149 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc107f3-3a7d-46a8-bdf4-b9c635959cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:59.120026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc107f3-3a7d-46a8-bdf4-b9c635959cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:59.120425 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc107f3-3a7d-46a8-bdf4-b9c635959cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:59.120800 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc107f3-3a7d-46a8-bdf4-b9c635959cc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:59.121535 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc107f3-3a7d-46a8-bdf4-b9c635959cc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:59.127863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc107f3-3a7d-46a8-bdf4-b9c635959cc5 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:59.326350 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 821/1664] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:37:58 2022] POST /identity/v3/users => generated 290 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:37:59.330562 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50d9dd-4714-43a0-8b01-a2574d906c50 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:59.367794 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50d9dd-4714-43a0-8b01-a2574d906c50 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:59.397369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c9270-418d-4051-8bea-6c08b2ac3f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:59.398053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c9270-418d-4051-8bea-6c08b2ac3f76 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:59.398332 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c9270-418d-4051-8bea-6c08b2ac3f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:59.398603 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c9270-418d-4051-8bea-6c08b2ac3f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:59.399263 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c9270-418d-4051-8bea-6c08b2ac3f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:59.401540 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c9270-418d-4051-8bea-6c08b2ac3f76 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:59.431287 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 844/1665] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:37:59.435732 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc107f3-3a7d-46a8-bdf4-b9c635959cc5 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:59.450376 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc107f3-3a7d-46a8-bdf4-b9c635959cc5 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:59.459087 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374a000-e8e3-4932-a8ea-5d0ebd28e64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:59.466273 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374a000-e8e3-4932-a8ea-5d0ebd28e64a admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:59.466675 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374a000-e8e3-4932-a8ea-5d0ebd28e64a admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:59.472691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374a000-e8e3-4932-a8ea-5d0ebd28e64a admin admin] PATH_INFO: `/v3/projects/fc924f1ada0741c4bec60b83a6bae90b/users/08892dde25cb44239a966063828e57af/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:59.519170 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374a000-e8e3-4932-a8ea-5d0ebd28e64a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc924f1ada0741c4bec60b83a6bae90b, user_id=08892dde25cb44239a966063828e57af, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:59.528427 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374a000-e8e3-4932-a8ea-5d0ebd28e64a admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:59.618937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 822/1666] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:37:59 2022] PUT /identity/v3/projects/fc924f1ada0741c4bec60b83a6bae90b/users/08892dde25cb44239a966063828e57af/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:37:59.622889 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c9270-418d-4051-8bea-6c08b2ac3f76 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:59.653803 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c9270-418d-4051-8bea-6c08b2ac3f76 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:59.731805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e70d89-1281-4638-a0f6-f7cf2870a504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:59.732435 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e70d89-1281-4638-a0f6-f7cf2870a504 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:59.732715 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e70d89-1281-4638-a0f6-f7cf2870a504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:59.732989 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e70d89-1281-4638-a0f6-f7cf2870a504 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:59.733644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e70d89-1281-4638-a0f6-f7cf2870a504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:59.735953 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e70d89-1281-4638-a0f6-f7cf2870a504 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:59.749072 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 845/1667] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:37:59.753244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374a000-e8e3-4932-a8ea-5d0ebd28e64a admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:59.769978 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374a000-e8e3-4932-a8ea-5d0ebd28e64a admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:59.784762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba3115-805e-4341-b170-84a92e2c1f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:59.785837 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba3115-805e-4341-b170-84a92e2c1f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:59.787350 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba3115-805e-4341-b170-84a92e2c1f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:59.787894 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba3115-805e-4341-b170-84a92e2c1f09 admin admin] PATH_INFO: `/v3/projects/fc924f1ada0741c4bec60b83a6bae90b/users/08892dde25cb44239a966063828e57af/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:59.792922 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba3115-805e-4341-b170-84a92e2c1f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc924f1ada0741c4bec60b83a6bae90b, user_id=08892dde25cb44239a966063828e57af, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:59.796095 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba3115-805e-4341-b170-84a92e2c1f09 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:59.823798 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 823/1668] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:37:59 2022] PUT /identity/v3/projects/fc924f1ada0741c4bec60b83a6bae90b/users/08892dde25cb44239a966063828e57af/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:37:59.836069 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519ed77-5a80-4e05-a67b-1367202f5c5b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:59.836458 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519ed77-5a80-4e05-a67b-1367202f5c5b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:59.836811 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519ed77-5a80-4e05-a67b-1367202f5c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:59.897544 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4519ed77-5a80-4e05-a67b-1367202f5c5b None None] MFA Rules not processed for user `08892dde25cb44239a966063828e57af`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:59.900314 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4519ed77-5a80-4e05-a67b-1367202f5c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:00.077581 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 846/1669] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:37:59 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:00.090127 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba3115-805e-4341-b170-84a92e2c1f09 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:00.090127 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-59ba3115-805e-4341-b170-84a92e2c1f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:00.244727 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba3115-805e-4341-b170-84a92e2c1f09 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:00.249929 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebbc05-995f-40df-a924-db77ed188e31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:00.250638 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebbc05-995f-40df-a924-db77ed188e31 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:00.250913 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebbc05-995f-40df-a924-db77ed188e31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:00.251179 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebbc05-995f-40df-a924-db77ed188e31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:00.269453 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ebbc05-995f-40df-a924-db77ed188e31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:00.271728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ebbc05-995f-40df-a924-db77ed188e31 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:00.305721 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 824/1670] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:38:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:38:00.431523 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80409e49-73ac-44d1-a05d-96e15eab0a38 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:00.432092 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80409e49-73ac-44d1-a05d-96e15eab0a38 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:00.432293 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80409e49-73ac-44d1-a05d-96e15eab0a38 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:00.437849 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 847/1671] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 14:38:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:38:00.473211 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebbc05-995f-40df-a924-db77ed188e31 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:00.475222 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a8ebbc05-995f-40df-a924-db77ed188e31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:00.511653 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932f976-dcd4-4c9f-843f-d441a4950225 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:00.512019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932f976-dcd4-4c9f-843f-d441a4950225 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:00.512303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932f976-dcd4-4c9f-843f-d441a4950225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:00.565784 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-3932f976-dcd4-4c9f-843f-d441a4950225 None None] MFA Rules not processed for user `63253cd786c04d6a9d099773198aee36`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:00.567057 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3932f976-dcd4-4c9f-843f-d441a4950225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:00.665961 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:00.747997 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebbc05-995f-40df-a924-db77ed188e31 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:00.761611 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5c113-2b06-4262-bdb2-b758071320ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:00.762291 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5c113-2b06-4262-bdb2-b758071320ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:00.762724 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5c113-2b06-4262-bdb2-b758071320ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:00.763134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5c113-2b06-4262-bdb2-b758071320ef admin admin] PATH_INFO: `/v3/projects/d2659c6241284e89b2acf6cfd8ae24f0` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:00.769938 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f5c113-2b06-4262-bdb2-b758071320ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2659c6241284e89b2acf6cfd8ae24f0)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:00.773471 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f5c113-2b06-4262-bdb2-b758071320ef admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:00.804373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:00.860765 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 848/1672] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 14:38:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:00.899828 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e9ae8-f82d-4f76-b4c7-97366027431e None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:00.900092 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e9ae8-f82d-4f76-b4c7-97366027431e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:00.900370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e9ae8-f82d-4f76-b4c7-97366027431e None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:00.904709 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 849/1673] 10.222.0.65 () {54 vars in 961 bytes} [Wed Aug 24 14:38:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:38:00.911887 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e4255-a7f1-42bc-bc7a-12642e4847e0 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:00.912166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e4255-a7f1-42bc-bc7a-12642e4847e0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:00.912606 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e4255-a7f1-42bc-bc7a-12642e4847e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:00.951709 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-bd5e4255-a7f1-42bc-bc7a-12642e4847e0 None None] MFA Rules not processed for user `63253cd786c04d6a9d099773198aee36`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:00.953931 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-bd5e4255-a7f1-42bc-bc7a-12642e4847e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:00.985451 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-36f5c113-2b06-4262-bdb2-b758071320ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2659c6241284e89b2acf6cfd8ae24f0', 'request_id': 'req-36f5c113-2b06-4262-bdb2-b758071320ef'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:01.096153 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-36f5c113-2b06-4262-bdb2-b758071320ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2659c6241284e89b2acf6cfd8ae24f0', 'request_id': 'req-36f5c113-2b06-4262-bdb2-b758071320ef'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:01.104067 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-36f5c113-2b06-4262-bdb2-b758071320ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2659c6241284e89b2acf6cfd8ae24f0', 'request_id': 'req-36f5c113-2b06-4262-bdb2-b758071320ef'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:01.115236 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 850/1674] 10.222.0.65 () {58 vars in 1058 bytes} [Wed Aug 24 14:38:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 24 14:38:01.115995 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e4255-a7f1-42bc-bc7a-12642e4847e0 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:01.139488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-36f5c113-2b06-4262-bdb2-b758071320ef admin admin] The token cache is being invalidate because project d2659c6241284e89b2acf6cfd8ae24f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:38:01.148926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-36f5c113-2b06-4262-bdb2-b758071320ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:01.148926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-36f5c113-2b06-4262-bdb2-b758071320ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:01.148926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 825/1675] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:38:00 2022] DELETE /identity/v3/projects/d2659c6241284e89b2acf6cfd8ae24f0 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:01.148926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b62c3-c2d3-4e48-b3d3-cdba1f242c11 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:01.149826 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e4255-a7f1-42bc-bc7a-12642e4847e0 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:01.150880 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b62c3-c2d3-4e48-b3d3-cdba1f242c11 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:01.151299 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b62c3-c2d3-4e48-b3d3-cdba1f242c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:01.161706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb70ef-977a-4f42-82fb-2a19a3dbffb0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63253cd786c04d6a9d099773198aee36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:01.163446 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb70ef-977a-4f42-82fb-2a19a3dbffb0 service placement] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:01.163749 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb70ef-977a-4f42-82fb-2a19a3dbffb0 service placement] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:01.165462 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb70ef-977a-4f42-82fb-2a19a3dbffb0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:01.177100 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d3cb70ef-977a-4f42-82fb-2a19a3dbffb0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:01.193470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb70ef-977a-4f42-82fb-2a19a3dbffb0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:01.195416 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb70ef-977a-4f42-82fb-2a19a3dbffb0 service placement] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:01.196584 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ab6b62c3-c2d3-4e48-b3d3-cdba1f242c11 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:01.201469 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ab6b62c3-c2d3-4e48-b3d3-cdba1f242c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:01.218714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 851/1676] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:38:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:38:01.415451 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 826/1677] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:38:01.418783 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9655e-322b-4e52-a41c-f6ffcf894195 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:01.419075 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9655e-322b-4e52-a41c-f6ffcf894195 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:01.419768 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9655e-322b-4e52-a41c-f6ffcf894195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:01.469912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b3c9655e-322b-4e52-a41c-f6ffcf894195 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:01.472010 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b3c9655e-322b-4e52-a41c-f6ffcf894195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:01.493620 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 852/1678] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:38:01.494831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b62c3-c2d3-4e48-b3d3-cdba1f242c11 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:01.510239 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b62c3-c2d3-4e48-b3d3-cdba1f242c11 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:01.543987 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf47c76-f9f8-4682-83bd-de1b3cb28b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:01.547208 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf47c76-f9f8-4682-83bd-de1b3cb28b0f admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:01.547208 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf47c76-f9f8-4682-83bd-de1b3cb28b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:01.547208 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf47c76-f9f8-4682-83bd-de1b3cb28b0f admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:01.547208 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf47c76-f9f8-4682-83bd-de1b3cb28b0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:38:01.547208 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf47c76-f9f8-4682-83bd-de1b3cb28b0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:01.547967 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf47c76-f9f8-4682-83bd-de1b3cb28b0f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:01.585884 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 827/1679] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:38:01.590222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9655e-322b-4e52-a41c-f6ffcf894195 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:01.620730 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9655e-322b-4e52-a41c-f6ffcf894195 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:01.627891 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505fdf6-9085-4891-a44c-31a6205893ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:01.628807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505fdf6-9085-4891-a44c-31a6205893ec admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:01.629340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505fdf6-9085-4891-a44c-31a6205893ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:01.630351 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505fdf6-9085-4891-a44c-31a6205893ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:01.631181 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505fdf6-9085-4891-a44c-31a6205893ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:01.634141 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505fdf6-9085-4891-a44c-31a6205893ec admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:01.783067 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 853/1680] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:38:01 2022] POST /identity/v3/projects => generated 379 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:38:01.788163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf47c76-f9f8-4682-83bd-de1b3cb28b0f admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:01.813535 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf47c76-f9f8-4682-83bd-de1b3cb28b0f admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:01.923744 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f830f29-8af5-4e28-9ef5-3c54421a3309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:01.925432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f830f29-8af5-4e28-9ef5-3c54421a3309 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:01.930789 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f830f29-8af5-4e28-9ef5-3c54421a3309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:01.930789 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f830f29-8af5-4e28-9ef5-3c54421a3309 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:01.930789 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f830f29-8af5-4e28-9ef5-3c54421a3309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:01.930789 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f830f29-8af5-4e28-9ef5-3c54421a3309 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:01.944169 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:02.020974 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 828/1681] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:38:01 2022] POST /identity/v3/users => generated 290 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:38:02.025253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505fdf6-9085-4891-a44c-31a6205893ec admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:02.042677 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505fdf6-9085-4891-a44c-31a6205893ec admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:02.055304 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14072c2-f67c-4bd0-b556-4e4b18b375f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:02.056603 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14072c2-f67c-4bd0-b556-4e4b18b375f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:02.057405 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14072c2-f67c-4bd0-b556-4e4b18b375f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:02.059560 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14072c2-f67c-4bd0-b556-4e4b18b375f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:02.060541 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14072c2-f67c-4bd0-b556-4e4b18b375f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:02.062442 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14072c2-f67c-4bd0-b556-4e4b18b375f5 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:02.115470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 854/1682] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:38:02.119217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f830f29-8af5-4e28-9ef5-3c54421a3309 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:02.146112 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f830f29-8af5-4e28-9ef5-3c54421a3309 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:02.176286 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbf6a5-e2ba-46b5-bdc0-76c80011ccad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:02.178558 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbf6a5-e2ba-46b5-bdc0-76c80011ccad admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:02.178922 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbf6a5-e2ba-46b5-bdc0-76c80011ccad admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:02.179309 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbf6a5-e2ba-46b5-bdc0-76c80011ccad admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:02.180303 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbf6a5-e2ba-46b5-bdc0-76c80011ccad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:02.183089 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbf6a5-e2ba-46b5-bdc0-76c80011ccad admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:02.220753 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 829/1683] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:38:02.226282 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14072c2-f67c-4bd0-b556-4e4b18b375f5 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:02.243673 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14072c2-f67c-4bd0-b556-4e4b18b375f5 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:02.268996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d13c6f-e5df-4ca7-9464-01ccf66f8a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:02.271350 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d13c6f-e5df-4ca7-9464-01ccf66f8a23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:02.271795 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d13c6f-e5df-4ca7-9464-01ccf66f8a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:02.272502 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d13c6f-e5df-4ca7-9464-01ccf66f8a23 admin admin] PATH_INFO: `/v3/projects/3870a4cd51d54d6893a321a56bd29684/users/14b9afd5cc0348f2ad54bd2bfbd93879/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:02.347129 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d13c6f-e5df-4ca7-9464-01ccf66f8a23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3870a4cd51d54d6893a321a56bd29684, user_id=14b9afd5cc0348f2ad54bd2bfbd93879, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:02.352243 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d13c6f-e5df-4ca7-9464-01ccf66f8a23 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:02.625838 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 855/1684] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:38:02 2022] PUT /identity/v3/projects/3870a4cd51d54d6893a321a56bd29684/users/14b9afd5cc0348f2ad54bd2bfbd93879/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:02.636761 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28992c1-1b05-42ec-8d61-5d63caf2ce87 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:02.637505 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28992c1-1b05-42ec-8d61-5d63caf2ce87 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:02.637895 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28992c1-1b05-42ec-8d61-5d63caf2ce87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:02.705214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-e28992c1-1b05-42ec-8d61-5d63caf2ce87 None None] MFA Rules not processed for user `14b9afd5cc0348f2ad54bd2bfbd93879`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:02.706535 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e28992c1-1b05-42ec-8d61-5d63caf2ce87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:02.815904 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 830/1685] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:02.821007 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d13c6f-e5df-4ca7-9464-01ccf66f8a23 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:02.875200 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d8aa1-c5d2-499e-b6bb-9e2613752bbd None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:02.875388 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d8aa1-c5d2-499e-b6bb-9e2613752bbd None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:02.875595 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d8aa1-c5d2-499e-b6bb-9e2613752bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:02.967484 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-0b1d8aa1-c5d2-499e-b6bb-9e2613752bbd None None] MFA Rules not processed for user `7b0a0a0664744f378ca4e17e914f4259`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:02.970143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0b1d8aa1-c5d2-499e-b6bb-9e2613752bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:02.980088 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d13c6f-e5df-4ca7-9464-01ccf66f8a23 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:02.998598 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2faa12-9e83-4473-b934-056d3f4bcd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:02.999664 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2faa12-9e83-4473-b934-056d3f4bcd9f admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:03.000156 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2faa12-9e83-4473-b934-056d3f4bcd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:03.000653 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2faa12-9e83-4473-b934-056d3f4bcd9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:03.001521 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2faa12-9e83-4473-b934-056d3f4bcd9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:03.003735 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2faa12-9e83-4473-b934-056d3f4bcd9f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:03.022419 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:03.131785 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 831/1686] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:03.135487 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e3492-6742-45bc-9e14-fa8b27d70165 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:03.141117 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e3492-6742-45bc-9e14-fa8b27d70165 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:03.141117 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e3492-6742-45bc-9e14-fa8b27d70165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:03.144591 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 856/1687] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:38:02 2022] POST /identity/v3/projects => generated 377 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:38:03.149696 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2faa12-9e83-4473-b934-056d3f4bcd9f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:03.164502 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a33e3492-6742-45bc-9e14-fa8b27d70165 None None] MFA Rules not processed for user `7b0a0a0664744f378ca4e17e914f4259`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:03.166154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a33e3492-6742-45bc-9e14-fa8b27d70165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:03.319443 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2faa12-9e83-4473-b934-056d3f4bcd9f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:03.330829 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4040be-26e0-4935-a068-412b2040fef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:03.331615 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4040be-26e0-4935-a068-412b2040fef5 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:03.332019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4040be-26e0-4935-a068-412b2040fef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:03.332392 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4040be-26e0-4935-a068-412b2040fef5 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:03.333676 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4040be-26e0-4935-a068-412b2040fef5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:03.337910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4040be-26e0-4935-a068-412b2040fef5 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:03.352069 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 832/1688] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:38:03.362373 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e3492-6742-45bc-9e14-fa8b27d70165 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:03.367092 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a33e3492-6742-45bc-9e14-fa8b27d70165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:03.461737 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 857/1689] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:38:03 2022] POST /identity/v3/users => generated 289 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:38:03.465670 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4040be-26e0-4935-a068-412b2040fef5 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:03.491027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4040be-26e0-4935-a068-412b2040fef5 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:03.533455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df277323-9df5-4093-b6e3-a8361e687e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:03.533455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df277323-9df5-4093-b6e3-a8361e687e93 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:03.533455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df277323-9df5-4093-b6e3-a8361e687e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:03.533455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df277323-9df5-4093-b6e3-a8361e687e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:03.533828 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df277323-9df5-4093-b6e3-a8361e687e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:03.533828 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df277323-9df5-4093-b6e3-a8361e687e93 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:03.540577 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e3492-6742-45bc-9e14-fa8b27d70165 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:03.560960 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 858/1690] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:38:03.566647 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df277323-9df5-4093-b6e3-a8361e687e93 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:03.576182 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c91810-ec5f-4867-ae8b-446bb760f3d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:03.577833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c91810-ec5f-4867-ae8b-446bb760f3d1 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:03.577833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c91810-ec5f-4867-ae8b-446bb760f3d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:03.577833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c91810-ec5f-4867-ae8b-446bb760f3d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:03.589978 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c91810-ec5f-4867-ae8b-446bb760f3d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:03.590802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c91810-ec5f-4867-ae8b-446bb760f3d1 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:03.610146 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df277323-9df5-4093-b6e3-a8361e687e93 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:03.616675 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 833/1691] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:38:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:38:03.625558 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88dbb0-aecf-4fc6-9a6b-a8e84821da93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:03.626270 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88dbb0-aecf-4fc6-9a6b-a8e84821da93 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:03.626854 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88dbb0-aecf-4fc6-9a6b-a8e84821da93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:03.626854 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88dbb0-aecf-4fc6-9a6b-a8e84821da93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:03.627460 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88dbb0-aecf-4fc6-9a6b-a8e84821da93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:03.634639 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88dbb0-aecf-4fc6-9a6b-a8e84821da93 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:03.680163 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 859/1692] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:38:03.685198 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c91810-ec5f-4867-ae8b-446bb760f3d1 service nova] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:03.717001 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c91810-ec5f-4867-ae8b-446bb760f3d1 service nova] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:03.744961 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392fac6-e71f-46ab-98f0-c72711fe0ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:03.744961 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392fac6-e71f-46ab-98f0-c72711fe0ea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:03.745926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392fac6-e71f-46ab-98f0-c72711fe0ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:03.746362 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392fac6-e71f-46ab-98f0-c72711fe0ea6 admin admin] PATH_INFO: `/v3/projects/db5d27a3ae6f4a8eb0bd5eac7bf4c360/users/f3bfa6d2d12d44ff8a295a892a68fd83/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:03.794980 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1392fac6-e71f-46ab-98f0-c72711fe0ea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db5d27a3ae6f4a8eb0bd5eac7bf4c360, user_id=f3bfa6d2d12d44ff8a295a892a68fd83, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:03.805455 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1392fac6-e71f-46ab-98f0-c72711fe0ea6 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:03.883910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4233e3c-d2e3-4073-b29c-f080ae330d62 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:03.886320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4233e3c-d2e3-4073-b29c-f080ae330d62 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:03.886683 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4233e3c-d2e3-4073-b29c-f080ae330d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:03.891316 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 834/1693] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:38:03 2022] PUT /identity/v3/projects/db5d27a3ae6f4a8eb0bd5eac7bf4c360/users/f3bfa6d2d12d44ff8a295a892a68fd83/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:03.907853 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bd5d6-b4c9-4ee7-ab85-a7a8ecea6cb5 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:03.908312 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bd5d6-b4c9-4ee7-ab85-a7a8ecea6cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:03.908748 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bd5d6-b4c9-4ee7-ab85-a7a8ecea6cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:03.971233 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f4233e3c-d2e3-4073-b29c-f080ae330d62 None None] MFA Rules not processed for user `fbdf19910c234794b8aeb480dba50d85`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:03.975763 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f4233e3c-d2e3-4073-b29c-f080ae330d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:04.006822 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-402bd5d6-b4c9-4ee7-ab85-a7a8ecea6cb5 None None] MFA Rules not processed for user `f3bfa6d2d12d44ff8a295a892a68fd83`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:04.011808 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-402bd5d6-b4c9-4ee7-ab85-a7a8ecea6cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:04.033549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:04.168009 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 860/1694] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:04.171096 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4233e3c-d2e3-4073-b29c-f080ae330d62 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:04.178077 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f4233e3c-d2e3-4073-b29c-f080ae330d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:04.213027 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 835/1695] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:04.214376 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bd5d6-b4c9-4ee7-ab85-a7a8ecea6cb5 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:04.218056 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-402bd5d6-b4c9-4ee7-ab85-a7a8ecea6cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:04.357127 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4233e3c-d2e3-4073-b29c-f080ae330d62 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:04.381275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8c602-58c0-4808-b8d5-f2c07025cfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:04.382746 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8c602-58c0-4808-b8d5-f2c07025cfd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:04.386411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8c602-58c0-4808-b8d5-f2c07025cfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:04.387024 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8c602-58c0-4808-b8d5-f2c07025cfd7 admin admin] PATH_INFO: `/v3/users/34a6ee60b33c416e82decddaa8d1aba9` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:04.389112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd8c602-58c0-4808-b8d5-f2c07025cfd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34a6ee60b33c416e82decddaa8d1aba9)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:04.396295 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd8c602-58c0-4808-b8d5-f2c07025cfd7 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:04.488492 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:04.499552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bd5d6-b4c9-4ee7-ab85-a7a8ecea6cb5 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:04.519470 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe92be-3693-4b04-a19d-aa76bb242b6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:04.524995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe92be-3693-4b04-a19d-aa76bb242b6f service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:04.524995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe92be-3693-4b04-a19d-aa76bb242b6f service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:04.524995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe92be-3693-4b04-a19d-aa76bb242b6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:04.534142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe92be-3693-4b04-a19d-aa76bb242b6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:04.543115 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe92be-3693-4b04-a19d-aa76bb242b6f service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:04.555240 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 836/1696] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:38:04 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:38:04.556462 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe92be-3693-4b04-a19d-aa76bb242b6f service nova] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:04.569006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe92be-3693-4b04-a19d-aa76bb242b6f service nova] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:04.574777 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3ca94-60ee-4ec4-ae25-db7feaf4ea6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:04.575682 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3ca94-60ee-4ec4-ae25-db7feaf4ea6f admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:04.576176 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3ca94-60ee-4ec4-ae25-db7feaf4ea6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:04.576662 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3ca94-60ee-4ec4-ae25-db7feaf4ea6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:04.577517 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3ca94-60ee-4ec4-ae25-db7feaf4ea6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:04.580504 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3ca94-60ee-4ec4-ae25-db7feaf4ea6f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:04.639855 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9dd8c602-58c0-4808-b8d5-f2c07025cfd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34a6ee60b33c416e82decddaa8d1aba9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:04.654877 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9dd8c602-58c0-4808-b8d5-f2c07025cfd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34a6ee60b33c416e82decddaa8d1aba9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:04.658579 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9dd8c602-58c0-4808-b8d5-f2c07025cfd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34a6ee60b33c416e82decddaa8d1aba9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:04.698096 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 837/1697] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:38:04 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:38:04.699991 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91c765-53a8-40dd-9705-df91dafc5806 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:04.699991 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91c765-53a8-40dd-9705-df91dafc5806 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:04.704852 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91c765-53a8-40dd-9705-df91dafc5806 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:04.718467 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 838/1698] 10.222.0.65 () {54 vars in 912 bytes} [Wed Aug 24 14:38:04 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:38:04.721607 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91c765-53a8-40dd-9705-df91dafc5806 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:04.730953 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-5e91c765-53a8-40dd-9705-df91dafc5806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:04.739444 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9dd8c602-58c0-4808-b8d5-f2c07025cfd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34a6ee60b33c416e82decddaa8d1aba9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:04.856161 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9dd8c602-58c0-4808-b8d5-f2c07025cfd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34a6ee60b33c416e82decddaa8d1aba9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:04.886844 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 861/1699] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:38:04 2022] DELETE /identity/v3/users/34a6ee60b33c416e82decddaa8d1aba9 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:04.889391 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b978cb-b1a0-407d-b58f-33dbb9939770 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:04.900719 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b978cb-b1a0-407d-b58f-33dbb9939770 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:04.900719 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b978cb-b1a0-407d-b58f-33dbb9939770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:05.063943 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-64b978cb-b1a0-407d-b58f-33dbb9939770 None None] MFA Rules not processed for user `cb5021b569db41a08218cbec928442af`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:05.071287 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-64b978cb-b1a0-407d-b58f-33dbb9939770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:05.078637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91c765-53a8-40dd-9705-df91dafc5806 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:05.292643 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 862/1700] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 14:38:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:05.317911 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474cc534-291c-41f3-a90c-d7131f3db239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:05.318770 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474cc534-291c-41f3-a90c-d7131f3db239 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:05.319221 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474cc534-291c-41f3-a90c-d7131f3db239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:05.319641 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474cc534-291c-41f3-a90c-d7131f3db239 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:05.320432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474cc534-291c-41f3-a90c-d7131f3db239 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:05.322711 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474cc534-291c-41f3-a90c-d7131f3db239 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:05.444023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b978cb-b1a0-407d-b58f-33dbb9939770 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:05.445560 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 839/1701] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:38:04 2022] POST /identity/v3/users => generated 296 bytes in 724 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:38:05.462617 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b978cb-b1a0-407d-b58f-33dbb9939770 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:05.487743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883705d9-9d70-4583-a9dd-1b0a1d27d6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:05.488400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883705d9-9d70-4583-a9dd-1b0a1d27d6cd admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:05.488718 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883705d9-9d70-4583-a9dd-1b0a1d27d6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:05.489034 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883705d9-9d70-4583-a9dd-1b0a1d27d6cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:05.489703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883705d9-9d70-4583-a9dd-1b0a1d27d6cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:05.499527 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883705d9-9d70-4583-a9dd-1b0a1d27d6cd admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:05.532045 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474cc534-291c-41f3-a90c-d7131f3db239 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:05.538207 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-474cc534-291c-41f3-a90c-d7131f3db239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:05.539703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 863/1702] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:38:05.540661 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883705d9-9d70-4583-a9dd-1b0a1d27d6cd admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:05.571002 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474cc534-291c-41f3-a90c-d7131f3db239 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:05.574039 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883705d9-9d70-4583-a9dd-1b0a1d27d6cd admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:05.599846 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9116bdf-fffe-4ad3-879c-305f939b423b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:05.601071 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9116bdf-fffe-4ad3-879c-305f939b423b service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:05.602252 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9116bdf-fffe-4ad3-879c-305f939b423b service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:05.602707 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9116bdf-fffe-4ad3-879c-305f939b423b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:05.603480 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d12d0-3212-4dfb-85e0-e22d882f459b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:05.605022 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d12d0-3212-4dfb-85e0-e22d882f459b admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:05.609200 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d12d0-3212-4dfb-85e0-e22d882f459b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:05.612867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d12d0-3212-4dfb-85e0-e22d882f459b admin admin] PATH_INFO: `/v3/projects/4aaf940dabd2415b97d9b08ed95d69d0/users/7c72299ec72f4ece80cc2f5bbf2929c8/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:05.626515 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:05.635155 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9116bdf-fffe-4ad3-879c-305f939b423b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:05.637581 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9116bdf-fffe-4ad3-879c-305f939b423b service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:05.652991 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d12d0-3212-4dfb-85e0-e22d882f459b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aaf940dabd2415b97d9b08ed95d69d0, user_id=7c72299ec72f4ece80cc2f5bbf2929c8, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:05.659793 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 840/1703] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:38:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:38:05.661483 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9116bdf-fffe-4ad3-879c-305f939b423b service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:05.662387 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d12d0-3212-4dfb-85e0-e22d882f459b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:05.666390 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c9116bdf-fffe-4ad3-879c-305f939b423b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:05.699624 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9116bdf-fffe-4ad3-879c-305f939b423b service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:05.706103 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d3b5d-6be8-408f-a2da-2701c9736446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:05.707189 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d3b5d-6be8-408f-a2da-2701c9736446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:05.708266 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d3b5d-6be8-408f-a2da-2701c9736446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:05.708751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d3b5d-6be8-408f-a2da-2701c9736446 admin admin] PATH_INFO: `/v3/users/b7a15d6a11f84256bfc1c7a28aa35203` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:05.710410 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d3b5d-6be8-408f-a2da-2701c9736446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7a15d6a11f84256bfc1c7a28aa35203)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:05.713178 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d3b5d-6be8-408f-a2da-2701c9736446 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:05.787454 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 864/1704] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:38:05 2022] PUT /identity/v3/projects/4aaf940dabd2415b97d9b08ed95d69d0/users/7c72299ec72f4ece80cc2f5bbf2929c8/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:05.791872 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d12d0-3212-4dfb-85e0-e22d882f459b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:05.932917 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:05.993837 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d12d0-3212-4dfb-85e0-e22d882f459b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:06.000577 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e91be-cd36-46b2-82f7-e82fc29872aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:06.001794 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e91be-cd36-46b2-82f7-e82fc29872aa admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:06.001999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e91be-cd36-46b2-82f7-e82fc29872aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:06.002419 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e91be-cd36-46b2-82f7-e82fc29872aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:06.006284 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e91be-cd36-46b2-82f7-e82fc29872aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:06.009078 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e91be-cd36-46b2-82f7-e82fc29872aa admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:06.027034 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 865/1705] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:38:06.037140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e91be-cd36-46b2-82f7-e82fc29872aa admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:06.064595 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e98d3b5d-6be8-408f-a2da-2701c9736446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7a15d6a11f84256bfc1c7a28aa35203'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:06.068187 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e98d3b5d-6be8-408f-a2da-2701c9736446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7a15d6a11f84256bfc1c7a28aa35203'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:06.073184 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e91be-cd36-46b2-82f7-e82fc29872aa admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:06.087557 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e98d3b5d-6be8-408f-a2da-2701c9736446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7a15d6a11f84256bfc1c7a28aa35203'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:06.087557 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e98d3b5d-6be8-408f-a2da-2701c9736446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7a15d6a11f84256bfc1c7a28aa35203'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:06.090266 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed20459-1bbe-47a7-a26c-c599bfe7b008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:06.094220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed20459-1bbe-47a7-a26c-c599bfe7b008 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:06.094912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed20459-1bbe-47a7-a26c-c599bfe7b008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:06.095407 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed20459-1bbe-47a7-a26c-c599bfe7b008 admin admin] PATH_INFO: `/v3/projects/4aaf940dabd2415b97d9b08ed95d69d0/users/7c72299ec72f4ece80cc2f5bbf2929c8/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:06.105500 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed20459-1bbe-47a7-a26c-c599bfe7b008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aaf940dabd2415b97d9b08ed95d69d0, user_id=7c72299ec72f4ece80cc2f5bbf2929c8, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:06.112798 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed20459-1bbe-47a7-a26c-c599bfe7b008 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:06.139726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 866/1706] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:38:06 2022] PUT /identity/v3/projects/4aaf940dabd2415b97d9b08ed95d69d0/users/7c72299ec72f4ece80cc2f5bbf2929c8/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:06.149971 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe45a4c-7621-4afd-a5c7-4edf7545fb37 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:06.150489 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe45a4c-7621-4afd-a5c7-4edf7545fb37 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:06.151659 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe45a4c-7621-4afd-a5c7-4edf7545fb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:06.193830 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e98d3b5d-6be8-408f-a2da-2701c9736446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7a15d6a11f84256bfc1c7a28aa35203'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:06.213395 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-2fe45a4c-7621-4afd-a5c7-4edf7545fb37 None None] MFA Rules not processed for user `7c72299ec72f4ece80cc2f5bbf2929c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:06.215399 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2fe45a4c-7621-4afd-a5c7-4edf7545fb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:06.220296 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 841/1707] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:38:05 2022] DELETE /identity/v3/users/b7a15d6a11f84256bfc1c7a28aa35203 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:06.235400 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac298d-f3cd-4db5-b999-9e83999396ef None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:06.235400 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac298d-f3cd-4db5-b999-9e83999396ef None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:06.235400 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac298d-f3cd-4db5-b999-9e83999396ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:06.291202 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-c4ac298d-f3cd-4db5-b999-9e83999396ef None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:06.292772 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c4ac298d-f3cd-4db5-b999-9e83999396ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:06.344957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 867/1708] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:06 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:06.366646 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe45a4c-7621-4afd-a5c7-4edf7545fb37 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:06.370417 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2fe45a4c-7621-4afd-a5c7-4edf7545fb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:06.530515 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 842/1709] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:06.580640 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac298d-f3cd-4db5-b999-9e83999396ef None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:06.582386 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c4ac298d-f3cd-4db5-b999-9e83999396ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:06.658379 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe45a4c-7621-4afd-a5c7-4edf7545fb37 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:06.659706 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac298d-f3cd-4db5-b999-9e83999396ef None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:06.688647 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ce5cc-6425-43d5-90a8-ad7381f917d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:06.688647 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ce5cc-6425-43d5-90a8-ad7381f917d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:06.688647 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ce5cc-6425-43d5-90a8-ad7381f917d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:06.688647 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ce5cc-6425-43d5-90a8-ad7381f917d1 admin admin] PATH_INFO: `/v3/users/a9daaf6a88b74bb4a11ab8e3f122fa82` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:06.695620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ce5cc-6425-43d5-90a8-ad7381f917d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9daaf6a88b74bb4a11ab8e3f122fa82)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:06.701815 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ce5cc-6425-43d5-90a8-ad7381f917d1 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:06.823035 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b7476-f8aa-4108-b1c1-1213acf8cc7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:06.823833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b7476-f8aa-4108-b1c1-1213acf8cc7f service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:06.824355 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b7476-f8aa-4108-b1c1-1213acf8cc7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:06.824903 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b7476-f8aa-4108-b1c1-1213acf8cc7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:07.005044 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b7476-f8aa-4108-b1c1-1213acf8cc7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:07.008902 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b7476-f8aa-4108-b1c1-1213acf8cc7f service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:07.011190 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d01ce5cc-6425-43d5-90a8-ad7381f917d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9daaf6a88b74bb4a11ab8e3f122fa82'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:07.012297 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d01ce5cc-6425-43d5-90a8-ad7381f917d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9daaf6a88b74bb4a11ab8e3f122fa82'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:07.036291 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 868/1710] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:38:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:38:07.038178 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b7476-f8aa-4108-b1c1-1213acf8cc7f service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:07.043888 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-905b7476-f8aa-4108-b1c1-1213acf8cc7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:07.063862 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d01ce5cc-6425-43d5-90a8-ad7381f917d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9daaf6a88b74bb4a11ab8e3f122fa82'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:07.068335 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d01ce5cc-6425-43d5-90a8-ad7381f917d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9daaf6a88b74bb4a11ab8e3f122fa82'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:07.175848 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d01ce5cc-6425-43d5-90a8-ad7381f917d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9daaf6a88b74bb4a11ab8e3f122fa82'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:07.201285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 843/1711] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:38:06 2022] DELETE /identity/v3/users/a9daaf6a88b74bb4a11ab8e3f122fa82 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:07.202523 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ce5cc-6425-43d5-90a8-ad7381f917d1 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:07.212415 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d01ce5cc-6425-43d5-90a8-ad7381f917d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:07.251511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:07.254131 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b7476-f8aa-4108-b1c1-1213acf8cc7f service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:07.358356 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91003a47-665e-49ae-98b2-55f0a1700b8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:07.359241 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91003a47-665e-49ae-98b2-55f0a1700b8f service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:07.360048 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91003a47-665e-49ae-98b2-55f0a1700b8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:07.360568 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91003a47-665e-49ae-98b2-55f0a1700b8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:07.377641 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-91003a47-665e-49ae-98b2-55f0a1700b8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:07.389059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ce5cc-6425-43d5-90a8-ad7381f917d1 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:07.413362 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91003a47-665e-49ae-98b2-55f0a1700b8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:07.414806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91003a47-665e-49ae-98b2-55f0a1700b8f service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:07.423611 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28261c90-5a1f-47dc-9a63-6191a7213dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:07.425405 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28261c90-5a1f-47dc-9a63-6191a7213dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:07.426556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28261c90-5a1f-47dc-9a63-6191a7213dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:07.426989 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28261c90-5a1f-47dc-9a63-6191a7213dd4 admin admin] PATH_INFO: `/v3/projects/4c499faddb204af092900c6319dbe425` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:07.429126 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28261c90-5a1f-47dc-9a63-6191a7213dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c499faddb204af092900c6319dbe425)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:07.433659 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28261c90-5a1f-47dc-9a63-6191a7213dd4 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:07.460636 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 869/1712] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:38:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:38:07.463254 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91003a47-665e-49ae-98b2-55f0a1700b8f service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:07.469500 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-91003a47-665e-49ae-98b2-55f0a1700b8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:07.631970 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-28261c90-5a1f-47dc-9a63-6191a7213dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c499faddb204af092900c6319dbe425', 'request_id': 'req-28261c90-5a1f-47dc-9a63-6191a7213dd4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:07.651042 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91003a47-665e-49ae-98b2-55f0a1700b8f service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:07.719304 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-28261c90-5a1f-47dc-9a63-6191a7213dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c499faddb204af092900c6319dbe425', 'request_id': 'req-28261c90-5a1f-47dc-9a63-6191a7213dd4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:07.729534 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-28261c90-5a1f-47dc-9a63-6191a7213dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c499faddb204af092900c6319dbe425', 'request_id': 'req-28261c90-5a1f-47dc-9a63-6191a7213dd4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:07.762210 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-28261c90-5a1f-47dc-9a63-6191a7213dd4 admin admin] The token cache is being invalidate because project 4c499faddb204af092900c6319dbe425 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:38:07.762499 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-28261c90-5a1f-47dc-9a63-6191a7213dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:07.766443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-28261c90-5a1f-47dc-9a63-6191a7213dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:07.781633 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 844/1713] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:38:07 2022] DELETE /identity/v3/projects/4c499faddb204af092900c6319dbe425 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:07.783362 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b770d0-9679-4816-a195-5c73c0a55e52 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:07.783653 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b770d0-9679-4816-a195-5c73c0a55e52 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:07.783930 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b770d0-9679-4816-a195-5c73c0a55e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:07.806988 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a6e59-3a2a-4e9e-97af-a2d28c911b82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:07.809592 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a6e59-3a2a-4e9e-97af-a2d28c911b82 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:07.809592 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a6e59-3a2a-4e9e-97af-a2d28c911b82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:07.809592 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a6e59-3a2a-4e9e-97af-a2d28c911b82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:07.818836 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-909a6e59-3a2a-4e9e-97af-a2d28c911b82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:07.848772 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a5b770d0-9679-4816-a195-5c73c0a55e52 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:07.850745 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a5b770d0-9679-4816-a195-5c73c0a55e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:07.865531 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:07.992295 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 845/1714] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:07.993551 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b770d0-9679-4816-a195-5c73c0a55e52 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:07.995283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a5b770d0-9679-4816-a195-5c73c0a55e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:08.065958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a6e59-3a2a-4e9e-97af-a2d28c911b82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:08.076442 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a6e59-3a2a-4e9e-97af-a2d28c911b82 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:08.095399 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 870/1715] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:38:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:38:08.097624 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a6e59-3a2a-4e9e-97af-a2d28c911b82 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:08.107296 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-909a6e59-3a2a-4e9e-97af-a2d28c911b82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:08.134952 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a6e59-3a2a-4e9e-97af-a2d28c911b82 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:08.151757 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299dca6-fafb-4d25-993b-b02fd5f06b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:08.152815 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299dca6-fafb-4d25-993b-b02fd5f06b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:08.153214 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299dca6-fafb-4d25-993b-b02fd5f06b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:08.153599 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299dca6-fafb-4d25-993b-b02fd5f06b1e admin admin] PATH_INFO: `/v3/users/5a425aca2b064455baa360d51bc7337e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:08.161488 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299dca6-fafb-4d25-993b-b02fd5f06b1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a425aca2b064455baa360d51bc7337e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:08.161488 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299dca6-fafb-4d25-993b-b02fd5f06b1e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:08.164130 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b770d0-9679-4816-a195-5c73c0a55e52 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:08.185010 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17bfb7-9852-4bdd-8d7a-1ca87e75995a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63253cd786c04d6a9d099773198aee36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:08.186583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17bfb7-9852-4bdd-8d7a-1ca87e75995a service placement] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:08.187002 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17bfb7-9852-4bdd-8d7a-1ca87e75995a service placement] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:08.189646 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17bfb7-9852-4bdd-8d7a-1ca87e75995a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:08.196975 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-5e17bfb7-9852-4bdd-8d7a-1ca87e75995a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:08.232632 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17bfb7-9852-4bdd-8d7a-1ca87e75995a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:08.236864 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17bfb7-9852-4bdd-8d7a-1ca87e75995a service placement] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:08.253630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:08.261007 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 846/1716] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:38:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:38:08.262445 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17bfb7-9852-4bdd-8d7a-1ca87e75995a service placement] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:08.265727 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-5e17bfb7-9852-4bdd-8d7a-1ca87e75995a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:08.393111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:08.424574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17bfb7-9852-4bdd-8d7a-1ca87e75995a service placement] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:08.432491 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e0cc6-5272-4751-9c4d-9a67c1502ddf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:08.435240 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e0cc6-5272-4751-9c4d-9a67c1502ddf service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:08.435240 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e0cc6-5272-4751-9c4d-9a67c1502ddf service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:08.435240 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e0cc6-5272-4751-9c4d-9a67c1502ddf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:08.446870 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e0cc6-5272-4751-9c4d-9a67c1502ddf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:08.448654 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e0cc6-5272-4751-9c4d-9a67c1502ddf service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:08.459861 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5299dca6-fafb-4d25-993b-b02fd5f06b1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a425aca2b064455baa360d51bc7337e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:08.467271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5299dca6-fafb-4d25-993b-b02fd5f06b1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a425aca2b064455baa360d51bc7337e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:08.467271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5299dca6-fafb-4d25-993b-b02fd5f06b1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a425aca2b064455baa360d51bc7337e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:08.470205 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 847/1717] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:38:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:38:08.530634 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5299dca6-fafb-4d25-993b-b02fd5f06b1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a425aca2b064455baa360d51bc7337e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:08.616828 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5299dca6-fafb-4d25-993b-b02fd5f06b1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a425aca2b064455baa360d51bc7337e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:08.637174 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 871/1718] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:38:08 2022] DELETE /identity/v3/users/5a425aca2b064455baa360d51bc7337e => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:09.781676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e0cc6-5272-4751-9c4d-9a67c1502ddf service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:09.783611 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f72e0cc6-5272-4751-9c4d-9a67c1502ddf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:09.820053 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e0cc6-5272-4751-9c4d-9a67c1502ddf service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:09.980177 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbc360-92b1-4e5f-a26e-8ab9a29763c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:09.981030 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbc360-92b1-4e5f-a26e-8ab9a29763c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:09.981313 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbc360-92b1-4e5f-a26e-8ab9a29763c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:09.981601 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbc360-92b1-4e5f-a26e-8ab9a29763c4 admin admin] PATH_INFO: `/v3/projects/6b3dfdfdfbd547a5bd83b7a7deb3727e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:09.986011 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bbc360-92b1-4e5f-a26e-8ab9a29763c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b3dfdfdfbd547a5bd83b7a7deb3727e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:09.987639 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bbc360-92b1-4e5f-a26e-8ab9a29763c4 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:10.163250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:10.174664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-47bbc360-92b1-4e5f-a26e-8ab9a29763c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b3dfdfdfbd547a5bd83b7a7deb3727e', 'request_id': 'req-47bbc360-92b1-4e5f-a26e-8ab9a29763c4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:10.271832 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-47bbc360-92b1-4e5f-a26e-8ab9a29763c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b3dfdfdfbd547a5bd83b7a7deb3727e', 'request_id': 'req-47bbc360-92b1-4e5f-a26e-8ab9a29763c4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:10.281901 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-47bbc360-92b1-4e5f-a26e-8ab9a29763c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b3dfdfdfbd547a5bd83b7a7deb3727e', 'request_id': 'req-47bbc360-92b1-4e5f-a26e-8ab9a29763c4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:10.313999 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-47bbc360-92b1-4e5f-a26e-8ab9a29763c4 admin admin] The token cache is being invalidate because project 6b3dfdfdfbd547a5bd83b7a7deb3727e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:38:10.314273 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-47bbc360-92b1-4e5f-a26e-8ab9a29763c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:10.316711 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-47bbc360-92b1-4e5f-a26e-8ab9a29763c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:10.322183 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 848/1719] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:38:09 2022] DELETE /identity/v3/projects/6b3dfdfdfbd547a5bd83b7a7deb3727e => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:10.326403 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299dca6-fafb-4d25-993b-b02fd5f06b1e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:10.338277 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5299dca6-fafb-4d25-993b-b02fd5f06b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:10.340865 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbc360-92b1-4e5f-a26e-8ab9a29763c4 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:10.343066 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-47bbc360-92b1-4e5f-a26e-8ab9a29763c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:10.382001 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299dca6-fafb-4d25-993b-b02fd5f06b1e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:10.566061 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:10.580257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbc360-92b1-4e5f-a26e-8ab9a29763c4 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:10.599235 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a81972-d73a-41b1-9f73-9153545ed69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:10.599987 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a81972-d73a-41b1-9f73-9153545ed69c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:10.600265 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a81972-d73a-41b1-9f73-9153545ed69c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:10.600533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a81972-d73a-41b1-9f73-9153545ed69c admin admin] PATH_INFO: `/v3/projects/966d61f09a32466093ade22b35c01917` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:10.608887 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a81972-d73a-41b1-9f73-9153545ed69c admin admin] RBAC: Authorizing `identity:delete_project(project_id=966d61f09a32466093ade22b35c01917)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:10.611224 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7ffe0-6a49-471a-b492-828fc2bf971e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:10.615492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a81972-d73a-41b1-9f73-9153545ed69c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:10.623762 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7ffe0-6a49-471a-b492-828fc2bf971e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:10.624137 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7ffe0-6a49-471a-b492-828fc2bf971e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:10.624421 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7ffe0-6a49-471a-b492-828fc2bf971e admin admin] PATH_INFO: `/v3/users/08892dde25cb44239a966063828e57af` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:10.628272 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d7ffe0-6a49-471a-b492-828fc2bf971e admin admin] RBAC: Authorizing `identity:delete_user(user_id=08892dde25cb44239a966063828e57af)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:10.634297 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d7ffe0-6a49-471a-b492-828fc2bf971e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:10.902545 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b4a81972-d73a-41b1-9f73-9153545ed69c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '966d61f09a32466093ade22b35c01917', 'request_id': 'req-b4a81972-d73a-41b1-9f73-9153545ed69c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:10.912019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-77d7ffe0-6a49-471a-b492-828fc2bf971e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08892dde25cb44239a966063828e57af'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:10.915606 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-77d7ffe0-6a49-471a-b492-828fc2bf971e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08892dde25cb44239a966063828e57af'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:10.917146 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-77d7ffe0-6a49-471a-b492-828fc2bf971e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08892dde25cb44239a966063828e57af'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:10.968501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-77d7ffe0-6a49-471a-b492-828fc2bf971e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08892dde25cb44239a966063828e57af'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:11.011653 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b4a81972-d73a-41b1-9f73-9153545ed69c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '966d61f09a32466093ade22b35c01917', 'request_id': 'req-b4a81972-d73a-41b1-9f73-9153545ed69c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:11.022033 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b4a81972-d73a-41b1-9f73-9153545ed69c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '966d61f09a32466093ade22b35c01917', 'request_id': 'req-b4a81972-d73a-41b1-9f73-9153545ed69c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:11.038981 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b4a81972-d73a-41b1-9f73-9153545ed69c admin admin] The token cache is being invalidate because project 966d61f09a32466093ade22b35c01917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:38:11.039589 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b4a81972-d73a-41b1-9f73-9153545ed69c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:11.040756 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b4a81972-d73a-41b1-9f73-9153545ed69c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:11.044531 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 849/1720] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:38:10 2022] DELETE /identity/v3/projects/966d61f09a32466093ade22b35c01917 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:11.046740 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e6c9a-5159-4637-9800-45a5549d4bb9 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:11.047601 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e6c9a-5159-4637-9800-45a5549d4bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:11.055327 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e6c9a-5159-4637-9800-45a5549d4bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:11.095622 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-77d7ffe0-6a49-471a-b492-828fc2bf971e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08892dde25cb44239a966063828e57af'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:11.112915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ba5e6c9a-5159-4637-9800-45a5549d4bb9 None None] MFA Rules not processed for user `3acc0010e3f54283934b75f58bb6ec93`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:11.113377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 872/1721] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:38:10 2022] DELETE /identity/v3/users/08892dde25cb44239a966063828e57af => generated 0 bytes in 787 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:11.114792 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7ffe0-6a49-471a-b492-828fc2bf971e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:11.115020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ba5e6c9a-5159-4637-9800-45a5549d4bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:11.127774 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-77d7ffe0-6a49-471a-b492-828fc2bf971e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:11.288619 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7ffe0-6a49-471a-b492-828fc2bf971e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:11.292066 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 850/1722] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:11.293673 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea673a-4e32-4e88-932f-e2996c4346f3 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:11.305135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea673a-4e32-4e88-932f-e2996c4346f3 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:11.305479 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea673a-4e32-4e88-932f-e2996c4346f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:11.310706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d4495-3ecf-4cd2-8971-42317d0d928e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:11.311504 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d4495-3ecf-4cd2-8971-42317d0d928e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:11.312498 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d4495-3ecf-4cd2-8971-42317d0d928e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:11.312791 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d4495-3ecf-4cd2-8971-42317d0d928e admin admin] PATH_INFO: `/v3/projects/75b83442ad4441d49b02d7ff3df9fe1b` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:11.314923 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d4495-3ecf-4cd2-8971-42317d0d928e admin admin] RBAC: Authorizing `identity:delete_project(project_id=75b83442ad4441d49b02d7ff3df9fe1b)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:11.321568 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: WARNING py.warnings [None req-2f7d4495-3ecf-4cd2-8971-42317d0d928e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:38:11.321568 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: warnings.warn(msg) Aug 24 14:38:11.321568 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: Aug 24 14:38:11.321568 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d4495-3ecf-4cd2-8971-42317d0d928e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:11.351146 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-35ea673a-4e32-4e88-932f-e2996c4346f3 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:11.353740 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-35ea673a-4e32-4e88-932f-e2996c4346f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:11.371669 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 851/1723] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:11.373179 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab88a4-708d-4ea1-9c13-80388e1fe9fe None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:11.373471 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab88a4-708d-4ea1-9c13-80388e1fe9fe None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:11.373855 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab88a4-708d-4ea1-9c13-80388e1fe9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:11.428192 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-41ab88a4-708d-4ea1-9c13-80388e1fe9fe None None] MFA Rules not processed for user `556b3a886df740cda4a94e55d2fcc08a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:11.429840 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-41ab88a4-708d-4ea1-9c13-80388e1fe9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:11.496112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2f7d4495-3ecf-4cd2-8971-42317d0d928e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75b83442ad4441d49b02d7ff3df9fe1b', 'request_id': 'req-2f7d4495-3ecf-4cd2-8971-42317d0d928e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:11.575684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2f7d4495-3ecf-4cd2-8971-42317d0d928e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75b83442ad4441d49b02d7ff3df9fe1b', 'request_id': 'req-2f7d4495-3ecf-4cd2-8971-42317d0d928e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:11.613450 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2f7d4495-3ecf-4cd2-8971-42317d0d928e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75b83442ad4441d49b02d7ff3df9fe1b', 'request_id': 'req-2f7d4495-3ecf-4cd2-8971-42317d0d928e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:11.661954 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2f7d4495-3ecf-4cd2-8971-42317d0d928e admin admin] The token cache is being invalidate because project 75b83442ad4441d49b02d7ff3df9fe1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:38:11.662248 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2f7d4495-3ecf-4cd2-8971-42317d0d928e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:11.664343 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2f7d4495-3ecf-4cd2-8971-42317d0d928e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:11.672674 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 873/1724] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:38:11 2022] DELETE /identity/v3/projects/75b83442ad4441d49b02d7ff3df9fe1b => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:11.674745 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c770e5-78a4-4ced-a0fb-68e305080f20 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:11.675111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c770e5-78a4-4ced-a0fb-68e305080f20 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:11.675405 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c770e5-78a4-4ced-a0fb-68e305080f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:11.688364 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 852/1725] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:11.690172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e37eec-17ad-4488-a5f6-b14dd2c80d6f None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:11.694223 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e37eec-17ad-4488-a5f6-b14dd2c80d6f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:11.694658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e37eec-17ad-4488-a5f6-b14dd2c80d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:11.729595 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-66c770e5-78a4-4ced-a0fb-68e305080f20 None None] MFA Rules not processed for user `3acc0010e3f54283934b75f58bb6ec93`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:11.732210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-66c770e5-78a4-4ced-a0fb-68e305080f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:11.744784 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-20e37eec-17ad-4488-a5f6-b14dd2c80d6f None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:11.748544 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-20e37eec-17ad-4488-a5f6-b14dd2c80d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:11.870703 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 853/1726] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:11.872983 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd70f57-4abe-42d2-8059-40ec95239b6c None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:11.873280 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd70f57-4abe-42d2-8059-40ec95239b6c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:11.874459 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd70f57-4abe-42d2-8059-40ec95239b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:11.901372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-afd70f57-4abe-42d2-8059-40ec95239b6c None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:11.902974 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-afd70f57-4abe-42d2-8059-40ec95239b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:11.904765 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 874/1727] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:11.906302 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c770e5-78a4-4ced-a0fb-68e305080f20 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:11.908238 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-66c770e5-78a4-4ced-a0fb-68e305080f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:11.915327 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 854/1728] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:11.917106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd70f57-4abe-42d2-8059-40ec95239b6c None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:11.921857 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-afd70f57-4abe-42d2-8059-40ec95239b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:11.938530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd70f57-4abe-42d2-8059-40ec95239b6c None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:11.947156 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d39875-6a55-4d83-bf49-8cc6ae172032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:11.948212 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d39875-6a55-4d83-bf49-8cc6ae172032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:11.948767 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d39875-6a55-4d83-bf49-8cc6ae172032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:11.949238 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d39875-6a55-4d83-bf49-8cc6ae172032 admin admin] PATH_INFO: `/v3/projects/fc924f1ada0741c4bec60b83a6bae90b` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:11.951429 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d39875-6a55-4d83-bf49-8cc6ae172032 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc924f1ada0741c4bec60b83a6bae90b)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:11.954358 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d39875-6a55-4d83-bf49-8cc6ae172032 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:12.061493 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c770e5-78a4-4ced-a0fb-68e305080f20 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:12.073388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590d586-91ab-4589-8872-a4c63f24a430 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:12.080406 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590d586-91ab-4589-8872-a4c63f24a430 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:12.080406 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590d586-91ab-4589-8872-a4c63f24a430 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:12.080406 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590d586-91ab-4589-8872-a4c63f24a430 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:12.080406 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1590d586-91ab-4589-8872-a4c63f24a430 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:12.149195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-91d39875-6a55-4d83-bf49-8cc6ae172032 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc924f1ada0741c4bec60b83a6bae90b', 'request_id': 'req-91d39875-6a55-4d83-bf49-8cc6ae172032'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:12.234270 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-91d39875-6a55-4d83-bf49-8cc6ae172032 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc924f1ada0741c4bec60b83a6bae90b', 'request_id': 'req-91d39875-6a55-4d83-bf49-8cc6ae172032'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:12.247110 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-91d39875-6a55-4d83-bf49-8cc6ae172032 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc924f1ada0741c4bec60b83a6bae90b', 'request_id': 'req-91d39875-6a55-4d83-bf49-8cc6ae172032'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:12.269145 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590d586-91ab-4589-8872-a4c63f24a430 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:12.274493 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590d586-91ab-4589-8872-a4c63f24a430 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:12.290505 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-91d39875-6a55-4d83-bf49-8cc6ae172032 admin admin] The token cache is being invalidate because project fc924f1ada0741c4bec60b83a6bae90b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:38:12.291338 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-91d39875-6a55-4d83-bf49-8cc6ae172032 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:12.292275 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-91d39875-6a55-4d83-bf49-8cc6ae172032 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:12.294786 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 855/1729] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:38:11 2022] DELETE /identity/v3/projects/fc924f1ada0741c4bec60b83a6bae90b => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:12.295097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 875/1730] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:38:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:38:12.296163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d39875-6a55-4d83-bf49-8cc6ae172032 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:12.296900 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f28f2d-097a-41b8-9041-e7e08751c573 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:12.297362 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f28f2d-097a-41b8-9041-e7e08751c573 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:12.297718 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f28f2d-097a-41b8-9041-e7e08751c573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:12.298401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-91d39875-6a55-4d83-bf49-8cc6ae172032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:12.343814 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-57f28f2d-097a-41b8-9041-e7e08751c573 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:12.345344 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-57f28f2d-097a-41b8-9041-e7e08751c573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:12.448148 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 876/1731] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:12.449165 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f28f2d-097a-41b8-9041-e7e08751c573 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:12.451335 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-57f28f2d-097a-41b8-9041-e7e08751c573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:12.459026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:12.474020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d39875-6a55-4d83-bf49-8cc6ae172032 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:12.482012 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721bc72-5d56-4df2-8cf7-22edd3aede4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:12.482702 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721bc72-5d56-4df2-8cf7-22edd3aede4f admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:12.483091 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721bc72-5d56-4df2-8cf7-22edd3aede4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:12.483370 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721bc72-5d56-4df2-8cf7-22edd3aede4f admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:12.484148 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721bc72-5d56-4df2-8cf7-22edd3aede4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:38:12.484457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721bc72-5d56-4df2-8cf7-22edd3aede4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:12.486636 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721bc72-5d56-4df2-8cf7-22edd3aede4f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:12.501537 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 856/1732] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:38:12.503013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa5f8f-757f-4953-a6bf-b81175adf135 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:12.503300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa5f8f-757f-4953-a6bf-b81175adf135 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:12.503576 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa5f8f-757f-4953-a6bf-b81175adf135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:12.540976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a8aa5f8f-757f-4953-a6bf-b81175adf135 None None] MFA Rules not processed for user `fbdf19910c234794b8aeb480dba50d85`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:12.540976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a8aa5f8f-757f-4953-a6bf-b81175adf135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:12.720261 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f28f2d-097a-41b8-9041-e7e08751c573 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:12.723582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 857/1733] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:12.726514 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c8aa0-346f-4cc1-813f-fb9d92df95a8 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:12.726967 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c8aa0-346f-4cc1-813f-fb9d92df95a8 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:12.727565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c8aa0-346f-4cc1-813f-fb9d92df95a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:12.769579 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d88e9-690b-4f40-980f-841d43c3daa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:12.770638 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d88e9-690b-4f40-980f-841d43c3daa7 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:12.770893 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d88e9-690b-4f40-980f-841d43c3daa7 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:12.771226 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d88e9-690b-4f40-980f-841d43c3daa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:12.777416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-8c7c8aa0-346f-4cc1-813f-fb9d92df95a8 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:12.778427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-021d88e9-690b-4f40-980f-841d43c3daa7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:12.779339 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-8c7c8aa0-346f-4cc1-813f-fb9d92df95a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:12.805368 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 858/1734] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:12.806586 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c8aa0-346f-4cc1-813f-fb9d92df95a8 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:12.835506 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c8aa0-346f-4cc1-813f-fb9d92df95a8 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:12.847300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3122c5e-da4d-4f9c-9a1d-6ea03805368e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:12.848043 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3122c5e-da4d-4f9c-9a1d-6ea03805368e admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:12.848331 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3122c5e-da4d-4f9c-9a1d-6ea03805368e admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:12.848614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3122c5e-da4d-4f9c-9a1d-6ea03805368e admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:12.849287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3122c5e-da4d-4f9c-9a1d-6ea03805368e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:38:12.849597 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3122c5e-da4d-4f9c-9a1d-6ea03805368e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:12.855227 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3122c5e-da4d-4f9c-9a1d-6ea03805368e admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:12.884197 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 859/1735] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:38:12.885113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3122c5e-da4d-4f9c-9a1d-6ea03805368e admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:12.890246 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:12.910009 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3122c5e-da4d-4f9c-9a1d-6ea03805368e admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:12.934932 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac430fc-6345-490e-a4ec-b2b9049e724c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:12.937981 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac430fc-6345-490e-a4ec-b2b9049e724c admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:12.938657 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac430fc-6345-490e-a4ec-b2b9049e724c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:12.944013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac430fc-6345-490e-a4ec-b2b9049e724c admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:12.945461 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac430fc-6345-490e-a4ec-b2b9049e724c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:12.950683 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac430fc-6345-490e-a4ec-b2b9049e724c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:12.989457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021d88e9-690b-4f40-980f-841d43c3daa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:12.992878 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021d88e9-690b-4f40-980f-841d43c3daa7 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:13.029486 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 877/1736] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:38:12 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:38:13.030897 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a3533-ebd4-447a-99e9-30e6b876c50d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:13.031218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a3533-ebd4-447a-99e9-30e6b876c50d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:13.031499 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a3533-ebd4-447a-99e9-30e6b876c50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:13.064602 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f60a3533-ebd4-447a-99e9-30e6b876c50d None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:13.072823 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f60a3533-ebd4-447a-99e9-30e6b876c50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:13.097220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 878/1737] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:13.098797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a3533-ebd4-447a-99e9-30e6b876c50d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:13.134548 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a3533-ebd4-447a-99e9-30e6b876c50d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:13.139905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df1d11-a02f-49b4-8ce0-f895f63a161a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:13.140968 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df1d11-a02f-49b4-8ce0-f895f63a161a admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:13.141391 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df1d11-a02f-49b4-8ce0-f895f63a161a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:13.142524 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df1d11-a02f-49b4-8ce0-f895f63a161a admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:13.143408 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df1d11-a02f-49b4-8ce0-f895f63a161a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:13.149498 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df1d11-a02f-49b4-8ce0-f895f63a161a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:13.165165 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 860/1738] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:38:12 2022] POST /identity/v3/projects => generated 355 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:38:13.172968 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac430fc-6345-490e-a4ec-b2b9049e724c admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:13.306873 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 879/1739] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:38:13 2022] POST /identity/v3/projects => generated 375 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:38:13.306873 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df1d11-a02f-49b4-8ce0-f895f63a161a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:13.420477 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac430fc-6345-490e-a4ec-b2b9049e724c admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:13.537066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df1d11-a02f-49b4-8ce0-f895f63a161a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:13.556985 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233a677-5876-4b58-ab97-1caa4783c198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:13.557680 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233a677-5876-4b58-ab97-1caa4783c198 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:13.557988 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233a677-5876-4b58-ab97-1caa4783c198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:13.559444 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233a677-5876-4b58-ab97-1caa4783c198 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:13.560814 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233a677-5876-4b58-ab97-1caa4783c198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:13.578578 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233a677-5876-4b58-ab97-1caa4783c198 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:13.579646 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e74032-aef7-4960-b569-34c6f55e8b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:13.583677 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e74032-aef7-4960-b569-34c6f55e8b07 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:13.586014 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e74032-aef7-4960-b569-34c6f55e8b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:13.586422 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e74032-aef7-4960-b569-34c6f55e8b07 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:13.587289 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e74032-aef7-4960-b569-34c6f55e8b07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:38:13.589104 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e74032-aef7-4960-b569-34c6f55e8b07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:13.593734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e74032-aef7-4960-b569-34c6f55e8b07 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:13.622370 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 861/1740] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:38:13.623471 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e74032-aef7-4960-b569-34c6f55e8b07 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:13.651220 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e74032-aef7-4960-b569-34c6f55e8b07 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:13.659107 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa718e-29db-42d7-b3fd-78cf8f0420ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:13.659743 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa718e-29db-42d7-b3fd-78cf8f0420ac admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:13.660916 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa718e-29db-42d7-b3fd-78cf8f0420ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:13.660916 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa718e-29db-42d7-b3fd-78cf8f0420ac admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:13.662449 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa718e-29db-42d7-b3fd-78cf8f0420ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:13.673008 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa718e-29db-42d7-b3fd-78cf8f0420ac admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:13.705226 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 880/1741] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:38:13 2022] POST /identity/v3/users => generated 278 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:38:13.706528 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233a677-5876-4b58-ab97-1caa4783c198 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:13.744708 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233a677-5876-4b58-ab97-1caa4783c198 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:13.772729 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4ff3c-27fe-48d9-bc1b-3501b0d5c234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:13.773678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4ff3c-27fe-48d9-bc1b-3501b0d5c234 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:13.775507 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4ff3c-27fe-48d9-bc1b-3501b0d5c234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:13.775917 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4ff3c-27fe-48d9-bc1b-3501b0d5c234 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:13.777373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4ff3c-27fe-48d9-bc1b-3501b0d5c234 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:13.779066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4ff3c-27fe-48d9-bc1b-3501b0d5c234 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:13.843901 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 862/1742] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:38:13 2022] POST /identity/v3/users => generated 288 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:38:13.844833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa718e-29db-42d7-b3fd-78cf8f0420ac admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:13.868557 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa718e-29db-42d7-b3fd-78cf8f0420ac admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:13.884392 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83797d02-2aaa-4632-8abd-a0e78d8addbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:13.885021 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83797d02-2aaa-4632-8abd-a0e78d8addbe admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:13.885303 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83797d02-2aaa-4632-8abd-a0e78d8addbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:13.885577 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83797d02-2aaa-4632-8abd-a0e78d8addbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:13.887168 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83797d02-2aaa-4632-8abd-a0e78d8addbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:13.887904 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83797d02-2aaa-4632-8abd-a0e78d8addbe admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:13.922195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 863/1743] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:38:13.923266 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83797d02-2aaa-4632-8abd-a0e78d8addbe admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:13.948705 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83797d02-2aaa-4632-8abd-a0e78d8addbe admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:13.952927 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 881/1744] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:38:13 2022] POST /identity/v3/projects => generated 359 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:38:13.954397 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4ff3c-27fe-48d9-bc1b-3501b0d5c234 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:14.079809 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b00a99-8b53-42ca-aac0-ee9756332cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:14.080748 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b00a99-8b53-42ca-aac0-ee9756332cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:14.083629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b00a99-8b53-42ca-aac0-ee9756332cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:14.083995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b00a99-8b53-42ca-aac0-ee9756332cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:14.084752 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b00a99-8b53-42ca-aac0-ee9756332cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:14.087983 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b00a99-8b53-42ca-aac0-ee9756332cc3 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:14.102047 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4ff3c-27fe-48d9-bc1b-3501b0d5c234 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:14.116330 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 864/1745] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:38:14.118478 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b00a99-8b53-42ca-aac0-ee9756332cc3 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:14.126788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b72d6-14f3-42a1-a23b-4d549d97161a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:14.127832 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b72d6-14f3-42a1-a23b-4d549d97161a admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:14.130433 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b72d6-14f3-42a1-a23b-4d549d97161a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:14.130865 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b72d6-14f3-42a1-a23b-4d549d97161a admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:14.132380 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b72d6-14f3-42a1-a23b-4d549d97161a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:14.137927 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b72d6-14f3-42a1-a23b-4d549d97161a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:14.139707 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b00a99-8b53-42ca-aac0-ee9756332cc3 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:14.147337 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f66ce-8477-4856-b5ca-d4f8f26abb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:14.148056 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f66ce-8477-4856-b5ca-d4f8f26abb65 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:14.148413 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f66ce-8477-4856-b5ca-d4f8f26abb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:14.148771 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f66ce-8477-4856-b5ca-d4f8f26abb65 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:14.149606 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f66ce-8477-4856-b5ca-d4f8f26abb65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:14.151800 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f66ce-8477-4856-b5ca-d4f8f26abb65 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:14.175728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 882/1746] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:38:14.175728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5967d83-6f6a-4d95-a844-69047e2a6b73 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:14.175728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5967d83-6f6a-4d95-a844-69047e2a6b73 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:14.176548 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5967d83-6f6a-4d95-a844-69047e2a6b73 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:14.178127 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 883/1747] 10.222.0.65 () {54 vars in 912 bytes} [Wed Aug 24 14:38:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:38:14.178714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5967d83-6f6a-4d95-a844-69047e2a6b73 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:14.202214 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5967d83-6f6a-4d95-a844-69047e2a6b73 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:14.213435 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b3dd5-123c-4f53-8f3a-f7f46cbf8870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:14.214145 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b3dd5-123c-4f53-8f3a-f7f46cbf8870 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:14.214430 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b3dd5-123c-4f53-8f3a-f7f46cbf8870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:14.214708 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b3dd5-123c-4f53-8f3a-f7f46cbf8870 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:14.215376 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b3dd5-123c-4f53-8f3a-f7f46cbf8870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:14.221073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b3dd5-123c-4f53-8f3a-f7f46cbf8870 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:14.236592 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 884/1748] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:38:14.237447 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b3dd5-123c-4f53-8f3a-f7f46cbf8870 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:14.251384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b3dd5-123c-4f53-8f3a-f7f46cbf8870 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:14.260933 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2faaed-488b-4f0f-a96f-0d578c141bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:14.261617 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2faaed-488b-4f0f-a96f-0d578c141bd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:14.261936 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2faaed-488b-4f0f-a96f-0d578c141bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:14.262216 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2faaed-488b-4f0f-a96f-0d578c141bd8 admin admin] PATH_INFO: `/v3/projects/80e79faf48104047913efa55086fd39b/users/e22348b155264c26a9a445c7e949d88c/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:14.283990 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2faaed-488b-4f0f-a96f-0d578c141bd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80e79faf48104047913efa55086fd39b, user_id=e22348b155264c26a9a445c7e949d88c, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:14.287868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 865/1749] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:38:14 2022] POST /identity/v3/users => generated 280 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:38:14.296992 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843eb4d7-d86e-458a-8e00-fd10e063a386 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:14.296992 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843eb4d7-d86e-458a-8e00-fd10e063a386 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:14.296992 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843eb4d7-d86e-458a-8e00-fd10e063a386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:14.297181 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2faaed-488b-4f0f-a96f-0d578c141bd8 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:14.401038 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 885/1750] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:38:14 2022] PUT /identity/v3/projects/80e79faf48104047913efa55086fd39b/users/e22348b155264c26a9a445c7e949d88c/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:14.402549 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c3e33-8324-46a2-b472-5bb5983d02a3 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:14.406138 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c3e33-8324-46a2-b472-5bb5983d02a3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:14.406801 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c3e33-8324-46a2-b472-5bb5983d02a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:14.431425 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-843eb4d7-d86e-458a-8e00-fd10e063a386 None None] MFA Rules not processed for user `477ab357d285415e8c0c82d414d242ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:14.444628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-843eb4d7-d86e-458a-8e00-fd10e063a386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:14.475478 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-512c3e33-8324-46a2-b472-5bb5983d02a3 None None] MFA Rules not processed for user `cb5021b569db41a08218cbec928442af`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:14.480293 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-512c3e33-8324-46a2-b472-5bb5983d02a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:14.643316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 886/1751] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 14:38:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:14.644250 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c3e33-8324-46a2-b472-5bb5983d02a3 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:14.682084 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 866/1752] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 14:38:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:14.696260 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843eb4d7-d86e-458a-8e00-fd10e063a386 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:14.811158 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c3e33-8324-46a2-b472-5bb5983d02a3 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:14.823528 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1653c0-fb36-4f8a-98d5-a56c8981d1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:14.824225 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1653c0-fb36-4f8a-98d5-a56c8981d1d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:14.824505 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1653c0-fb36-4f8a-98d5-a56c8981d1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:14.824780 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1653c0-fb36-4f8a-98d5-a56c8981d1d5 admin admin] PATH_INFO: `/v3/projects/64ee0694e58e493488db4c40273a1b32/users/86590cc2b82448259f60de3d85d3677b/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:14.858794 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843eb4d7-d86e-458a-8e00-fd10e063a386 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:14.868790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbf704-67f6-4ef7-b30c-7b6fe3d19c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:14.873835 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbf704-67f6-4ef7-b30c-7b6fe3d19c98 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:14.873835 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbf704-67f6-4ef7-b30c-7b6fe3d19c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:14.873835 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbf704-67f6-4ef7-b30c-7b6fe3d19c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:14.873835 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbf704-67f6-4ef7-b30c-7b6fe3d19c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:14.873835 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbf704-67f6-4ef7-b30c-7b6fe3d19c98 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:14.889669 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 867/1753] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:38:14.891120 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bcc61-e08d-4741-aa27-9ac43fd1f9a2 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:14.891518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bcc61-e08d-4741-aa27-9ac43fd1f9a2 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:14.891894 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bcc61-e08d-4741-aa27-9ac43fd1f9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:14.892663 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1653c0-fb36-4f8a-98d5-a56c8981d1d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ee0694e58e493488db4c40273a1b32, user_id=86590cc2b82448259f60de3d85d3677b, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:14.896537 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1653c0-fb36-4f8a-98d5-a56c8981d1d5 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:14.930785 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-404bcc61-e08d-4741-aa27-9ac43fd1f9a2 None None] MFA Rules not processed for user `e22348b155264c26a9a445c7e949d88c`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:14.932035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-404bcc61-e08d-4741-aa27-9ac43fd1f9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:15.004509 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 887/1754] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:38:14 2022] PUT /identity/v3/projects/64ee0694e58e493488db4c40273a1b32/users/86590cc2b82448259f60de3d85d3677b/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:15.005408 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1653c0-fb36-4f8a-98d5-a56c8981d1d5 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:15.014155 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-cc1653c0-fb36-4f8a-98d5-a56c8981d1d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:15.131300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 868/1755] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:15.133224 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bcc61-e08d-4741-aa27-9ac43fd1f9a2 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:15.137838 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-404bcc61-e08d-4741-aa27-9ac43fd1f9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:15.172097 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bcc61-e08d-4741-aa27-9ac43fd1f9a2 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:15.176464 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:15.203083 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1653c0-fb36-4f8a-98d5-a56c8981d1d5 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:15.210091 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa0e77-0cf3-47bb-a1ed-1db12d9ad350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:15.210980 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa0e77-0cf3-47bb-a1ed-1db12d9ad350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:15.211891 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa0e77-0cf3-47bb-a1ed-1db12d9ad350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:15.212316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa0e77-0cf3-47bb-a1ed-1db12d9ad350 admin admin] PATH_INFO: `/v3/users/14b9afd5cc0348f2ad54bd2bfbd93879` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:15.213646 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa0e77-0cf3-47bb-a1ed-1db12d9ad350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14b9afd5cc0348f2ad54bd2bfbd93879)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:15.215822 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa0e77-0cf3-47bb-a1ed-1db12d9ad350 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:15.276394 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b01298-b139-4736-acf6-114191b0ba17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:15.277308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b01298-b139-4736-acf6-114191b0ba17 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:15.277656 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b01298-b139-4736-acf6-114191b0ba17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:15.282869 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b01298-b139-4736-acf6-114191b0ba17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:15.287300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b01298-b139-4736-acf6-114191b0ba17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:15.288966 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b01298-b139-4736-acf6-114191b0ba17 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:15.297996 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 869/1756] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:38:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:38:15.298893 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b01298-b139-4736-acf6-114191b0ba17 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:15.312923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b01298-b139-4736-acf6-114191b0ba17 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:15.319109 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fa01c-98bf-43aa-8ced-7d0c816ff8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:15.319716 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fa01c-98bf-43aa-8ced-7d0c816ff8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:15.319992 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fa01c-98bf-43aa-8ced-7d0c816ff8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:15.320263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fa01c-98bf-43aa-8ced-7d0c816ff8d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:15.320927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2fa01c-98bf-43aa-8ced-7d0c816ff8d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:15.322639 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2fa01c-98bf-43aa-8ced-7d0c816ff8d1 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:15.339812 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 870/1757] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:38:15.341060 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039be5ac-92db-4ded-ba72-9112087ff6eb None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:15.341419 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039be5ac-92db-4ded-ba72-9112087ff6eb None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:15.341606 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039be5ac-92db-4ded-ba72-9112087ff6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:15.393498 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-039be5ac-92db-4ded-ba72-9112087ff6eb None None] MFA Rules not processed for user `86590cc2b82448259f60de3d85d3677b`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:15.395158 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-039be5ac-92db-4ded-ba72-9112087ff6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:15.484998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-11fa0e77-0cf3-47bb-a1ed-1db12d9ad350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14b9afd5cc0348f2ad54bd2bfbd93879'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:15.487563 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-11fa0e77-0cf3-47bb-a1ed-1db12d9ad350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14b9afd5cc0348f2ad54bd2bfbd93879'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:15.490002 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-11fa0e77-0cf3-47bb-a1ed-1db12d9ad350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14b9afd5cc0348f2ad54bd2bfbd93879'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:15.512760 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-11fa0e77-0cf3-47bb-a1ed-1db12d9ad350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14b9afd5cc0348f2ad54bd2bfbd93879'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:15.525650 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 871/1758] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:15.533292 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94c569-6e5e-40d1-85f8-32c3afb779a4 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:15.533644 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94c569-6e5e-40d1-85f8-32c3afb779a4 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:15.533889 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94c569-6e5e-40d1-85f8-32c3afb779a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:15.553215 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:15.588983 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-6e94c569-6e5e-40d1-85f8-32c3afb779a4 None None] MFA Rules not processed for user `3acc0010e3f54283934b75f58bb6ec93`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:15.590170 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6e94c569-6e5e-40d1-85f8-32c3afb779a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:15.596920 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-11fa0e77-0cf3-47bb-a1ed-1db12d9ad350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14b9afd5cc0348f2ad54bd2bfbd93879'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:15.645316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 888/1759] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:38:15 2022] DELETE /identity/v3/users/14b9afd5cc0348f2ad54bd2bfbd93879 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:15.651557 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa0e77-0cf3-47bb-a1ed-1db12d9ad350 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:15.659246 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-11fa0e77-0cf3-47bb-a1ed-1db12d9ad350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:15.759793 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 872/1760] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:15.764150 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94c569-6e5e-40d1-85f8-32c3afb779a4 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:15.766667 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6e94c569-6e5e-40d1-85f8-32c3afb779a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:15.862511 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa0e77-0cf3-47bb-a1ed-1db12d9ad350 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:15.874432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6dd0b-9573-47ad-990f-5eee5c37a917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:15.875121 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6dd0b-9573-47ad-990f-5eee5c37a917 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:15.875393 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6dd0b-9573-47ad-990f-5eee5c37a917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:15.875662 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6dd0b-9573-47ad-990f-5eee5c37a917 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:15.876306 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6dd0b-9573-47ad-990f-5eee5c37a917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:15.881716 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6dd0b-9573-47ad-990f-5eee5c37a917 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:15.923101 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94c569-6e5e-40d1-85f8-32c3afb779a4 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:16.006468 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e42b5c-8a8a-4041-bc82-84de77de840c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b3c32ecfdcf40629f09a7f52b2b5fa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:16.007628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e42b5c-8a8a-4041-bc82-84de77de840c service swift] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:16.008056 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e42b5c-8a8a-4041-bc82-84de77de840c service swift] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:16.008413 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e42b5c-8a8a-4041-bc82-84de77de840c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:16.011775 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d9e42b5c-8a8a-4041-bc82-84de77de840c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:16.100966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 889/1761] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:38:15 2022] POST /identity/v3/projects => generated 357 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:38:16.115736 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6dd0b-9573-47ad-990f-5eee5c37a917 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:16.126822 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-80c6dd0b-9573-47ad-990f-5eee5c37a917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:16.143476 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e42b5c-8a8a-4041-bc82-84de77de840c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:16.148934 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e42b5c-8a8a-4041-bc82-84de77de840c service swift] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:16.177079 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 873/1762] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 14:38:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 14:38:16.178195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e42b5c-8a8a-4041-bc82-84de77de840c service swift] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:16.182464 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d9e42b5c-8a8a-4041-bc82-84de77de840c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:16.357595 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6dd0b-9573-47ad-990f-5eee5c37a917 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:16.396753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f02d7-cda1-486a-a25b-e10405474c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:16.397604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f02d7-cda1-486a-a25b-e10405474c46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:16.398043 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f02d7-cda1-486a-a25b-e10405474c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:16.405179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f02d7-cda1-486a-a25b-e10405474c46 admin admin] PATH_INFO: `/v3/projects/d1377b589e53413b8c09435dac43eaa0/users/094e9a34aa824cd2872f20b7c64369b1/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:16.515750 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f02d7-cda1-486a-a25b-e10405474c46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1377b589e53413b8c09435dac43eaa0, user_id=094e9a34aa824cd2872f20b7c64369b1, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:16.521547 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f02d7-cda1-486a-a25b-e10405474c46 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:16.534393 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e42b5c-8a8a-4041-bc82-84de77de840c service swift] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:16.754940 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9b777-da6a-4d6b-bf7b-e2e65735a93d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:16.755449 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9b777-da6a-4d6b-bf7b-e2e65735a93d service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:16.755730 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9b777-da6a-4d6b-bf7b-e2e65735a93d service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:16.756024 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9b777-da6a-4d6b-bf7b-e2e65735a93d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:16.825281 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 890/1763] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:38:16 2022] PUT /identity/v3/projects/d1377b589e53413b8c09435dac43eaa0/users/094e9a34aa824cd2872f20b7c64369b1/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:16.838291 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd080ecb-2857-4462-af0f-8beb539e9629 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:16.838291 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd080ecb-2857-4462-af0f-8beb539e9629 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:16.838291 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd080ecb-2857-4462-af0f-8beb539e9629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:16.917869 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-fd080ecb-2857-4462-af0f-8beb539e9629 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:16.922574 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fd080ecb-2857-4462-af0f-8beb539e9629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:16.959937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9b777-da6a-4d6b-bf7b-e2e65735a93d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:16.962006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9b777-da6a-4d6b-bf7b-e2e65735a93d service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:17.007140 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 874/1764] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:38:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 808 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:38:17.007140 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9b777-da6a-4d6b-bf7b-e2e65735a93d service nova] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:17.043885 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9b777-da6a-4d6b-bf7b-e2e65735a93d service nova] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:17.074338 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 891/1765] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:17.081939 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c80a9-8682-4be5-8e3a-6d23489db4e5 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:17.083570 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c80a9-8682-4be5-8e3a-6d23489db4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:17.084108 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c80a9-8682-4be5-8e3a-6d23489db4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:17.113189 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-142c80a9-8682-4be5-8e3a-6d23489db4e5 None None] MFA Rules not processed for user `cb5021b569db41a08218cbec928442af`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:17.115396 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-142c80a9-8682-4be5-8e3a-6d23489db4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:17.197257 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:17.267216 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 892/1766] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Aug 24 14:38:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:17.268676 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73212eb0-9c03-4a82-b5d0-cfc46fb180a3 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:17.269017 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73212eb0-9c03-4a82-b5d0-cfc46fb180a3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:17.269435 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73212eb0-9c03-4a82-b5d0-cfc46fb180a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:17.309421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda73606-a6e7-41dd-bf16-c3a0d44a94e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:17.311072 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda73606-a6e7-41dd-bf16-c3a0d44a94e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:17.311616 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda73606-a6e7-41dd-bf16-c3a0d44a94e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:17.312093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda73606-a6e7-41dd-bf16-c3a0d44a94e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:17.312880 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda73606-a6e7-41dd-bf16-c3a0d44a94e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:17.315357 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda73606-a6e7-41dd-bf16-c3a0d44a94e2 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:17.339737 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-73212eb0-9c03-4a82-b5d0-cfc46fb180a3 None None] MFA Rules not processed for user `094e9a34aa824cd2872f20b7c64369b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:17.341352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-73212eb0-9c03-4a82-b5d0-cfc46fb180a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:17.465216 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 875/1767] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:38:16 2022] POST /identity/v3/users => generated 285 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:38:17.467696 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda73606-a6e7-41dd-bf16-c3a0d44a94e2 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:17.472362 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-eda73606-a6e7-41dd-bf16-c3a0d44a94e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:17.516443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda73606-a6e7-41dd-bf16-c3a0d44a94e2 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:17.528408 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 893/1768] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:17.529456 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73212eb0-9c03-4a82-b5d0-cfc46fb180a3 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:17.541593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496a070-5bcb-4aba-9f8d-fca3458fa20b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:17.541593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496a070-5bcb-4aba-9f8d-fca3458fa20b service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:17.541810 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496a070-5bcb-4aba-9f8d-fca3458fa20b service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:17.545607 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496a070-5bcb-4aba-9f8d-fca3458fa20b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:17.575381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73212eb0-9c03-4a82-b5d0-cfc46fb180a3 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:17.592361 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a99cd2-245b-452b-94be-067f4f938da9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:17.592999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a99cd2-245b-452b-94be-067f4f938da9 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:17.593284 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a99cd2-245b-452b-94be-067f4f938da9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:17.593560 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a99cd2-245b-452b-94be-067f4f938da9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:17.594625 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:17.596255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496a070-5bcb-4aba-9f8d-fca3458fa20b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:17.598647 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496a070-5bcb-4aba-9f8d-fca3458fa20b service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:17.608342 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a99cd2-245b-452b-94be-067f4f938da9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:17.611740 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a99cd2-245b-452b-94be-067f4f938da9 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:17.628336 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 876/1770] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:38:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:38:17.631785 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 894/1770] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:38:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:38:17.631911 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496a070-5bcb-4aba-9f8d-fca3458fa20b service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:17.632673 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a99cd2-245b-452b-94be-067f4f938da9 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:17.634647 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d8a99cd2-245b-452b-94be-067f4f938da9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:17.681399 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496a070-5bcb-4aba-9f8d-fca3458fa20b service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:17.696549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3104e1-ce72-4206-b175-6d7ecbf7adf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:17.697571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3104e1-ce72-4206-b175-6d7ecbf7adf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:17.697571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3104e1-ce72-4206-b175-6d7ecbf7adf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:17.698055 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3104e1-ce72-4206-b175-6d7ecbf7adf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:17.698456 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3104e1-ce72-4206-b175-6d7ecbf7adf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:17.702362 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3104e1-ce72-4206-b175-6d7ecbf7adf4 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:17.748101 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 877/1771] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:38:17.749254 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3104e1-ce72-4206-b175-6d7ecbf7adf4 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:17.779617 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3104e1-ce72-4206-b175-6d7ecbf7adf4 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:17.807631 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e44996-533f-4ed1-aee4-101e83308fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:17.812760 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e44996-533f-4ed1-aee4-101e83308fae admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:17.815472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e44996-533f-4ed1-aee4-101e83308fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:17.820394 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e44996-533f-4ed1-aee4-101e83308fae admin admin] PATH_INFO: `/v3/projects/39df97f13e6d41cdb732d35b2b12cedb/users/07024492414f4f61b9daa919d29ad900/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:17.858554 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e44996-533f-4ed1-aee4-101e83308fae admin admin] RBAC: Authorizing `identity:create_grant(project_id=39df97f13e6d41cdb732d35b2b12cedb, user_id=07024492414f4f61b9daa919d29ad900, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:17.870102 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e44996-533f-4ed1-aee4-101e83308fae admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:17.904047 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a99cd2-245b-452b-94be-067f4f938da9 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:17.916247 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988d81b-558c-4958-b476-86abbb15fbb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:17.916838 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988d81b-558c-4958-b476-86abbb15fbb2 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:17.917231 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988d81b-558c-4958-b476-86abbb15fbb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:17.917604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988d81b-558c-4958-b476-86abbb15fbb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:17.928404 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988d81b-558c-4958-b476-86abbb15fbb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:17.930115 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988d81b-558c-4958-b476-86abbb15fbb2 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:17.981115 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 878/1772] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:38:17 2022] PUT /identity/v3/projects/39df97f13e6d41cdb732d35b2b12cedb/users/07024492414f4f61b9daa919d29ad900/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:17.988987 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 895/1773] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:38:17 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:38:18.003862 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e44996-533f-4ed1-aee4-101e83308fae admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:18.004438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988d81b-558c-4958-b476-86abbb15fbb2 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:18.030775 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988d81b-558c-4958-b476-86abbb15fbb2 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:18.166622 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e44996-533f-4ed1-aee4-101e83308fae admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:18.172189 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fc2fe-e2f4-4640-af64-7995223df9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:18.172920 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fc2fe-e2f4-4640-af64-7995223df9a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:18.173207 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fc2fe-e2f4-4640-af64-7995223df9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:18.173533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fc2fe-e2f4-4640-af64-7995223df9a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:18.174186 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fc2fe-e2f4-4640-af64-7995223df9a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:18.176529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fc2fe-e2f4-4640-af64-7995223df9a3 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:18.213953 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 879/1774] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:38:18.215105 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fc2fe-e2f4-4640-af64-7995223df9a3 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:18.243458 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fc2fe-e2f4-4640-af64-7995223df9a3 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:18.254432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6196c-af8d-4572-9a07-b082fa5a0f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:18.261272 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63083f8d-0987-4f66-949d-81ba7c2244ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:18.262016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63083f8d-0987-4f66-949d-81ba7c2244ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:18.262360 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63083f8d-0987-4f66-949d-81ba7c2244ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:18.262692 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63083f8d-0987-4f66-949d-81ba7c2244ec admin admin] PATH_INFO: `/v3/projects/39df97f13e6d41cdb732d35b2b12cedb/users/07024492414f4f61b9daa919d29ad900/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:18.265401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63083f8d-0987-4f66-949d-81ba7c2244ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=39df97f13e6d41cdb732d35b2b12cedb, user_id=07024492414f4f61b9daa919d29ad900, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:18.268705 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63083f8d-0987-4f66-949d-81ba7c2244ec admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:18.275602 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6196c-af8d-4572-9a07-b082fa5a0f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:18.276503 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6196c-af8d-4572-9a07-b082fa5a0f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:18.276767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6196c-af8d-4572-9a07-b082fa5a0f92 admin admin] PATH_INFO: `/v3/users/094e9a34aa824cd2872f20b7c64369b1` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:18.279205 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:18.280667 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6196c-af8d-4572-9a07-b082fa5a0f92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=094e9a34aa824cd2872f20b7c64369b1)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:18.283187 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6196c-af8d-4572-9a07-b082fa5a0f92 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:18.291254 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 880/1775] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:38:18 2022] PUT /identity/v3/projects/39df97f13e6d41cdb732d35b2b12cedb/users/07024492414f4f61b9daa919d29ad900/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:18.308772 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f2517-7c6a-4a10-a7d2-c6724f261ac0 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:18.309096 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f2517-7c6a-4a10-a7d2-c6724f261ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:18.309377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f2517-7c6a-4a10-a7d2-c6724f261ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:18.380607 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-fc9f2517-7c6a-4a10-a7d2-c6724f261ac0 None None] MFA Rules not processed for user `07024492414f4f61b9daa919d29ad900`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:18.387480 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-fc9f2517-7c6a-4a10-a7d2-c6724f261ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:18.632682 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b2f6196c-af8d-4572-9a07-b082fa5a0f92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '094e9a34aa824cd2872f20b7c64369b1'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:18.636145 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b2f6196c-af8d-4572-9a07-b082fa5a0f92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '094e9a34aa824cd2872f20b7c64369b1'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:18.637398 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b2f6196c-af8d-4572-9a07-b082fa5a0f92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '094e9a34aa824cd2872f20b7c64369b1'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:18.683406 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 881/1776] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:18 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:38:18.698568 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b2f6196c-af8d-4572-9a07-b082fa5a0f92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '094e9a34aa824cd2872f20b7c64369b1'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:18.699896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f2517-7c6a-4a10-a7d2-c6724f261ac0 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:18.826920 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b2f6196c-af8d-4572-9a07-b082fa5a0f92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '094e9a34aa824cd2872f20b7c64369b1'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:18.844084 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 896/1777] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:38:18 2022] DELETE /identity/v3/users/094e9a34aa824cd2872f20b7c64369b1 => generated 0 bytes in 840 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:38:18.848557 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155bb10-73cf-4b6a-91d9-aa80506e0f3e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:18.848916 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155bb10-73cf-4b6a-91d9-aa80506e0f3e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:18.849261 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155bb10-73cf-4b6a-91d9-aa80506e0f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:18.917951 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f155bb10-73cf-4b6a-91d9-aa80506e0f3e None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:18.922225 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f155bb10-73cf-4b6a-91d9-aa80506e0f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:19.009246 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f2517-7c6a-4a10-a7d2-c6724f261ac0 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:19.049323 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:19.157975 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 897/1778] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:38:19.163671 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52667e24-7e8a-471e-8aeb-d50e4274d7d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:19.175051 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52667e24-7e8a-471e-8aeb-d50e4274d7d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:19.175051 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52667e24-7e8a-471e-8aeb-d50e4274d7d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:19.175051 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52667e24-7e8a-471e-8aeb-d50e4274d7d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:19.175051 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-52667e24-7e8a-471e-8aeb-d50e4274d7d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:19.177387 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155bb10-73cf-4b6a-91d9-aa80506e0f3e None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:19.177387 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f155bb10-73cf-4b6a-91d9-aa80506e0f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:19.219376 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155bb10-73cf-4b6a-91d9-aa80506e0f3e None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:19.242463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25881b81-1fde-4421-991c-4f4f72547541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:19.252383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25881b81-1fde-4421-991c-4f4f72547541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:19.252383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25881b81-1fde-4421-991c-4f4f72547541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:19.252383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25881b81-1fde-4421-991c-4f4f72547541 admin admin] PATH_INFO: `/v3/users/86590cc2b82448259f60de3d85d3677b` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:19.252383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25881b81-1fde-4421-991c-4f4f72547541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86590cc2b82448259f60de3d85d3677b)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:19.252383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25881b81-1fde-4421-991c-4f4f72547541 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:19.323124 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52667e24-7e8a-471e-8aeb-d50e4274d7d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:19.324603 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52667e24-7e8a-471e-8aeb-d50e4274d7d9 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:19.343353 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 882/1779] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:38:18 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:38:19.344663 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83431c-8ef6-4d16-9990-bd865edb57b0 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:19.344944 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83431c-8ef6-4d16-9990-bd865edb57b0 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:19.345210 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83431c-8ef6-4d16-9990-bd865edb57b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:19.392207 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-6d83431c-8ef6-4d16-9990-bd865edb57b0 None None] MFA Rules not processed for user `556b3a886df740cda4a94e55d2fcc08a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:19.394008 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6d83431c-8ef6-4d16-9990-bd865edb57b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:19.448897 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:19.569118 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-25881b81-1fde-4421-991c-4f4f72547541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86590cc2b82448259f60de3d85d3677b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:19.570326 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-25881b81-1fde-4421-991c-4f4f72547541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86590cc2b82448259f60de3d85d3677b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:19.571270 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-25881b81-1fde-4421-991c-4f4f72547541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86590cc2b82448259f60de3d85d3677b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:19.590966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-25881b81-1fde-4421-991c-4f4f72547541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86590cc2b82448259f60de3d85d3677b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:19.602965 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 883/1780] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:19.610881 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83431c-8ef6-4d16-9990-bd865edb57b0 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:19.615654 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6d83431c-8ef6-4d16-9990-bd865edb57b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:19.714920 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-25881b81-1fde-4421-991c-4f4f72547541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86590cc2b82448259f60de3d85d3677b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:19.743981 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 898/1781] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:38:19 2022] DELETE /identity/v3/users/86590cc2b82448259f60de3d85d3677b => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:19.752887 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25881b81-1fde-4421-991c-4f4f72547541 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:19.752887 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-25881b81-1fde-4421-991c-4f4f72547541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:19.815896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83431c-8ef6-4d16-9990-bd865edb57b0 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:20.001384 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac01c4a-deb5-4611-87a0-a8832f856709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:20.004817 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac01c4a-deb5-4611-87a0-a8832f856709 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:20.005172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac01c4a-deb5-4611-87a0-a8832f856709 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:20.005512 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac01c4a-deb5-4611-87a0-a8832f856709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:20.009555 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-bac01c4a-deb5-4611-87a0-a8832f856709 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:20.100930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25881b81-1fde-4421-991c-4f4f72547541 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:20.120879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62681f1-8b23-4775-9a65-096fdc3c17c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:20.123420 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62681f1-8b23-4775-9a65-096fdc3c17c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:20.123420 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62681f1-8b23-4775-9a65-096fdc3c17c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:20.123420 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62681f1-8b23-4775-9a65-096fdc3c17c0 admin admin] PATH_INFO: `/v3/projects/3870a4cd51d54d6893a321a56bd29684` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:20.127789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62681f1-8b23-4775-9a65-096fdc3c17c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3870a4cd51d54d6893a321a56bd29684)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:20.150819 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62681f1-8b23-4775-9a65-096fdc3c17c0 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:20.163139 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:20.224648 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac01c4a-deb5-4611-87a0-a8832f856709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:20.226148 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac01c4a-deb5-4611-87a0-a8832f856709 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:20.248084 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 884/1782] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:38:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:38:20.249481 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695e619-199e-4d5e-8f1c-1206f33e34e9 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:20.249785 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695e619-199e-4d5e-8f1c-1206f33e34e9 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:20.250071 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695e619-199e-4d5e-8f1c-1206f33e34e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:20.300259 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-4695e619-199e-4d5e-8f1c-1206f33e34e9 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:20.302928 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4695e619-199e-4d5e-8f1c-1206f33e34e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:20.345505 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 885/1783] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:20.348915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695e619-199e-4d5e-8f1c-1206f33e34e9 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:20.355457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4695e619-199e-4d5e-8f1c-1206f33e34e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:20.363998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f62681f1-8b23-4775-9a65-096fdc3c17c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3870a4cd51d54d6893a321a56bd29684', 'request_id': 'req-f62681f1-8b23-4775-9a65-096fdc3c17c0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:20.439457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f62681f1-8b23-4775-9a65-096fdc3c17c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3870a4cd51d54d6893a321a56bd29684', 'request_id': 'req-f62681f1-8b23-4775-9a65-096fdc3c17c0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:20.454416 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f62681f1-8b23-4775-9a65-096fdc3c17c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3870a4cd51d54d6893a321a56bd29684', 'request_id': 'req-f62681f1-8b23-4775-9a65-096fdc3c17c0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:20.489470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f62681f1-8b23-4775-9a65-096fdc3c17c0 admin admin] The token cache is being invalidate because project 3870a4cd51d54d6893a321a56bd29684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:38:20.489775 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f62681f1-8b23-4775-9a65-096fdc3c17c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:20.492863 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f62681f1-8b23-4775-9a65-096fdc3c17c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:20.496227 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 899/1784] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:38:19 2022] DELETE /identity/v3/projects/3870a4cd51d54d6893a321a56bd29684 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:20.502013 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62681f1-8b23-4775-9a65-096fdc3c17c0 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:20.502013 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f62681f1-8b23-4775-9a65-096fdc3c17c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:20.533454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695e619-199e-4d5e-8f1c-1206f33e34e9 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:20.642899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62681f1-8b23-4775-9a65-096fdc3c17c0 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:20.677105 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ebb98-1a62-429b-8103-524bbd6b2637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:20.677916 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ebb98-1a62-429b-8103-524bbd6b2637 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:20.678991 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ebb98-1a62-429b-8103-524bbd6b2637 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:20.679370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ebb98-1a62-429b-8103-524bbd6b2637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:20.688531 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-753ebb98-1a62-429b-8103-524bbd6b2637 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:20.692149 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711240ad-17dc-437e-9f1a-b89fbfd9516e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:20.693444 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711240ad-17dc-437e-9f1a-b89fbfd9516e service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:20.694370 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711240ad-17dc-437e-9f1a-b89fbfd9516e service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:20.695446 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711240ad-17dc-437e-9f1a-b89fbfd9516e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:20.699653 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-711240ad-17dc-437e-9f1a-b89fbfd9516e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:20.907602 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:20.940159 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711240ad-17dc-437e-9f1a-b89fbfd9516e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:20.942538 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ebb98-1a62-429b-8103-524bbd6b2637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:20.945781 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ebb98-1a62-429b-8103-524bbd6b2637 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:20.945964 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711240ad-17dc-437e-9f1a-b89fbfd9516e service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:20.975534 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 886/1785] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:38:20 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:38:20.975859 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711240ad-17dc-437e-9f1a-b89fbfd9516e service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:20.982830 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-711240ad-17dc-437e-9f1a-b89fbfd9516e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:21.010621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 900/1786] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:38:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:38:21.012488 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22acd1f-ba6a-4e6e-be6c-ee6360ce463d None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:21.019015 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711240ad-17dc-437e-9f1a-b89fbfd9516e service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:21.027929 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22acd1f-ba6a-4e6e-be6c-ee6360ce463d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:21.028540 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22acd1f-ba6a-4e6e-be6c-ee6360ce463d None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:21.032500 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 901/1787] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 14:38:21 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:38:21.036055 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833a424-a5fa-4e6a-9eb4-0723a151542c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:21.036704 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833a424-a5fa-4e6a-9eb4-0723a151542c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:21.037053 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833a424-a5fa-4e6a-9eb4-0723a151542c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:21.037252 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833a424-a5fa-4e6a-9eb4-0723a151542c admin admin] PATH_INFO: `/v3/users/f3bfa6d2d12d44ff8a295a892a68fd83` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:21.039398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833a424-a5fa-4e6a-9eb4-0723a151542c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3bfa6d2d12d44ff8a295a892a68fd83)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:21.041389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833a424-a5fa-4e6a-9eb4-0723a151542c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:21.085569 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:21.107393 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef97e8-a2e9-478e-ae48-5beba1ee7409 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:21.107895 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef97e8-a2e9-478e-ae48-5beba1ee7409 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:21.108340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef97e8-a2e9-478e-ae48-5beba1ee7409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:21.163340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-52ef97e8-a2e9-478e-ae48-5beba1ee7409 None None] MFA Rules not processed for user `8d099678d6454f7eb494892a69feaf62`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:21.177905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-52ef97e8-a2e9-478e-ae48-5beba1ee7409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:21.304899 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e833a424-a5fa-4e6a-9eb4-0723a151542c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3bfa6d2d12d44ff8a295a892a68fd83'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:21.304899 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e833a424-a5fa-4e6a-9eb4-0723a151542c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3bfa6d2d12d44ff8a295a892a68fd83'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:21.322150 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e833a424-a5fa-4e6a-9eb4-0723a151542c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3bfa6d2d12d44ff8a295a892a68fd83'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:21.323661 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e833a424-a5fa-4e6a-9eb4-0723a151542c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3bfa6d2d12d44ff8a295a892a68fd83'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:21.371002 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 902/1788] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 14:38:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:21.435467 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e833a424-a5fa-4e6a-9eb4-0723a151542c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3bfa6d2d12d44ff8a295a892a68fd83'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:21.467611 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:21.480142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 887/1789] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:38:20 2022] DELETE /identity/v3/users/f3bfa6d2d12d44ff8a295a892a68fd83 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:21.688076 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:21.732195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:21.876807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:22.015676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:22.500177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef97e8-a2e9-478e-ae48-5beba1ee7409 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:22.501813 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-52ef97e8-a2e9-478e-ae48-5beba1ee7409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:22.529055 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef97e8-a2e9-478e-ae48-5beba1ee7409 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:22.623129 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c21a4-53d2-4ba2-a786-337d604ee145 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:22.624020 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c21a4-53d2-4ba2-a786-337d604ee145 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:22.624420 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c21a4-53d2-4ba2-a786-337d604ee145 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:22.624943 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c21a4-53d2-4ba2-a786-337d604ee145 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:22.637523 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c21a4-53d2-4ba2-a786-337d604ee145 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:22.639268 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c21a4-53d2-4ba2-a786-337d604ee145 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:22.655111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 903/1790] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:38:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:38:22.844683 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833a424-a5fa-4e6a-9eb4-0723a151542c admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:22.846654 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e833a424-a5fa-4e6a-9eb4-0723a151542c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:22.890948 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c21a4-53d2-4ba2-a786-337d604ee145 service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:22.890948 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b35c21a4-53d2-4ba2-a786-337d604ee145 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:23.111117 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833a424-a5fa-4e6a-9eb4-0723a151542c admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:23.123273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c21a4-53d2-4ba2-a786-337d604ee145 service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:23.125527 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32feeba7-3114-4fc6-bf5d-510285989008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:23.126307 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32feeba7-3114-4fc6-bf5d-510285989008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:23.129345 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32feeba7-3114-4fc6-bf5d-510285989008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:23.129345 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32feeba7-3114-4fc6-bf5d-510285989008 admin admin] PATH_INFO: `/v3/projects/64ee0694e58e493488db4c40273a1b32` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:23.129345 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32feeba7-3114-4fc6-bf5d-510285989008 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64ee0694e58e493488db4c40273a1b32)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:23.131600 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32feeba7-3114-4fc6-bf5d-510285989008 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:23.139745 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b5a15-75f8-4ebf-beb8-949651e038db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:23.140482 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b5a15-75f8-4ebf-beb8-949651e038db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:23.140888 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b5a15-75f8-4ebf-beb8-949651e038db admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:23.141111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b5a15-75f8-4ebf-beb8-949651e038db admin admin] PATH_INFO: `/v3/projects/db5d27a3ae6f4a8eb0bd5eac7bf4c360` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:23.142993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b5a15-75f8-4ebf-beb8-949651e038db admin admin] RBAC: Authorizing `identity:delete_project(project_id=db5d27a3ae6f4a8eb0bd5eac7bf4c360)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:23.148682 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b5a15-75f8-4ebf-beb8-949651e038db admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:23.403287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-32feeba7-3114-4fc6-bf5d-510285989008 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64ee0694e58e493488db4c40273a1b32', 'request_id': 'req-32feeba7-3114-4fc6-bf5d-510285989008'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:23.409107 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d53b5a15-75f8-4ebf-beb8-949651e038db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db5d27a3ae6f4a8eb0bd5eac7bf4c360', 'request_id': 'req-d53b5a15-75f8-4ebf-beb8-949651e038db'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:23.470942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:23.507584 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d53b5a15-75f8-4ebf-beb8-949651e038db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db5d27a3ae6f4a8eb0bd5eac7bf4c360', 'request_id': 'req-d53b5a15-75f8-4ebf-beb8-949651e038db'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:23.540760 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d53b5a15-75f8-4ebf-beb8-949651e038db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db5d27a3ae6f4a8eb0bd5eac7bf4c360', 'request_id': 'req-d53b5a15-75f8-4ebf-beb8-949651e038db'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:23.583914 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d53b5a15-75f8-4ebf-beb8-949651e038db admin admin] The token cache is being invalidate because project db5d27a3ae6f4a8eb0bd5eac7bf4c360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:38:23.584206 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d53b5a15-75f8-4ebf-beb8-949651e038db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:23.585677 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d53b5a15-75f8-4ebf-beb8-949651e038db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:23.589308 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:23.593022 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 904/1791] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:38:22 2022] DELETE /identity/v3/projects/db5d27a3ae6f4a8eb0bd5eac7bf4c360 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:23.593905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b5a15-75f8-4ebf-beb8-949651e038db admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:23.598582 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d53b5a15-75f8-4ebf-beb8-949651e038db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:23.621888 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-32feeba7-3114-4fc6-bf5d-510285989008 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64ee0694e58e493488db4c40273a1b32', 'request_id': 'req-32feeba7-3114-4fc6-bf5d-510285989008'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:23.661859 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-32feeba7-3114-4fc6-bf5d-510285989008 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64ee0694e58e493488db4c40273a1b32', 'request_id': 'req-32feeba7-3114-4fc6-bf5d-510285989008'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:23.687454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-32feeba7-3114-4fc6-bf5d-510285989008 admin admin] The token cache is being invalidate because project 64ee0694e58e493488db4c40273a1b32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:38:23.687454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-32feeba7-3114-4fc6-bf5d-510285989008 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:23.688487 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-32feeba7-3114-4fc6-bf5d-510285989008 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:23.695819 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 888/1792] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:38:22 2022] DELETE /identity/v3/projects/64ee0694e58e493488db4c40273a1b32 => generated 0 bytes in 847 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:23.697092 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32feeba7-3114-4fc6-bf5d-510285989008 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:23.699709 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-32feeba7-3114-4fc6-bf5d-510285989008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:23.775608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b5a15-75f8-4ebf-beb8-949651e038db admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:23.814830 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32feeba7-3114-4fc6-bf5d-510285989008 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:23.815845 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4217e1-ffad-43c8-9dca-24a1bf15b6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:23.817344 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4217e1-ffad-43c8-9dca-24a1bf15b6a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:23.817940 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4217e1-ffad-43c8-9dca-24a1bf15b6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:23.818221 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4217e1-ffad-43c8-9dca-24a1bf15b6a8 admin admin] PATH_INFO: `/v3/projects/d1377b589e53413b8c09435dac43eaa0` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:23.823536 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4217e1-ffad-43c8-9dca-24a1bf15b6a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1377b589e53413b8c09435dac43eaa0)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:23.827866 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4217e1-ffad-43c8-9dca-24a1bf15b6a8 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:23.830662 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecc7a3-d01d-4545-9178-e7913ec18146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:23.831667 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecc7a3-d01d-4545-9178-e7913ec18146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:23.832644 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecc7a3-d01d-4545-9178-e7913ec18146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:23.833079 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecc7a3-d01d-4545-9178-e7913ec18146 admin admin] PATH_INFO: `/v3/users/7c72299ec72f4ece80cc2f5bbf2929c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:23.836049 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcecc7a3-d01d-4545-9178-e7913ec18146 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c72299ec72f4ece80cc2f5bbf2929c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:23.839487 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcecc7a3-d01d-4545-9178-e7913ec18146 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:23.989954 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5e4217e1-ffad-43c8-9dca-24a1bf15b6a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1377b589e53413b8c09435dac43eaa0', 'request_id': 'req-5e4217e1-ffad-43c8-9dca-24a1bf15b6a8'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:24.086311 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dcecc7a3-d01d-4545-9178-e7913ec18146 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c72299ec72f4ece80cc2f5bbf2929c8'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:24.088176 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dcecc7a3-d01d-4545-9178-e7913ec18146 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c72299ec72f4ece80cc2f5bbf2929c8'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:24.126099 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5e4217e1-ffad-43c8-9dca-24a1bf15b6a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1377b589e53413b8c09435dac43eaa0', 'request_id': 'req-5e4217e1-ffad-43c8-9dca-24a1bf15b6a8'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:24.134826 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5e4217e1-ffad-43c8-9dca-24a1bf15b6a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1377b589e53413b8c09435dac43eaa0', 'request_id': 'req-5e4217e1-ffad-43c8-9dca-24a1bf15b6a8'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:24.141910 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dcecc7a3-d01d-4545-9178-e7913ec18146 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c72299ec72f4ece80cc2f5bbf2929c8'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:24.147029 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dcecc7a3-d01d-4545-9178-e7913ec18146 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c72299ec72f4ece80cc2f5bbf2929c8'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:24.163276 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5e4217e1-ffad-43c8-9dca-24a1bf15b6a8 admin admin] The token cache is being invalidate because project d1377b589e53413b8c09435dac43eaa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:38:24.163571 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5e4217e1-ffad-43c8-9dca-24a1bf15b6a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:24.164369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5e4217e1-ffad-43c8-9dca-24a1bf15b6a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:24.169446 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 905/1793] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:38:23 2022] DELETE /identity/v3/projects/d1377b589e53413b8c09435dac43eaa0 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:24.171060 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad22e90-d3db-4377-b261-dad64bbf061e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:24.171353 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad22e90-d3db-4377-b261-dad64bbf061e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:24.171652 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad22e90-d3db-4377-b261-dad64bbf061e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:24.240832 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-bad22e90-d3db-4377-b261-dad64bbf061e None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:24.242120 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-bad22e90-d3db-4377-b261-dad64bbf061e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:24.306773 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dcecc7a3-d01d-4545-9178-e7913ec18146 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c72299ec72f4ece80cc2f5bbf2929c8'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:24.343463 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 889/1794] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:38:23 2022] DELETE /identity/v3/users/7c72299ec72f4ece80cc2f5bbf2929c8 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:24.346293 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5a463-2df0-493e-96b2-4a908fe01875 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:24.346591 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5a463-2df0-493e-96b2-4a908fe01875 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:24.346875 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5a463-2df0-493e-96b2-4a908fe01875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:24.429058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-f5f5a463-2df0-493e-96b2-4a908fe01875 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:24.431056 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f5f5a463-2df0-493e-96b2-4a908fe01875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:24.441819 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 906/1795] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:24.448470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73328db-08d5-42c3-b476-8cf7c50599f7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:24.449180 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73328db-08d5-42c3-b476-8cf7c50599f7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:24.449460 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73328db-08d5-42c3-b476-8cf7c50599f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:24.487327 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a73328db-08d5-42c3-b476-8cf7c50599f7 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:24.490432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a73328db-08d5-42c3-b476-8cf7c50599f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:24.521674 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:24.675714 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 890/1796] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:24.687238 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e9080-939e-4299-9986-9146e90197eb None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:24.687484 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e9080-939e-4299-9986-9146e90197eb None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:24.687785 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e9080-939e-4299-9986-9146e90197eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:24.768805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 907/1797] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:38:24.775367 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73328db-08d5-42c3-b476-8cf7c50599f7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:24.797257 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73328db-08d5-42c3-b476-8cf7c50599f7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:24.797472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-065e9080-939e-4299-9986-9146e90197eb None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:24.803051 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-065e9080-939e-4299-9986-9146e90197eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:24.836983 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 891/1798] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:24.840318 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e9080-939e-4299-9986-9146e90197eb None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:24.851482 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a85f7-8210-4171-ad9a-a832ac4b3088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:24.860392 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e9080-939e-4299-9986-9146e90197eb None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:24.862420 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a85f7-8210-4171-ad9a-a832ac4b3088 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:24.865721 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a85f7-8210-4171-ad9a-a832ac4b3088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:24.866732 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a85f7-8210-4171-ad9a-a832ac4b3088 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:24.869871 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a85f7-8210-4171-ad9a-a832ac4b3088 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:38:24.870906 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a85f7-8210-4171-ad9a-a832ac4b3088 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:24.874343 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a85f7-8210-4171-ad9a-a832ac4b3088 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:24.879864 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5abfd-ad03-47ab-96ae-74df74799109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:24.880719 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5abfd-ad03-47ab-96ae-74df74799109 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:24.881068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5abfd-ad03-47ab-96ae-74df74799109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:24.881790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5abfd-ad03-47ab-96ae-74df74799109 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:24.882199 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5abfd-ad03-47ab-96ae-74df74799109 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:38:24.882956 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5abfd-ad03-47ab-96ae-74df74799109 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:24.885583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5abfd-ad03-47ab-96ae-74df74799109 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:24.917530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 892/1799] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:38:24.923316 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5abfd-ad03-47ab-96ae-74df74799109 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:24.934673 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 908/1800] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:38:24.937498 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a85f7-8210-4171-ad9a-a832ac4b3088 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:24.946161 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5abfd-ad03-47ab-96ae-74df74799109 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:24.966611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a85f7-8210-4171-ad9a-a832ac4b3088 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:24.966986 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170b095-b31b-4880-8370-9a79644a91ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:24.968455 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170b095-b31b-4880-8370-9a79644a91ae admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:24.969907 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cfb92-ed48-40d3-b387-7bfdc821e528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:24.970432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170b095-b31b-4880-8370-9a79644a91ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:24.970771 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cfb92-ed48-40d3-b387-7bfdc821e528 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:24.971022 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170b095-b31b-4880-8370-9a79644a91ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:24.971281 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cfb92-ed48-40d3-b387-7bfdc821e528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:24.971676 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cfb92-ed48-40d3-b387-7bfdc821e528 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:24.972459 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630cfb92-ed48-40d3-b387-7bfdc821e528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:24.974771 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170b095-b31b-4880-8370-9a79644a91ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:24.976562 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630cfb92-ed48-40d3-b387-7bfdc821e528 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:24.983598 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170b095-b31b-4880-8370-9a79644a91ae admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:25.073160 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:25.114348 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 909/1801] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:38:24 2022] POST /identity/v3/projects => generated 381 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:38:25.122154 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cfb92-ed48-40d3-b387-7bfdc821e528 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:25.149828 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 893/1802] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:38:24 2022] POST /identity/v3/projects => generated 375 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:38:25.150949 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170b095-b31b-4880-8370-9a79644a91ae admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:25.339091 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:25.342586 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170b095-b31b-4880-8370-9a79644a91ae admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:25.361161 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaedbb0-2e1d-48fd-8e72-7e5e94243193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:25.362225 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaedbb0-2e1d-48fd-8e72-7e5e94243193 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:25.362704 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaedbb0-2e1d-48fd-8e72-7e5e94243193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:25.363722 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaedbb0-2e1d-48fd-8e72-7e5e94243193 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:25.364556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaedbb0-2e1d-48fd-8e72-7e5e94243193 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:25.369961 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaedbb0-2e1d-48fd-8e72-7e5e94243193 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:25.491102 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cfb92-ed48-40d3-b387-7bfdc821e528 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:25.498889 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17369215-def5-479b-b836-cec485ce4af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:25.501323 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17369215-def5-479b-b836-cec485ce4af3 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:25.501323 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17369215-def5-479b-b836-cec485ce4af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:25.501323 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17369215-def5-479b-b836-cec485ce4af3 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:25.510426 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17369215-def5-479b-b836-cec485ce4af3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:25.513146 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17369215-def5-479b-b836-cec485ce4af3 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:25.537589 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 894/1803] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:38:25 2022] POST /identity/v3/users => generated 288 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:38:25.541892 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaedbb0-2e1d-48fd-8e72-7e5e94243193 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:25.556351 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaedbb0-2e1d-48fd-8e72-7e5e94243193 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:25.562344 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b453cb9-6863-4f9c-ab29-c2acc433b366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:25.563226 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b453cb9-6863-4f9c-ab29-c2acc433b366 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:25.563624 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b453cb9-6863-4f9c-ab29-c2acc433b366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:25.564057 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b453cb9-6863-4f9c-ab29-c2acc433b366 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:25.565012 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b453cb9-6863-4f9c-ab29-c2acc433b366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:25.567339 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b453cb9-6863-4f9c-ab29-c2acc433b366 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:25.602381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 910/1804] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:38:25 2022] POST /identity/v3/users => generated 291 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:38:25.602381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17369215-def5-479b-b836-cec485ce4af3 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:25.604527 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-17369215-def5-479b-b836-cec485ce4af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:25.623444 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17369215-def5-479b-b836-cec485ce4af3 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:25.630279 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c322ede-bb19-41d3-9219-a0171085a621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:25.639288 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c322ede-bb19-41d3-9219-a0171085a621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:25.639821 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c322ede-bb19-41d3-9219-a0171085a621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:25.640469 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c322ede-bb19-41d3-9219-a0171085a621 admin admin] PATH_INFO: `/v3/projects/4aaf940dabd2415b97d9b08ed95d69d0` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:25.642112 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 895/1805] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:38:25.643171 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c322ede-bb19-41d3-9219-a0171085a621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aaf940dabd2415b97d9b08ed95d69d0)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:25.645089 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b453cb9-6863-4f9c-ab29-c2acc433b366 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:25.646996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c322ede-bb19-41d3-9219-a0171085a621 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:25.696357 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b453cb9-6863-4f9c-ab29-c2acc433b366 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:25.713903 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6e8e0-9e40-4de3-be40-594052a13ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:25.723639 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6e8e0-9e40-4de3-be40-594052a13ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:25.724376 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6e8e0-9e40-4de3-be40-594052a13ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:25.724956 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6e8e0-9e40-4de3-be40-594052a13ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:25.726197 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6e8e0-9e40-4de3-be40-594052a13ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:25.729096 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6e8e0-9e40-4de3-be40-594052a13ae5 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:25.756754 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 896/1806] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:38:25.758503 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6e8e0-9e40-4de3-be40-594052a13ae5 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:25.783738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6e8e0-9e40-4de3-be40-594052a13ae5 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:25.803252 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7567270-9ea5-4c00-b938-df23e4c7edc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:25.804173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7567270-9ea5-4c00-b938-df23e4c7edc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:25.804301 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7567270-9ea5-4c00-b938-df23e4c7edc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:25.804696 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7567270-9ea5-4c00-b938-df23e4c7edc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:25.805447 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7567270-9ea5-4c00-b938-df23e4c7edc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:25.807543 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7567270-9ea5-4c00-b938-df23e4c7edc2 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:25.827674 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 897/1807] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:38:25.832427 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7567270-9ea5-4c00-b938-df23e4c7edc2 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:25.843455 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7567270-9ea5-4c00-b938-df23e4c7edc2 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:25.852372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba4937-adb5-42e1-a571-0ea33eaf14de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:25.853100 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba4937-adb5-42e1-a571-0ea33eaf14de admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:25.853447 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba4937-adb5-42e1-a571-0ea33eaf14de admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:25.853824 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba4937-adb5-42e1-a571-0ea33eaf14de admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:25.862115 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba4937-adb5-42e1-a571-0ea33eaf14de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:25.868170 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba4937-adb5-42e1-a571-0ea33eaf14de admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:25.896520 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9c322ede-bb19-41d3-9219-a0171085a621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aaf940dabd2415b97d9b08ed95d69d0', 'request_id': 'req-9c322ede-bb19-41d3-9219-a0171085a621'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:25.902944 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 898/1808] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:38:25.902944 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba4937-adb5-42e1-a571-0ea33eaf14de admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:25.919521 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba4937-adb5-42e1-a571-0ea33eaf14de admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:25.997125 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9c322ede-bb19-41d3-9219-a0171085a621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aaf940dabd2415b97d9b08ed95d69d0', 'request_id': 'req-9c322ede-bb19-41d3-9219-a0171085a621'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:25.998568 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14c4a7-99b2-48c1-a38e-6830e7c38b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:25.999799 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14c4a7-99b2-48c1-a38e-6830e7c38b07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:26.000241 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14c4a7-99b2-48c1-a38e-6830e7c38b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:26.000853 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14c4a7-99b2-48c1-a38e-6830e7c38b07 admin admin] PATH_INFO: `/v3/projects/a19797b8e0344459a61c8d50d13e70bd/users/6eff19c3fdc748fab080e897fe8d2c5a/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:26.022413 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14c4a7-99b2-48c1-a38e-6830e7c38b07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a19797b8e0344459a61c8d50d13e70bd, user_id=6eff19c3fdc748fab080e897fe8d2c5a, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:26.025664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14c4a7-99b2-48c1-a38e-6830e7c38b07 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:26.039444 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9c322ede-bb19-41d3-9219-a0171085a621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aaf940dabd2415b97d9b08ed95d69d0', 'request_id': 'req-9c322ede-bb19-41d3-9219-a0171085a621'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:26.083997 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9c322ede-bb19-41d3-9219-a0171085a621 admin admin] The token cache is being invalidate because project 4aaf940dabd2415b97d9b08ed95d69d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:38:26.084325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9c322ede-bb19-41d3-9219-a0171085a621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:26.085832 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9c322ede-bb19-41d3-9219-a0171085a621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:26.095294 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 911/1809] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:38:25 2022] DELETE /identity/v3/projects/4aaf940dabd2415b97d9b08ed95d69d0 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:26.096192 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c322ede-bb19-41d3-9219-a0171085a621 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:26.100129 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9c322ede-bb19-41d3-9219-a0171085a621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:26.140203 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 899/1810] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:38:25 2022] PUT /identity/v3/projects/a19797b8e0344459a61c8d50d13e70bd/users/6eff19c3fdc748fab080e897fe8d2c5a/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:26.142054 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe422a-0a7f-4821-a4a7-5f02a6ab85e3 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:26.142523 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe422a-0a7f-4821-a4a7-5f02a6ab85e3 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:26.143704 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe422a-0a7f-4821-a4a7-5f02a6ab85e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:26.154344 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c322ede-bb19-41d3-9219-a0171085a621 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:26.191333 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:26.205361 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-9bbe422a-0a7f-4821-a4a7-5f02a6ab85e3 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:26.207137 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9bbe422a-0a7f-4821-a4a7-5f02a6ab85e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:26.281994 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:26.298124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c5f7f5-e935-4403-ae45-f93b0425165b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:26.302375 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5f7f5-e935-4403-ae45-f93b0425165b admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:26.309364 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5f7f5-e935-4403-ae45-f93b0425165b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:26.309364 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5f7f5-e935-4403-ae45-f93b0425165b admin admin] PATH_INFO: `/v3/projects/c05135de05524cbf898e941ae633d1a1/users/d3519160f379497aa525c0d9b7616fa6/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:26.339512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c5f7f5-e935-4403-ae45-f93b0425165b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c05135de05524cbf898e941ae633d1a1, user_id=d3519160f379497aa525c0d9b7616fa6, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:26.343519 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c5f7f5-e935-4403-ae45-f93b0425165b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:26.392100 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 900/1811] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:26.393816 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd10cf2-a4bb-421d-b16e-88566b674388 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:26.394339 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd10cf2-a4bb-421d-b16e-88566b674388 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:26.395040 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd10cf2-a4bb-421d-b16e-88566b674388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:26.449233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-6cd10cf2-a4bb-421d-b16e-88566b674388 None None] MFA Rules not processed for user `6eff19c3fdc748fab080e897fe8d2c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:26.451518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6cd10cf2-a4bb-421d-b16e-88566b674388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:26.469886 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 912/1812] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:38:26 2022] PUT /identity/v3/projects/c05135de05524cbf898e941ae633d1a1/users/d3519160f379497aa525c0d9b7616fa6/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:26.469886 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687c689-b4be-41aa-9525-89676ac576c5 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:26.469886 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687c689-b4be-41aa-9525-89676ac576c5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:26.469886 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687c689-b4be-41aa-9525-89676ac576c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:26.525414 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-3687c689-b4be-41aa-9525-89676ac576c5 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:26.526936 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3687c689-b4be-41aa-9525-89676ac576c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:26.630430 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 901/1813] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:26.634130 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168ae6f-b37b-483a-a0c2-d83699c24d2e None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:26.634569 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168ae6f-b37b-483a-a0c2-d83699c24d2e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:26.634945 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168ae6f-b37b-483a-a0c2-d83699c24d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:26.671776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 913/1814] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:26.677548 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687c689-b4be-41aa-9525-89676ac576c5 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:26.679039 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3687c689-b4be-41aa-9525-89676ac576c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:26.689810 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-8168ae6f-b37b-483a-a0c2-d83699c24d2e None None] MFA Rules not processed for user `d3519160f379497aa525c0d9b7616fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:26.692990 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-8168ae6f-b37b-483a-a0c2-d83699c24d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:26.797705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687c689-b4be-41aa-9525-89676ac576c5 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:26.804918 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c616a84-4326-4b36-b574-4e6d5ee2da16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:26.805779 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c616a84-4326-4b36-b574-4e6d5ee2da16 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:26.805930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c616a84-4326-4b36-b574-4e6d5ee2da16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:26.806339 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c616a84-4326-4b36-b574-4e6d5ee2da16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:26.834314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 902/1815] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:26.834314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168ae6f-b37b-483a-a0c2-d83699c24d2e None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:26.848601 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168ae6f-b37b-483a-a0c2-d83699c24d2e None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:26.850242 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c616a84-4326-4b36-b574-4e6d5ee2da16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:26.853057 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c616a84-4326-4b36-b574-4e6d5ee2da16 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:26.865887 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebcaa45-6f45-4675-b3e3-1b1373d21a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:26.866139 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebcaa45-6f45-4675-b3e3-1b1373d21a87 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:26.866444 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebcaa45-6f45-4675-b3e3-1b1373d21a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:26.866739 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebcaa45-6f45-4675-b3e3-1b1373d21a87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:26.867419 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebcaa45-6f45-4675-b3e3-1b1373d21a87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:38:26.867724 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebcaa45-6f45-4675-b3e3-1b1373d21a87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:26.869470 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebcaa45-6f45-4675-b3e3-1b1373d21a87 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:26.891430 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 914/1816] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:38:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:38:26.892194 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c616a84-4326-4b36-b574-4e6d5ee2da16 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:26.917609 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 903/1817] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:38:26.923326 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c616a84-4326-4b36-b574-4e6d5ee2da16 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:26.924456 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebcaa45-6f45-4675-b3e3-1b1373d21a87 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:26.942372 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5a677-e94a-424a-bff4-4fc9d11779e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:26.948556 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5a677-e94a-424a-bff4-4fc9d11779e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:26.948556 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5a677-e94a-424a-bff4-4fc9d11779e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:26.948556 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5a677-e94a-424a-bff4-4fc9d11779e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:26.948556 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f5a677-e94a-424a-bff4-4fc9d11779e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:26.949079 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebcaa45-6f45-4675-b3e3-1b1373d21a87 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:26.949174 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f5a677-e94a-424a-bff4-4fc9d11779e0 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:26.964535 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f91ee-97dd-4ab7-912f-d10790e94d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:26.965593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f91ee-97dd-4ab7-912f-d10790e94d60 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:26.966215 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f91ee-97dd-4ab7-912f-d10790e94d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:26.966877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f91ee-97dd-4ab7-912f-d10790e94d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:26.967706 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f91ee-97dd-4ab7-912f-d10790e94d60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:26.970193 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f91ee-97dd-4ab7-912f-d10790e94d60 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:27.125871 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 904/1818] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:38:26 2022] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:38:27.126468 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 915/1819] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:38:26 2022] POST /identity/v3/projects => generated 381 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:38:27.128116 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f91ee-97dd-4ab7-912f-d10790e94d60 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:27.129593 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5a677-e94a-424a-bff4-4fc9d11779e0 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:27.271131 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5a677-e94a-424a-bff4-4fc9d11779e0 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:27.329230 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f91ee-97dd-4ab7-912f-d10790e94d60 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:27.336549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b5573-8a47-4160-a57f-257732d25cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:27.336549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b5573-8a47-4160-a57f-257732d25cec admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:27.336549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b5573-8a47-4160-a57f-257732d25cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:27.336928 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b5573-8a47-4160-a57f-257732d25cec admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:27.337735 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b5573-8a47-4160-a57f-257732d25cec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:27.346420 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b5573-8a47-4160-a57f-257732d25cec admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:27.384338 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5ab79-ce2b-4a80-8b8d-988551d984f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:27.384338 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5ab79-ce2b-4a80-8b8d-988551d984f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:27.384338 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5ab79-ce2b-4a80-8b8d-988551d984f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:27.384338 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5ab79-ce2b-4a80-8b8d-988551d984f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:27.385083 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c5ab79-ce2b-4a80-8b8d-988551d984f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:27.385083 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c5ab79-ce2b-4a80-8b8d-988551d984f3 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:27.529471 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 905/1820] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:38:27 2022] POST /identity/v3/users => generated 297 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:38:27.530931 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b5573-8a47-4160-a57f-257732d25cec admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:27.534324 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 916/1821] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:38:27 2022] POST /identity/v3/users => generated 292 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:38:27.538780 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5ab79-ce2b-4a80-8b8d-988551d984f3 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:27.555049 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b5573-8a47-4160-a57f-257732d25cec admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:27.555588 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5ab79-ce2b-4a80-8b8d-988551d984f3 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:27.567140 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464461e-2ed0-4b10-88c2-6f16133b43f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:27.567761 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464461e-2ed0-4b10-88c2-6f16133b43f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:27.568036 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464461e-2ed0-4b10-88c2-6f16133b43f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:27.568773 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464461e-2ed0-4b10-88c2-6f16133b43f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:27.569034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464461e-2ed0-4b10-88c2-6f16133b43f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:27.570888 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464461e-2ed0-4b10-88c2-6f16133b43f0 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:27.576872 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5ac35-2f17-4c77-819d-f8401efb1d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:27.578651 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5ac35-2f17-4c77-819d-f8401efb1d75 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:27.579195 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5ac35-2f17-4c77-819d-f8401efb1d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:27.580797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5ac35-2f17-4c77-819d-f8401efb1d75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:27.582290 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b5ac35-2f17-4c77-819d-f8401efb1d75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:27.583498 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 906/1822] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:38:27.585850 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b5ac35-2f17-4c77-819d-f8401efb1d75 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:27.593173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464461e-2ed0-4b10-88c2-6f16133b43f0 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:27.600976 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 917/1823] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:38:27.604952 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5ac35-2f17-4c77-819d-f8401efb1d75 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:27.613078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464461e-2ed0-4b10-88c2-6f16133b43f0 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:27.620687 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821de957-caf9-4a5e-b959-9a6b0dae88d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:27.621398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821de957-caf9-4a5e-b959-9a6b0dae88d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:27.621833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821de957-caf9-4a5e-b959-9a6b0dae88d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:27.622056 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821de957-caf9-4a5e-b959-9a6b0dae88d2 admin admin] PATH_INFO: `/v3/projects/04a470c1b4c84ab0b390a417a13c5b89/users/182612b6a407434fb3c4c814dd2a3c41/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:27.622447 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5ac35-2f17-4c77-819d-f8401efb1d75 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:27.646560 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a63f8-afb9-4d94-90dc-16a55868b348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:27.651624 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a63f8-afb9-4d94-90dc-16a55868b348 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:27.651624 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a63f8-afb9-4d94-90dc-16a55868b348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:27.651624 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a63f8-afb9-4d94-90dc-16a55868b348 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:27.651624 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a63f8-afb9-4d94-90dc-16a55868b348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:27.651624 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a63f8-afb9-4d94-90dc-16a55868b348 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:27.665472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821de957-caf9-4a5e-b959-9a6b0dae88d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a470c1b4c84ab0b390a417a13c5b89, user_id=182612b6a407434fb3c4c814dd2a3c41, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:27.668253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 918/1824] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:38:27.669203 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821de957-caf9-4a5e-b959-9a6b0dae88d2 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:27.672995 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:27.676225 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a63f8-afb9-4d94-90dc-16a55868b348 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:27.701640 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a63f8-afb9-4d94-90dc-16a55868b348 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:27.714747 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5939d99-0626-4b81-ba9b-9e634c04f84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:27.717885 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5939d99-0626-4b81-ba9b-9e634c04f84b admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:27.717885 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5939d99-0626-4b81-ba9b-9e634c04f84b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:27.717885 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5939d99-0626-4b81-ba9b-9e634c04f84b admin admin] PATH_INFO: `/v3/projects/cf99bfb6f9e8482f869b959171506384/users/b1611c7f3a514a40bb1d2d5d8f1815ac/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:27.749726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5939d99-0626-4b81-ba9b-9e634c04f84b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf99bfb6f9e8482f869b959171506384, user_id=b1611c7f3a514a40bb1d2d5d8f1815ac, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:27.761878 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5939d99-0626-4b81-ba9b-9e634c04f84b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:27.806106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 907/1825] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:38:27 2022] PUT /identity/v3/projects/04a470c1b4c84ab0b390a417a13c5b89/users/182612b6a407434fb3c4c814dd2a3c41/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:27.811299 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821de957-caf9-4a5e-b959-9a6b0dae88d2 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:27.884664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:27.892238 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 919/1826] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:38:27 2022] PUT /identity/v3/projects/cf99bfb6f9e8482f869b959171506384/users/b1611c7f3a514a40bb1d2d5d8f1815ac/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:27.908992 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05518a44-6332-4849-ae91-56fc74dd2418 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:27.909555 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05518a44-6332-4849-ae91-56fc74dd2418 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:27.910679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05518a44-6332-4849-ae91-56fc74dd2418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:28.059060 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-05518a44-6332-4849-ae91-56fc74dd2418 None None] MFA Rules not processed for user `b1611c7f3a514a40bb1d2d5d8f1815ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:28.060834 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-05518a44-6332-4849-ae91-56fc74dd2418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:28.080159 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821de957-caf9-4a5e-b959-9a6b0dae88d2 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:28.260914 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e44c5-5135-49ec-a1a9-45553003682d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:28.262959 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e44c5-5135-49ec-a1a9-45553003682d admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:28.262959 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e44c5-5135-49ec-a1a9-45553003682d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:28.262959 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e44c5-5135-49ec-a1a9-45553003682d admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:28.262959 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e44c5-5135-49ec-a1a9-45553003682d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:28.264755 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e44c5-5135-49ec-a1a9-45553003682d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:28.297011 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 908/1827] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 486 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:38:28.298343 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e44c5-5135-49ec-a1a9-45553003682d admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:28.314646 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e44c5-5135-49ec-a1a9-45553003682d admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:28.335359 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aecc61-5133-4932-966f-70b8162bf8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:28.336939 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aecc61-5133-4932-966f-70b8162bf8d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:28.337452 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aecc61-5133-4932-966f-70b8162bf8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:28.337936 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aecc61-5133-4932-966f-70b8162bf8d2 admin admin] PATH_INFO: `/v3/projects/04a470c1b4c84ab0b390a417a13c5b89/users/182612b6a407434fb3c4c814dd2a3c41/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:28.341820 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aecc61-5133-4932-966f-70b8162bf8d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a470c1b4c84ab0b390a417a13c5b89, user_id=182612b6a407434fb3c4c814dd2a3c41, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:28.350215 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aecc61-5133-4932-966f-70b8162bf8d2 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:28.374724 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 909/1828] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:38:28 2022] PUT /identity/v3/projects/04a470c1b4c84ab0b390a417a13c5b89/users/182612b6a407434fb3c4c814dd2a3c41/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:28.375666 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 920/1829] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:38:28.386669 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60747c1-5eb1-4134-b259-051193216780 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:28.386951 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60747c1-5eb1-4134-b259-051193216780 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:28.390746 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60747c1-5eb1-4134-b259-051193216780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:28.392000 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aecc61-5133-4932-966f-70b8162bf8d2 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:28.394732 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-74aecc61-5133-4932-966f-70b8162bf8d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:28.445205 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d60747c1-5eb1-4134-b259-051193216780 None None] MFA Rules not processed for user `182612b6a407434fb3c4c814dd2a3c41`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:28.446502 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d60747c1-5eb1-4134-b259-051193216780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:28.549999 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aecc61-5133-4932-966f-70b8162bf8d2 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:28.554674 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46875f48-d640-4820-99af-027dfd500429 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:28.556097 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46875f48-d640-4820-99af-027dfd500429 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:28.556558 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46875f48-d640-4820-99af-027dfd500429 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:28.556982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46875f48-d640-4820-99af-027dfd500429 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:28.614243 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:28.628016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 921/1830] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:28 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:28.634771 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53142ee1-a44f-4805-bafd-5379cd75dd6e None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:28.636335 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53142ee1-a44f-4805-bafd-5379cd75dd6e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:28.637675 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53142ee1-a44f-4805-bafd-5379cd75dd6e None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:28.642649 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 922/1831] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 14:38:28 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:38:28.688528 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46875f48-d640-4820-99af-027dfd500429 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:28.690315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46875f48-d640-4820-99af-027dfd500429 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:28.698898 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315541c-3f8d-43e0-b7d9-c3df15ec6fd0 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:28.699336 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315541c-3f8d-43e0-b7d9-c3df15ec6fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:28.699736 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315541c-3f8d-43e0-b7d9-c3df15ec6fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:28.708926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 910/1832] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:38:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:38:28.753053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b315541c-3f8d-43e0-b7d9-c3df15ec6fd0 None None] MFA Rules not processed for user `8d099678d6454f7eb494892a69feaf62`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:28.755615 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b315541c-3f8d-43e0-b7d9-c3df15ec6fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:28.798857 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46875f48-d640-4820-99af-027dfd500429 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:28.815357 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46875f48-d640-4820-99af-027dfd500429 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:28.842205 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c1cb4-44e5-4386-9f02-1f9efef94b58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:28.844313 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c1cb4-44e5-4386-9f02-1f9efef94b58 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:28.845666 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c1cb4-44e5-4386-9f02-1f9efef94b58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:28.848985 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c1cb4-44e5-4386-9f02-1f9efef94b58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:28.897980 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 923/1833] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 14:38:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:38:28.903536 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c1cb4-44e5-4386-9f02-1f9efef94b58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:28.911143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c1cb4-44e5-4386-9f02-1f9efef94b58 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:28.941461 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 911/1834] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:38:28 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:38:29.221623 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:29.437305 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315541c-3f8d-43e0-b7d9-c3df15ec6fd0 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:29.439440 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b315541c-3f8d-43e0-b7d9-c3df15ec6fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:29.469007 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315541c-3f8d-43e0-b7d9-c3df15ec6fd0 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:29.483191 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8ed6b-26ad-4b86-9436-0e8349d73534 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:29.484661 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8ed6b-26ad-4b86-9436-0e8349d73534 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:29.484945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8ed6b-26ad-4b86-9436-0e8349d73534 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:29.485225 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8ed6b-26ad-4b86-9436-0e8349d73534 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:29.511067 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8ed6b-26ad-4b86-9436-0e8349d73534 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:29.511067 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8ed6b-26ad-4b86-9436-0e8349d73534 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:29.531584 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 924/1835] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:38:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:38:29.728251 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c1cb4-44e5-4386-9f02-1f9efef94b58 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:29.745254 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c1cb4-44e5-4386-9f02-1f9efef94b58 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:29.755229 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47cd5b-4d6f-4df1-9a99-8c9684320dd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:29.756725 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47cd5b-4d6f-4df1-9a99-8c9684320dd4 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:29.757343 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47cd5b-4d6f-4df1-9a99-8c9684320dd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:29.757816 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47cd5b-4d6f-4df1-9a99-8c9684320dd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:29.886017 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47cd5b-4d6f-4df1-9a99-8c9684320dd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:29.887954 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47cd5b-4d6f-4df1-9a99-8c9684320dd4 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:29.926747 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 912/1836] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:38:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:38:29.947561 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:30.135711 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:32.584254 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:32.815433 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:44.044293 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=11 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:44.330104 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=72 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:57.344737 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8ed6b-26ad-4b86-9436-0e8349d73534 service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:57.439002 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8ed6b-26ad-4b86-9436-0e8349d73534 service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:57.447623 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab102fe-ed0c-49a7-9123-b7cd008f6001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:57.449082 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab102fe-ed0c-49a7-9123-b7cd008f6001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:57.449511 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab102fe-ed0c-49a7-9123-b7cd008f6001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:57.449996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab102fe-ed0c-49a7-9123-b7cd008f6001 admin admin] PATH_INFO: `/v3/users/b1611c7f3a514a40bb1d2d5d8f1815ac` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:57.453089 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab102fe-ed0c-49a7-9123-b7cd008f6001 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1611c7f3a514a40bb1d2d5d8f1815ac)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:57.457414 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab102fe-ed0c-49a7-9123-b7cd008f6001 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:57.814208 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7ab102fe-ed0c-49a7-9123-b7cd008f6001 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1611c7f3a514a40bb1d2d5d8f1815ac'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:57.817668 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7ab102fe-ed0c-49a7-9123-b7cd008f6001 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1611c7f3a514a40bb1d2d5d8f1815ac'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:57.818750 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7ab102fe-ed0c-49a7-9123-b7cd008f6001 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1611c7f3a514a40bb1d2d5d8f1815ac'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:57.848405 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7ab102fe-ed0c-49a7-9123-b7cd008f6001 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1611c7f3a514a40bb1d2d5d8f1815ac'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:57.971234 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7ab102fe-ed0c-49a7-9123-b7cd008f6001 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1611c7f3a514a40bb1d2d5d8f1815ac'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:58.003468 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 925/1837] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:38:57 2022] DELETE /identity/v3/users/b1611c7f3a514a40bb1d2d5d8f1815ac => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:58.010883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc09960-47f7-47e0-b12e-6bf143eb4a10 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:58.012634 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc09960-47f7-47e0-b12e-6bf143eb4a10 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:58.013522 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc09960-47f7-47e0-b12e-6bf143eb4a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:58.045743 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-2dc09960-47f7-47e0-b12e-6bf143eb4a10 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:58.048302 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2dc09960-47f7-47e0-b12e-6bf143eb4a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:58.177030 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 913/1838] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:58.193864 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141c0ed-c2b7-4c36-96b9-43ebd9a432ef None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:58.194332 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141c0ed-c2b7-4c36-96b9-43ebd9a432ef None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:58.194780 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141c0ed-c2b7-4c36-96b9-43ebd9a432ef None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:58.198276 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 926/1839] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 14:38:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:38:58.199661 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc09960-47f7-47e0-b12e-6bf143eb4a10 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:58.201328 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2dc09960-47f7-47e0-b12e-6bf143eb4a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:58.212829 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490077be-84a6-4422-b379-eb49c38311bd None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:58.213834 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490077be-84a6-4422-b379-eb49c38311bd None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:58.214186 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490077be-84a6-4422-b379-eb49c38311bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:58.248507 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-490077be-84a6-4422-b379-eb49c38311bd None None] MFA Rules not processed for user `8d099678d6454f7eb494892a69feaf62`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:58.250685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-490077be-84a6-4422-b379-eb49c38311bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:58.314219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc09960-47f7-47e0-b12e-6bf143eb4a10 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:58.328425 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59363bc-374b-4a59-a616-9b3ba3e751c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:58.330040 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59363bc-374b-4a59-a616-9b3ba3e751c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:58.332008 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59363bc-374b-4a59-a616-9b3ba3e751c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:58.332555 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59363bc-374b-4a59-a616-9b3ba3e751c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:58.351069 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59363bc-374b-4a59-a616-9b3ba3e751c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:58.352491 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59363bc-374b-4a59-a616-9b3ba3e751c4 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:58.367906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 914/1840] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:38:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:38:58.380906 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 927/1841] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 14:38:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:38:58.418058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59363bc-374b-4a59-a616-9b3ba3e751c4 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:58.420567 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b59363bc-374b-4a59-a616-9b3ba3e751c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:58.447451 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59363bc-374b-4a59-a616-9b3ba3e751c4 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:58.458277 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6646b68-3f99-4d0b-9b75-07da45c47744 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:58.459212 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6646b68-3f99-4d0b-9b75-07da45c47744 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:58.459212 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6646b68-3f99-4d0b-9b75-07da45c47744 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:58.460005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6646b68-3f99-4d0b-9b75-07da45c47744 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:58.470989 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6646b68-3f99-4d0b-9b75-07da45c47744 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:58.473421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6646b68-3f99-4d0b-9b75-07da45c47744 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:58.485660 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 915/1842] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:38:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:38:58.891739 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490077be-84a6-4422-b379-eb49c38311bd None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:58.896536 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-490077be-84a6-4422-b379-eb49c38311bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:58.924788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490077be-84a6-4422-b379-eb49c38311bd None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:58.948828 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c073e2-b18b-4d9c-8b38-9b0675ddb9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:58.948828 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c073e2-b18b-4d9c-8b38-9b0675ddb9ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:58.948828 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c073e2-b18b-4d9c-8b38-9b0675ddb9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:58.948828 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c073e2-b18b-4d9c-8b38-9b0675ddb9ae admin admin] PATH_INFO: `/v3/projects/cf99bfb6f9e8482f869b959171506384` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:58.952854 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c073e2-b18b-4d9c-8b38-9b0675ddb9ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf99bfb6f9e8482f869b959171506384)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:58.973958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c073e2-b18b-4d9c-8b38-9b0675ddb9ae admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:59.000616 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:59.204395 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-08c073e2-b18b-4d9c-8b38-9b0675ddb9ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf99bfb6f9e8482f869b959171506384', 'request_id': 'req-08c073e2-b18b-4d9c-8b38-9b0675ddb9ae'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:59.302335 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-08c073e2-b18b-4d9c-8b38-9b0675ddb9ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf99bfb6f9e8482f869b959171506384', 'request_id': 'req-08c073e2-b18b-4d9c-8b38-9b0675ddb9ae'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:59.312935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-08c073e2-b18b-4d9c-8b38-9b0675ddb9ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf99bfb6f9e8482f869b959171506384', 'request_id': 'req-08c073e2-b18b-4d9c-8b38-9b0675ddb9ae'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:59.359291 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-08c073e2-b18b-4d9c-8b38-9b0675ddb9ae admin admin] The token cache is being invalidate because project cf99bfb6f9e8482f869b959171506384 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:38:59.359601 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-08c073e2-b18b-4d9c-8b38-9b0675ddb9ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:59.367065 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-08c073e2-b18b-4d9c-8b38-9b0675ddb9ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:38:59.369039 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 928/1843] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:38:58 2022] DELETE /identity/v3/projects/cf99bfb6f9e8482f869b959171506384 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:59.374989 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca9ab1-a4e0-4e85-8408-bdee2ad9674e None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:59.375734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca9ab1-a4e0-4e85-8408-bdee2ad9674e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:59.375734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca9ab1-a4e0-4e85-8408-bdee2ad9674e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:59.412894 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-aeca9ab1-a4e0-4e85-8408-bdee2ad9674e None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:59.414479 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-aeca9ab1-a4e0-4e85-8408-bdee2ad9674e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:59.527101 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 916/1844] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:38:59.535822 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11746154-62d5-4cd9-96b7-0724df132f41 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:59.536477 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11746154-62d5-4cd9-96b7-0724df132f41 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:59.536750 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11746154-62d5-4cd9-96b7-0724df132f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:59.564033 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-11746154-62d5-4cd9-96b7-0724df132f41 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:59.566642 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-11746154-62d5-4cd9-96b7-0724df132f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:59.576305 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 929/1845] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:38:59.581621 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca9ab1-a4e0-4e85-8408-bdee2ad9674e None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:59.616621 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca9ab1-a4e0-4e85-8408-bdee2ad9674e None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:59.624979 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9f5c4-32c7-4fce-90d9-a84ed5922dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:59.637478 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9f5c4-32c7-4fce-90d9-a84ed5922dbd admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:59.646568 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9f5c4-32c7-4fce-90d9-a84ed5922dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:59.651910 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9f5c4-32c7-4fce-90d9-a84ed5922dbd admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:59.651910 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9f5c4-32c7-4fce-90d9-a84ed5922dbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:38:59.651910 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9f5c4-32c7-4fce-90d9-a84ed5922dbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:59.652960 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9f5c4-32c7-4fce-90d9-a84ed5922dbd admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:59.681176 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 917/1846] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:38:59.683808 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11746154-62d5-4cd9-96b7-0724df132f41 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:59.717852 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11746154-62d5-4cd9-96b7-0724df132f41 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:59.743046 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd51f3-24a4-4147-a105-b44b048c74b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:59.744125 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd51f3-24a4-4147-a105-b44b048c74b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:59.745083 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd51f3-24a4-4147-a105-b44b048c74b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:59.745585 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd51f3-24a4-4147-a105-b44b048c74b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:59.761127 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd51f3-24a4-4147-a105-b44b048c74b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:59.765669 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd51f3-24a4-4147-a105-b44b048c74b1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:59.901660 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 930/1847] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:38:59 2022] POST /identity/v3/projects => generated 383 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:38:59.909252 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9f5c4-32c7-4fce-90d9-a84ed5922dbd admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:59.946183 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9f5c4-32c7-4fce-90d9-a84ed5922dbd admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:00.007434 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:00.126631 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c1296-560e-4c17-b13c-57d660b6aa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:00.130678 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c1296-560e-4c17-b13c-57d660b6aa08 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:00.132387 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c1296-560e-4c17-b13c-57d660b6aa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:00.134194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c1296-560e-4c17-b13c-57d660b6aa08 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:00.135846 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c1296-560e-4c17-b13c-57d660b6aa08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:00.140686 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c1296-560e-4c17-b13c-57d660b6aa08 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:00.297974 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 918/1848] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:38:59 2022] POST /identity/v3/users => generated 292 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:00.303184 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd51f3-24a4-4147-a105-b44b048c74b1 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:00.333166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd51f3-24a4-4147-a105-b44b048c74b1 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:00.350742 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb32ea9-9aeb-4e56-81c9-0f10167bf06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:00.351542 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb32ea9-9aeb-4e56-81c9-0f10167bf06f admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:00.351947 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb32ea9-9aeb-4e56-81c9-0f10167bf06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:00.352327 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb32ea9-9aeb-4e56-81c9-0f10167bf06f admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:00.353539 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb32ea9-9aeb-4e56-81c9-0f10167bf06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:00.359266 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb32ea9-9aeb-4e56-81c9-0f10167bf06f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:00.387367 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 931/1849] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:00.390683 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c1296-560e-4c17-b13c-57d660b6aa08 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:00.415460 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c1296-560e-4c17-b13c-57d660b6aa08 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:00.435454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e1d01-4286-4dca-aa29-1c1853718d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:00.436090 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e1d01-4286-4dca-aa29-1c1853718d1b admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:00.436371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e1d01-4286-4dca-aa29-1c1853718d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:00.436642 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e1d01-4286-4dca-aa29-1c1853718d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:00.437320 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7e1d01-4286-4dca-aa29-1c1853718d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:00.439313 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7e1d01-4286-4dca-aa29-1c1853718d1b admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:00.462506 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 919/1850] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:00.463962 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb32ea9-9aeb-4e56-81c9-0f10167bf06f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:00.475987 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb32ea9-9aeb-4e56-81c9-0f10167bf06f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:00.483655 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b572537-3d5d-4136-bf17-dc44b2fe6671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:00.484647 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b572537-3d5d-4136-bf17-dc44b2fe6671 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:00.485067 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b572537-3d5d-4136-bf17-dc44b2fe6671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:00.485500 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b572537-3d5d-4136-bf17-dc44b2fe6671 admin admin] PATH_INFO: `/v3/projects/1e00946f0f0f46808a02c51a8e0e7ffe/users/8630c30478604680abf18a4c42ac5471/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:00.516449 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b572537-3d5d-4136-bf17-dc44b2fe6671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e00946f0f0f46808a02c51a8e0e7ffe, user_id=8630c30478604680abf18a4c42ac5471, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:00.528135 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b572537-3d5d-4136-bf17-dc44b2fe6671 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:00.714185 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 932/1851] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:00 2022] PUT /identity/v3/projects/1e00946f0f0f46808a02c51a8e0e7ffe/users/8630c30478604680abf18a4c42ac5471/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:00.727342 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0153526-86b5-4850-a439-30f0c78a3a0d None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:00.727626 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0153526-86b5-4850-a439-30f0c78a3a0d None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:00.727893 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0153526-86b5-4850-a439-30f0c78a3a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:00.789146 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a0153526-86b5-4850-a439-30f0c78a3a0d None None] MFA Rules not processed for user `8630c30478604680abf18a4c42ac5471`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:00.790624 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a0153526-86b5-4850-a439-30f0c78a3a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:00.952413 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 920/1852] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:39:01.032727 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b572537-3d5d-4136-bf17-dc44b2fe6671 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:01.034472 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0b572537-3d5d-4136-bf17-dc44b2fe6671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:01.130773 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b572537-3d5d-4136-bf17-dc44b2fe6671 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:01.135511 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf89f1-16ce-4868-9870-016522c92be5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:01.136517 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf89f1-16ce-4868-9870-016522c92be5 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:01.136888 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf89f1-16ce-4868-9870-016522c92be5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:01.137199 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf89f1-16ce-4868-9870-016522c92be5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:01.150382 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf89f1-16ce-4868-9870-016522c92be5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:01.152792 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf89f1-16ce-4868-9870-016522c92be5 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:01.168610 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 933/1853] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:39:01.640429 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0153526-86b5-4850-a439-30f0c78a3a0d None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:01.642200 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a0153526-86b5-4850-a439-30f0c78a3a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:01.731003 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0153526-86b5-4850-a439-30f0c78a3a0d None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:01.738010 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88add4a-1ad1-490b-a9bd-304b21a576d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:01.738982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88add4a-1ad1-490b-a9bd-304b21a576d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:01.744175 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88add4a-1ad1-490b-a9bd-304b21a576d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:01.744175 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88add4a-1ad1-490b-a9bd-304b21a576d9 admin admin] PATH_INFO: `/v3/users/d3519160f379497aa525c0d9b7616fa6` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:01.744175 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88add4a-1ad1-490b-a9bd-304b21a576d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3519160f379497aa525c0d9b7616fa6)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:01.744175 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88add4a-1ad1-490b-a9bd-304b21a576d9 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:01.864844 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:01.968271 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f88add4a-1ad1-490b-a9bd-304b21a576d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3519160f379497aa525c0d9b7616fa6'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:01.969040 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f88add4a-1ad1-490b-a9bd-304b21a576d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3519160f379497aa525c0d9b7616fa6'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:01.984942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f88add4a-1ad1-490b-a9bd-304b21a576d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3519160f379497aa525c0d9b7616fa6'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:01.985967 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f88add4a-1ad1-490b-a9bd-304b21a576d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3519160f379497aa525c0d9b7616fa6'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:02.100624 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f88add4a-1ad1-490b-a9bd-304b21a576d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3519160f379497aa525c0d9b7616fa6'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:02.132910 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 921/1854] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:39:01 2022] DELETE /identity/v3/users/d3519160f379497aa525c0d9b7616fa6 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:02.135386 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20639e62-2201-455e-8e4e-0452b10e8d6f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:02.136248 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20639e62-2201-455e-8e4e-0452b10e8d6f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:02.136676 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20639e62-2201-455e-8e4e-0452b10e8d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:02.168673 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-20639e62-2201-455e-8e4e-0452b10e8d6f None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:02.170535 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-20639e62-2201-455e-8e4e-0452b10e8d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:02.220083 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:02.270188 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 934/1855] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:02.280386 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88add4a-1ad1-490b-a9bd-304b21a576d9 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:02.285909 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f88add4a-1ad1-490b-a9bd-304b21a576d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:02.360775 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88add4a-1ad1-490b-a9bd-304b21a576d9 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:02.365477 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa03f5a-7b42-4684-9d8f-4b00e91d5ffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:02.366137 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa03f5a-7b42-4684-9d8f-4b00e91d5ffd service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:02.366418 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa03f5a-7b42-4684-9d8f-4b00e91d5ffd service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:02.366700 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa03f5a-7b42-4684-9d8f-4b00e91d5ffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:02.377545 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa03f5a-7b42-4684-9d8f-4b00e91d5ffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:02.379302 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa03f5a-7b42-4684-9d8f-4b00e91d5ffd service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:02.397521 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 922/1856] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:39:02.901766 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20639e62-2201-455e-8e4e-0452b10e8d6f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:02.903258 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-20639e62-2201-455e-8e4e-0452b10e8d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:02.921255 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20639e62-2201-455e-8e4e-0452b10e8d6f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:02.929366 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62235d73-270a-4d4f-93a0-4a1d1c1caadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:02.930063 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62235d73-270a-4d4f-93a0-4a1d1c1caadb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:02.930432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62235d73-270a-4d4f-93a0-4a1d1c1caadb admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:02.930689 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62235d73-270a-4d4f-93a0-4a1d1c1caadb admin admin] PATH_INFO: `/v3/projects/c05135de05524cbf898e941ae633d1a1` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:02.932615 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62235d73-270a-4d4f-93a0-4a1d1c1caadb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c05135de05524cbf898e941ae633d1a1)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:02.934691 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62235d73-270a-4d4f-93a0-4a1d1c1caadb admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:03.089240 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-62235d73-270a-4d4f-93a0-4a1d1c1caadb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c05135de05524cbf898e941ae633d1a1', 'request_id': 'req-62235d73-270a-4d4f-93a0-4a1d1c1caadb'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:03.173046 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-62235d73-270a-4d4f-93a0-4a1d1c1caadb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c05135de05524cbf898e941ae633d1a1', 'request_id': 'req-62235d73-270a-4d4f-93a0-4a1d1c1caadb'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:03.181873 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-62235d73-270a-4d4f-93a0-4a1d1c1caadb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c05135de05524cbf898e941ae633d1a1', 'request_id': 'req-62235d73-270a-4d4f-93a0-4a1d1c1caadb'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:03.193583 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-62235d73-270a-4d4f-93a0-4a1d1c1caadb admin admin] The token cache is being invalidate because project c05135de05524cbf898e941ae633d1a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:39:03.193831 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-62235d73-270a-4d4f-93a0-4a1d1c1caadb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:03.194364 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-62235d73-270a-4d4f-93a0-4a1d1c1caadb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:03.198386 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 935/1857] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:39:02 2022] DELETE /identity/v3/projects/c05135de05524cbf898e941ae633d1a1 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:03.201234 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa03f5a-7b42-4684-9d8f-4b00e91d5ffd service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:03.211318 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa03f5a-7b42-4684-9d8f-4b00e91d5ffd service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:03.272400 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf309f-1f36-4f59-bd0c-465c5b3ed753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:03.273037 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf309f-1f36-4f59-bd0c-465c5b3ed753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:03.273346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf309f-1f36-4f59-bd0c-465c5b3ed753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:03.273579 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf309f-1f36-4f59-bd0c-465c5b3ed753 admin admin] PATH_INFO: `/v3/users/182612b6a407434fb3c4c814dd2a3c41` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:03.274773 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf309f-1f36-4f59-bd0c-465c5b3ed753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=182612b6a407434fb3c4c814dd2a3c41)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:03.276726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf309f-1f36-4f59-bd0c-465c5b3ed753 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:03.500384 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d8cf309f-1f36-4f59-bd0c-465c5b3ed753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '182612b6a407434fb3c4c814dd2a3c41'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:03.501160 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d8cf309f-1f36-4f59-bd0c-465c5b3ed753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '182612b6a407434fb3c4c814dd2a3c41'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:03.504417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:03.524668 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d8cf309f-1f36-4f59-bd0c-465c5b3ed753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '182612b6a407434fb3c4c814dd2a3c41'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:03.525451 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d8cf309f-1f36-4f59-bd0c-465c5b3ed753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '182612b6a407434fb3c4c814dd2a3c41'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:03.620999 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d8cf309f-1f36-4f59-bd0c-465c5b3ed753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '182612b6a407434fb3c4c814dd2a3c41'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:03.639152 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 923/1858] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:39:03 2022] DELETE /identity/v3/users/182612b6a407434fb3c4c814dd2a3c41 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:04.159255 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62235d73-270a-4d4f-93a0-4a1d1c1caadb admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:04.160697 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-62235d73-270a-4d4f-93a0-4a1d1c1caadb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:04.179668 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62235d73-270a-4d4f-93a0-4a1d1c1caadb admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:04.240332 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb85f3-4258-4fa6-83f1-dc8427130103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:04.240971 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb85f3-4258-4fa6-83f1-dc8427130103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:04.241251 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb85f3-4258-4fa6-83f1-dc8427130103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:04.241524 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb85f3-4258-4fa6-83f1-dc8427130103 admin admin] PATH_INFO: `/v3/projects/04a470c1b4c84ab0b390a417a13c5b89` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:04.242682 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb85f3-4258-4fa6-83f1-dc8427130103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04a470c1b4c84ab0b390a417a13c5b89)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:04.244594 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb85f3-4258-4fa6-83f1-dc8427130103 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:04.357540 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-26cb85f3-4258-4fa6-83f1-dc8427130103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04a470c1b4c84ab0b390a417a13c5b89', 'request_id': 'req-26cb85f3-4258-4fa6-83f1-dc8427130103'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:04.442803 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-26cb85f3-4258-4fa6-83f1-dc8427130103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04a470c1b4c84ab0b390a417a13c5b89', 'request_id': 'req-26cb85f3-4258-4fa6-83f1-dc8427130103'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:04.444902 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:04.449870 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-26cb85f3-4258-4fa6-83f1-dc8427130103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04a470c1b4c84ab0b390a417a13c5b89', 'request_id': 'req-26cb85f3-4258-4fa6-83f1-dc8427130103'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:04.461340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-26cb85f3-4258-4fa6-83f1-dc8427130103 admin admin] The token cache is being invalidate because project 04a470c1b4c84ab0b390a417a13c5b89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:39:04.461634 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-26cb85f3-4258-4fa6-83f1-dc8427130103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:04.462429 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-26cb85f3-4258-4fa6-83f1-dc8427130103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:04.464146 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 936/1859] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:39:04 2022] DELETE /identity/v3/projects/04a470c1b4c84ab0b390a417a13c5b89 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:04.469057 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f3ed0-ae6c-401d-b97b-359acee4e550 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:04.469555 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f3ed0-ae6c-401d-b97b-359acee4e550 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:04.469780 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f3ed0-ae6c-401d-b97b-359acee4e550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:04.493794 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-179f3ed0-ae6c-401d-b97b-359acee4e550 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:04.495257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-179f3ed0-ae6c-401d-b97b-359acee4e550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:04.563798 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 924/1860] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:04.572699 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd25ada-3a38-4695-bcd3-544b4ed24aec None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:04.572992 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd25ada-3a38-4695-bcd3-544b4ed24aec None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:04.573283 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd25ada-3a38-4695-bcd3-544b4ed24aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:04.594510 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-edd25ada-3a38-4695-bcd3-544b4ed24aec None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:04.596224 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-edd25ada-3a38-4695-bcd3-544b4ed24aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:04.607090 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 937/1861] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:04.612444 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f3ed0-ae6c-401d-b97b-359acee4e550 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:04.624068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f3ed0-ae6c-401d-b97b-359acee4e550 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:04.627049 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edc836-69b8-46be-af0e-ce6f55f5bf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:04.627656 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edc836-69b8-46be-af0e-ce6f55f5bf95 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:04.627933 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edc836-69b8-46be-af0e-ce6f55f5bf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:04.628206 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edc836-69b8-46be-af0e-ce6f55f5bf95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:04.628857 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31edc836-69b8-46be-af0e-ce6f55f5bf95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:04.629155 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31edc836-69b8-46be-af0e-ce6f55f5bf95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:04.630787 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31edc836-69b8-46be-af0e-ce6f55f5bf95 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:04.643079 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 925/1862] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:04.648279 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd25ada-3a38-4695-bcd3-544b4ed24aec None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:04.657816 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd25ada-3a38-4695-bcd3-544b4ed24aec None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:04.663920 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac276d45-244c-4f8b-a70f-7c6b585f4316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:04.664597 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac276d45-244c-4f8b-a70f-7c6b585f4316 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:04.664874 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac276d45-244c-4f8b-a70f-7c6b585f4316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:04.665149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac276d45-244c-4f8b-a70f-7c6b585f4316 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:04.665978 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac276d45-244c-4f8b-a70f-7c6b585f4316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:04.668047 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac276d45-244c-4f8b-a70f-7c6b585f4316 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:04.755496 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 938/1863] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:39:04 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:04.759792 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edc836-69b8-46be-af0e-ce6f55f5bf95 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:04.775550 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edc836-69b8-46be-af0e-ce6f55f5bf95 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:04.848941 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbc81d-b760-4a71-a62d-c53103b17060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:04.849862 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbc81d-b760-4a71-a62d-c53103b17060 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:04.850222 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbc81d-b760-4a71-a62d-c53103b17060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:04.851182 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbc81d-b760-4a71-a62d-c53103b17060 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:04.852198 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcbc81d-b760-4a71-a62d-c53103b17060 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:04.854787 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcbc81d-b760-4a71-a62d-c53103b17060 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:04.973956 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 926/1864] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:39:04 2022] POST /identity/v3/users => generated 282 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:04.981144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac276d45-244c-4f8b-a70f-7c6b585f4316 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:04.992353 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac276d45-244c-4f8b-a70f-7c6b585f4316 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:04.998492 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fe377-4226-41bc-bce1-b989f067942a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:04.999228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fe377-4226-41bc-bce1-b989f067942a admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:04.999570 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fe377-4226-41bc-bce1-b989f067942a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:05.002152 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fe377-4226-41bc-bce1-b989f067942a admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:05.003268 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fe377-4226-41bc-bce1-b989f067942a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:05.005091 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fe377-4226-41bc-bce1-b989f067942a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:05.019887 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 939/1865] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:05.023749 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbc81d-b760-4a71-a62d-c53103b17060 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:05.035163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbc81d-b760-4a71-a62d-c53103b17060 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:05.040353 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5a7f4-07f7-4c90-99d0-fedd1b2489be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:05.040957 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5a7f4-07f7-4c90-99d0-fedd1b2489be admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:05.041241 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5a7f4-07f7-4c90-99d0-fedd1b2489be admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:05.041515 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5a7f4-07f7-4c90-99d0-fedd1b2489be admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:05.042191 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5a7f4-07f7-4c90-99d0-fedd1b2489be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:05.043782 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5a7f4-07f7-4c90-99d0-fedd1b2489be admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:05.055436 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 927/1866] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:05.075110 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fe377-4226-41bc-bce1-b989f067942a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:05.092660 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fe377-4226-41bc-bce1-b989f067942a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:05.100729 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21bcdef-b80a-4532-bff0-255c913dbf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:05.101410 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bcdef-b80a-4532-bff0-255c913dbf7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:05.101690 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bcdef-b80a-4532-bff0-255c913dbf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:05.102001 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bcdef-b80a-4532-bff0-255c913dbf7e admin admin] PATH_INFO: `/v3/projects/af8056a8427d4147b38dbd147d59c777/users/d0eca7a4531c43efa659da2739682c50/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:05.119723 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21bcdef-b80a-4532-bff0-255c913dbf7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=af8056a8427d4147b38dbd147d59c777, user_id=d0eca7a4531c43efa659da2739682c50, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:05.122545 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21bcdef-b80a-4532-bff0-255c913dbf7e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:05.192634 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5a7f4-07f7-4c90-99d0-fedd1b2489be admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:05.194599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9bd5a7f4-07f7-4c90-99d0-fedd1b2489be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:05.211467 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5a7f4-07f7-4c90-99d0-fedd1b2489be admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:05.212626 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 940/1867] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:05 2022] PUT /identity/v3/projects/af8056a8427d4147b38dbd147d59c777/users/d0eca7a4531c43efa659da2739682c50/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:05.230612 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfffa6a-f832-4563-a558-cca0a3822435 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:05.230946 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfffa6a-f832-4563-a558-cca0a3822435 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:05.231260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfffa6a-f832-4563-a558-cca0a3822435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:05.266123 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:05.268162 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-abfffa6a-f832-4563-a558-cca0a3822435 None None] MFA Rules not processed for user `d0eca7a4531c43efa659da2739682c50`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:05.269453 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-abfffa6a-f832-4563-a558-cca0a3822435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:05.311781 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba65e1f-f924-40f4-a291-ed91f52a1167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:05.312566 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba65e1f-f924-40f4-a291-ed91f52a1167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:05.312924 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba65e1f-f924-40f4-a291-ed91f52a1167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:05.313439 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba65e1f-f924-40f4-a291-ed91f52a1167 admin admin] PATH_INFO: `/v3/users/e22348b155264c26a9a445c7e949d88c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:05.315084 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba65e1f-f924-40f4-a291-ed91f52a1167 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e22348b155264c26a9a445c7e949d88c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:05.317159 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba65e1f-f924-40f4-a291-ed91f52a1167 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:05.338746 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 941/1868] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:05.343245 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfffa6a-f832-4563-a558-cca0a3822435 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:05.354079 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfffa6a-f832-4563-a558-cca0a3822435 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:05.358926 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e2ac8-aa85-4e6b-ad22-7063d4cf303f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:05.359515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e2ac8-aa85-4e6b-ad22-7063d4cf303f admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:05.359821 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e2ac8-aa85-4e6b-ad22-7063d4cf303f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:05.360092 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e2ac8-aa85-4e6b-ad22-7063d4cf303f admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:05.360707 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e2ac8-aa85-4e6b-ad22-7063d4cf303f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:05.362764 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e2ac8-aa85-4e6b-ad22-7063d4cf303f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:05.473539 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 942/1869] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:39:05 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:39:05.477428 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e2ac8-aa85-4e6b-ad22-7063d4cf303f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:05.512155 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2ba65e1f-f924-40f4-a291-ed91f52a1167 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e22348b155264c26a9a445c7e949d88c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:05.512752 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2ba65e1f-f924-40f4-a291-ed91f52a1167 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e22348b155264c26a9a445c7e949d88c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:05.527341 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2ba65e1f-f924-40f4-a291-ed91f52a1167 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e22348b155264c26a9a445c7e949d88c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:05.528062 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2ba65e1f-f924-40f4-a291-ed91f52a1167 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e22348b155264c26a9a445c7e949d88c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:05.535853 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:05.547337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e2ac8-aa85-4e6b-ad22-7063d4cf303f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:05.553496 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4baee0-6e76-4b45-8158-ae9a693db443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:05.554306 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4baee0-6e76-4b45-8158-ae9a693db443 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:05.554657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4baee0-6e76-4b45-8158-ae9a693db443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:05.554994 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4baee0-6e76-4b45-8158-ae9a693db443 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:05.555879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4baee0-6e76-4b45-8158-ae9a693db443 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:05.558504 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4baee0-6e76-4b45-8158-ae9a693db443 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:05.600843 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2ba65e1f-f924-40f4-a291-ed91f52a1167 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e22348b155264c26a9a445c7e949d88c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:05.617216 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 928/1870] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:39:05 2022] DELETE /identity/v3/users/e22348b155264c26a9a445c7e949d88c => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:39:05.621246 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb9c85-6aed-47ed-bcc3-a924c56edaa2 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:05.621548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb9c85-6aed-47ed-bcc3-a924c56edaa2 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:05.621858 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb9c85-6aed-47ed-bcc3-a924c56edaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:05.641876 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-5deb9c85-6aed-47ed-bcc3-a924c56edaa2 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:05.643571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-5deb9c85-6aed-47ed-bcc3-a924c56edaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:05.675720 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 943/1871] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:39:05 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:05.679639 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4baee0-6e76-4b45-8158-ae9a693db443 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:05.681295 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6a4baee0-6e76-4b45-8158-ae9a693db443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:05.694335 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4baee0-6e76-4b45-8158-ae9a693db443 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:05.706810 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 929/1872] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:39:05.722283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb9c85-6aed-47ed-bcc3-a924c56edaa2 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:05.723731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-5deb9c85-6aed-47ed-bcc3-a924c56edaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:05.773272 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc22a0a-b4cb-4be3-b00c-ecb5bcc9e6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:05.773962 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc22a0a-b4cb-4be3-b00c-ecb5bcc9e6ce admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:05.774301 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc22a0a-b4cb-4be3-b00c-ecb5bcc9e6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:05.774696 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc22a0a-b4cb-4be3-b00c-ecb5bcc9e6ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:05.775385 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc22a0a-b4cb-4be3-b00c-ecb5bcc9e6ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:05.777089 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc22a0a-b4cb-4be3-b00c-ecb5bcc9e6ce admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:05.788696 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 944/1873] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:39:05.792653 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc22a0a-b4cb-4be3-b00c-ecb5bcc9e6ce admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:05.796456 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb9c85-6aed-47ed-bcc3-a924c56edaa2 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:05.803698 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8a0fa-2f53-474c-a901-ed72770c4980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:05.803894 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc22a0a-b4cb-4be3-b00c-ecb5bcc9e6ce admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:05.804593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8a0fa-2f53-474c-a901-ed72770c4980 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:05.804945 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8a0fa-2f53-474c-a901-ed72770c4980 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:05.805340 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8a0fa-2f53-474c-a901-ed72770c4980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:05.809116 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161221f8-332e-4c9a-9833-2663d7f7430d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:05.809817 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161221f8-332e-4c9a-9833-2663d7f7430d admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:05.810099 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161221f8-332e-4c9a-9833-2663d7f7430d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:05.810373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161221f8-332e-4c9a-9833-2663d7f7430d admin admin] PATH_INFO: `/v3/projects/ba8e67acfef2450cb3e77c1732683b96/users/df940dad52ca49949a1e397f4e7a3757/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:05.817104 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:05.819811 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8a0fa-2f53-474c-a901-ed72770c4980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:05.821628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8a0fa-2f53-474c-a901-ed72770c4980 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:05.827393 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161221f8-332e-4c9a-9833-2663d7f7430d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba8e67acfef2450cb3e77c1732683b96, user_id=df940dad52ca49949a1e397f4e7a3757, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:05.838019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161221f8-332e-4c9a-9833-2663d7f7430d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:05.838157 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 930/1874] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:39:05.915333 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 945/1875] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:05 2022] PUT /identity/v3/projects/ba8e67acfef2450cb3e77c1732683b96/users/df940dad52ca49949a1e397f4e7a3757/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:39:05.919360 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8a0fa-2f53-474c-a901-ed72770c4980 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:05.932245 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8a0fa-2f53-474c-a901-ed72770c4980 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:05.989194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd434c1-32fa-456d-9d7f-9e0ebe2ec269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:05.989837 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd434c1-32fa-456d-9d7f-9e0ebe2ec269 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:05.990116 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd434c1-32fa-456d-9d7f-9e0ebe2ec269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:05.990388 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd434c1-32fa-456d-9d7f-9e0ebe2ec269 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:05.991197 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd434c1-32fa-456d-9d7f-9e0ebe2ec269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:05.992813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd434c1-32fa-456d-9d7f-9e0ebe2ec269 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:06.018845 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 931/1876] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:39:06.023645 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161221f8-332e-4c9a-9833-2663d7f7430d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:06.044034 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161221f8-332e-4c9a-9833-2663d7f7430d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:06.053940 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17b70a-8873-4b08-a512-5e4b229db108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:06.054925 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17b70a-8873-4b08-a512-5e4b229db108 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:06.055203 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17b70a-8873-4b08-a512-5e4b229db108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:06.055657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17b70a-8873-4b08-a512-5e4b229db108 admin admin] PATH_INFO: `/v3/projects/ba8e67acfef2450cb3e77c1732683b96/users/df940dad52ca49949a1e397f4e7a3757/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:06.057853 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f17b70a-8873-4b08-a512-5e4b229db108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba8e67acfef2450cb3e77c1732683b96, user_id=df940dad52ca49949a1e397f4e7a3757, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:06.069185 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f17b70a-8873-4b08-a512-5e4b229db108 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:06.083536 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 946/1877] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:06 2022] PUT /identity/v3/projects/ba8e67acfef2450cb3e77c1732683b96/users/df940dad52ca49949a1e397f4e7a3757/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:39:06.094421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ae454-558d-45f0-9b27-75ce938174df None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:06.094803 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ae454-558d-45f0-9b27-75ce938174df None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:06.095154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ae454-558d-45f0-9b27-75ce938174df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:06.136313 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ae3ae454-558d-45f0-9b27-75ce938174df None None] MFA Rules not processed for user `df940dad52ca49949a1e397f4e7a3757`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:06.137546 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ae3ae454-558d-45f0-9b27-75ce938174df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:06.233889 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 932/1878] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:06.253281 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17b70a-8873-4b08-a512-5e4b229db108 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:06.263397 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ae454-558d-45f0-9b27-75ce938174df None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:06.264637 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0f17b70a-8873-4b08-a512-5e4b229db108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:06.269404 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ae3ae454-558d-45f0-9b27-75ce938174df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:06.358120 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ae454-558d-45f0-9b27-75ce938174df None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:06.362937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bbbf7-9ec8-4de2-bac4-2c9419b7e324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:06.363663 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bbbf7-9ec8-4de2-bac4-2c9419b7e324 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:06.364056 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bbbf7-9ec8-4de2-bac4-2c9419b7e324 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:06.364424 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bbbf7-9ec8-4de2-bac4-2c9419b7e324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:06.375867 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46bbbf7-9ec8-4de2-bac4-2c9419b7e324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:06.377536 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46bbbf7-9ec8-4de2-bac4-2c9419b7e324 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:06.384206 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17b70a-8873-4b08-a512-5e4b229db108 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:06.388989 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 933/1879] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:06 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:39:06.389112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5cdbb-4b63-4d31-be59-94f41f8d9f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:06.389864 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5cdbb-4b63-4d31-be59-94f41f8d9f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:06.390243 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5cdbb-4b63-4d31-be59-94f41f8d9f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:06.390628 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5cdbb-4b63-4d31-be59-94f41f8d9f98 admin admin] PATH_INFO: `/v3/projects/80e79faf48104047913efa55086fd39b` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:06.391811 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5cdbb-4b63-4d31-be59-94f41f8d9f98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80e79faf48104047913efa55086fd39b)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:06.395018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5cdbb-4b63-4d31-be59-94f41f8d9f98 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:06.519931 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:06.525900 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-98d5cdbb-4b63-4d31-be59-94f41f8d9f98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80e79faf48104047913efa55086fd39b', 'request_id': 'req-98d5cdbb-4b63-4d31-be59-94f41f8d9f98'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:06.598372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bbbf7-9ec8-4de2-bac4-2c9419b7e324 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:06.600010 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c46bbbf7-9ec8-4de2-bac4-2c9419b7e324 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:06.603289 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-98d5cdbb-4b63-4d31-be59-94f41f8d9f98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80e79faf48104047913efa55086fd39b', 'request_id': 'req-98d5cdbb-4b63-4d31-be59-94f41f8d9f98'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:06.611083 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-98d5cdbb-4b63-4d31-be59-94f41f8d9f98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80e79faf48104047913efa55086fd39b', 'request_id': 'req-98d5cdbb-4b63-4d31-be59-94f41f8d9f98'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:06.612899 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bbbf7-9ec8-4de2-bac4-2c9419b7e324 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:06.634603 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-98d5cdbb-4b63-4d31-be59-94f41f8d9f98 admin admin] The token cache is being invalidate because project 80e79faf48104047913efa55086fd39b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:39:06.635021 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-98d5cdbb-4b63-4d31-be59-94f41f8d9f98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:06.635737 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-98d5cdbb-4b63-4d31-be59-94f41f8d9f98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:06.637250 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 947/1880] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:39:06 2022] DELETE /identity/v3/projects/80e79faf48104047913efa55086fd39b => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:06.638651 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:06.643728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5cdbb-4b63-4d31-be59-94f41f8d9f98 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:06.645245 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-98d5cdbb-4b63-4d31-be59-94f41f8d9f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:06.673489 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a79e2-64ba-4dd3-844d-fb3eff5ca810 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:06.674691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a79e2-64ba-4dd3-844d-fb3eff5ca810 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:06.674936 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a79e2-64ba-4dd3-844d-fb3eff5ca810 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:06.675381 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a79e2-64ba-4dd3-844d-fb3eff5ca810 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:06.677545 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a77a79e2-64ba-4dd3-844d-fb3eff5ca810 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:06.713799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5cdbb-4b63-4d31-be59-94f41f8d9f98 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:06.719114 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497075eb-2ca3-4e93-950d-ca74b3053cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:06.719757 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497075eb-2ca3-4e93-950d-ca74b3053cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:06.720036 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497075eb-2ca3-4e93-950d-ca74b3053cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:06.720334 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497075eb-2ca3-4e93-950d-ca74b3053cb6 admin admin] PATH_INFO: `/v3/users/07024492414f4f61b9daa919d29ad900` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:06.721848 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497075eb-2ca3-4e93-950d-ca74b3053cb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07024492414f4f61b9daa919d29ad900)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:06.723793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497075eb-2ca3-4e93-950d-ca74b3053cb6 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:06.739757 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a79e2-64ba-4dd3-844d-fb3eff5ca810 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:06.741305 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a79e2-64ba-4dd3-844d-fb3eff5ca810 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:06.750674 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 934/1881] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:39:06.931223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-497075eb-2ca3-4e93-950d-ca74b3053cb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07024492414f4f61b9daa919d29ad900'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:06.931855 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-497075eb-2ca3-4e93-950d-ca74b3053cb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07024492414f4f61b9daa919d29ad900'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:06.932518 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-497075eb-2ca3-4e93-950d-ca74b3053cb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07024492414f4f61b9daa919d29ad900'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:06.945175 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-497075eb-2ca3-4e93-950d-ca74b3053cb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07024492414f4f61b9daa919d29ad900'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:07.042866 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-497075eb-2ca3-4e93-950d-ca74b3053cb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07024492414f4f61b9daa919d29ad900'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:07.055441 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 948/1882] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:39:06 2022] DELETE /identity/v3/users/07024492414f4f61b9daa919d29ad900 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:39:08.032605 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a79e2-64ba-4dd3-844d-fb3eff5ca810 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:08.048193 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a79e2-64ba-4dd3-844d-fb3eff5ca810 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:08.110527 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519caba-07a2-4f40-889d-285cbe4631d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:08.112145 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519caba-07a2-4f40-889d-285cbe4631d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:08.112443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519caba-07a2-4f40-889d-285cbe4631d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:08.112720 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519caba-07a2-4f40-889d-285cbe4631d1 admin admin] PATH_INFO: `/v3/projects/39df97f13e6d41cdb732d35b2b12cedb` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:08.114067 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519caba-07a2-4f40-889d-285cbe4631d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39df97f13e6d41cdb732d35b2b12cedb)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:08.117506 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519caba-07a2-4f40-889d-285cbe4631d1 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:08.223383 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a519caba-07a2-4f40-889d-285cbe4631d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39df97f13e6d41cdb732d35b2b12cedb', 'request_id': 'req-a519caba-07a2-4f40-889d-285cbe4631d1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:08.306640 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a519caba-07a2-4f40-889d-285cbe4631d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39df97f13e6d41cdb732d35b2b12cedb', 'request_id': 'req-a519caba-07a2-4f40-889d-285cbe4631d1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:08.314893 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a519caba-07a2-4f40-889d-285cbe4631d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39df97f13e6d41cdb732d35b2b12cedb', 'request_id': 'req-a519caba-07a2-4f40-889d-285cbe4631d1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:08.326620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a519caba-07a2-4f40-889d-285cbe4631d1 admin admin] The token cache is being invalidate because project 39df97f13e6d41cdb732d35b2b12cedb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:39:08.328331 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a519caba-07a2-4f40-889d-285cbe4631d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:08.328331 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a519caba-07a2-4f40-889d-285cbe4631d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:08.335947 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 935/1883] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:39:08 2022] DELETE /identity/v3/projects/39df97f13e6d41cdb732d35b2b12cedb => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:08.342132 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43a78c-149a-444b-86fa-895423088b28 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:08.342607 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43a78c-149a-444b-86fa-895423088b28 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:08.342868 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43a78c-149a-444b-86fa-895423088b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:08.365353 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-7a43a78c-149a-444b-86fa-895423088b28 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:08.366564 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7a43a78c-149a-444b-86fa-895423088b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:08.421442 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:08.434566 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 949/1884] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:39:08.443043 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63e1ac-6d5f-44a5-8009-9086ad4b6509 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:08.445225 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63e1ac-6d5f-44a5-8009-9086ad4b6509 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:08.445225 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63e1ac-6d5f-44a5-8009-9086ad4b6509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:08.452269 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:08.463953 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-7d63e1ac-6d5f-44a5-8009-9086ad4b6509 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:08.466065 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-7d63e1ac-6d5f-44a5-8009-9086ad4b6509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:08.474609 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 936/1885] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:08.478935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43a78c-149a-444b-86fa-895423088b28 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:08.489331 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43a78c-149a-444b-86fa-895423088b28 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:08.494045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44ca5b-0831-46fc-ae77-eae8c1413f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:08.494648 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44ca5b-0831-46fc-ae77-eae8c1413f8b admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:08.494926 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44ca5b-0831-46fc-ae77-eae8c1413f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:08.495197 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44ca5b-0831-46fc-ae77-eae8c1413f8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:08.495843 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44ca5b-0831-46fc-ae77-eae8c1413f8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:08.496145 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44ca5b-0831-46fc-ae77-eae8c1413f8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:08.497777 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44ca5b-0831-46fc-ae77-eae8c1413f8b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:08.510674 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 950/1886] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:08.514592 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63e1ac-6d5f-44a5-8009-9086ad4b6509 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:08.525159 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63e1ac-6d5f-44a5-8009-9086ad4b6509 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:08.529840 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec682464-4d99-4270-9179-94fc616d846c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:08.530496 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec682464-4d99-4270-9179-94fc616d846c admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:08.530775 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec682464-4d99-4270-9179-94fc616d846c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:08.531042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec682464-4d99-4270-9179-94fc616d846c admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:08.531674 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec682464-4d99-4270-9179-94fc616d846c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:08.534061 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec682464-4d99-4270-9179-94fc616d846c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:08.649812 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 937/1887] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:39:08 2022] POST /identity/v3/projects => generated 367 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:08.654068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44ca5b-0831-46fc-ae77-eae8c1413f8b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:08.665228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44ca5b-0831-46fc-ae77-eae8c1413f8b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:08.753277 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1cb92-4584-473c-8a18-fed3437078a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:08.754180 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1cb92-4584-473c-8a18-fed3437078a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:08.754827 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1cb92-4584-473c-8a18-fed3437078a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:08.755120 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1cb92-4584-473c-8a18-fed3437078a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:08.756047 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1cb92-4584-473c-8a18-fed3437078a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:08.758541 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1cb92-4584-473c-8a18-fed3437078a4 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:08.893108 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 951/1888] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:39:08 2022] POST /identity/v3/users => generated 284 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:08.897464 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec682464-4d99-4270-9179-94fc616d846c admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:08.908901 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec682464-4d99-4270-9179-94fc616d846c admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:08.917369 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769b8bc-c1d2-45fe-9094-7fdd6f2f526d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:08.930801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769b8bc-c1d2-45fe-9094-7fdd6f2f526d admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:08.930801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769b8bc-c1d2-45fe-9094-7fdd6f2f526d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:08.930801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769b8bc-c1d2-45fe-9094-7fdd6f2f526d admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:08.930801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769b8bc-c1d2-45fe-9094-7fdd6f2f526d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:08.930801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769b8bc-c1d2-45fe-9094-7fdd6f2f526d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:08.936418 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 938/1889] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:08.937683 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1cb92-4584-473c-8a18-fed3437078a4 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:08.948591 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1cb92-4584-473c-8a18-fed3437078a4 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:08.953514 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44901bdf-83ca-4ab8-84d8-4c57bff39bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:08.954726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44901bdf-83ca-4ab8-84d8-4c57bff39bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:08.954726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44901bdf-83ca-4ab8-84d8-4c57bff39bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:08.956282 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44901bdf-83ca-4ab8-84d8-4c57bff39bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:08.957011 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44901bdf-83ca-4ab8-84d8-4c57bff39bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:08.958679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44901bdf-83ca-4ab8-84d8-4c57bff39bb0 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:08.971312 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 952/1890] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:08.975532 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769b8bc-c1d2-45fe-9094-7fdd6f2f526d admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:08.987286 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769b8bc-c1d2-45fe-9094-7fdd6f2f526d admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:08.992105 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5659b-5375-4cf0-899d-6f63f78811e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:08.992759 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5659b-5375-4cf0-899d-6f63f78811e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:08.993039 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5659b-5375-4cf0-899d-6f63f78811e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:08.993618 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5659b-5375-4cf0-899d-6f63f78811e2 admin admin] PATH_INFO: `/v3/projects/9774adee07ae419f94e6c0b4c5e005c7/users/f96c3ea910d74cd3a1034c36e0ce3817/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:09.019842 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5659b-5375-4cf0-899d-6f63f78811e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9774adee07ae419f94e6c0b4c5e005c7, user_id=f96c3ea910d74cd3a1034c36e0ce3817, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:09.022559 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5659b-5375-4cf0-899d-6f63f78811e2 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:09.136265 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 939/1891] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:08 2022] PUT /identity/v3/projects/9774adee07ae419f94e6c0b4c5e005c7/users/f96c3ea910d74cd3a1034c36e0ce3817/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:09.149882 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa276766-9229-46ae-ab71-2f5d8b8bdb3f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:09.149882 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa276766-9229-46ae-ab71-2f5d8b8bdb3f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:09.149882 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa276766-9229-46ae-ab71-2f5d8b8bdb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:09.232644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-aa276766-9229-46ae-ab71-2f5d8b8bdb3f None None] MFA Rules not processed for user `f96c3ea910d74cd3a1034c36e0ce3817`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:09.235582 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-aa276766-9229-46ae-ab71-2f5d8b8bdb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:09.359629 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 953/1892] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:09.365421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5659b-5375-4cf0-899d-6f63f78811e2 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:09.430265 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5659b-5375-4cf0-899d-6f63f78811e2 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:09.435127 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170fc7a-bc72-40bd-ae44-c0593e203a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:09.435736 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170fc7a-bc72-40bd-ae44-c0593e203a76 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:09.436045 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170fc7a-bc72-40bd-ae44-c0593e203a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:09.436324 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170fc7a-bc72-40bd-ae44-c0593e203a76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:09.436952 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7170fc7a-bc72-40bd-ae44-c0593e203a76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:09.438909 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7170fc7a-bc72-40bd-ae44-c0593e203a76 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:09.565115 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 940/1893] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:39:09 2022] POST /identity/v3/projects => generated 369 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:09.569616 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa276766-9229-46ae-ab71-2f5d8b8bdb3f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:09.580407 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa276766-9229-46ae-ab71-2f5d8b8bdb3f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:09.623711 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:09.644894 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2e7f7-60ef-4bb6-a3f3-c455047f3398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:09.645665 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2e7f7-60ef-4bb6-a3f3-c455047f3398 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:09.646090 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2e7f7-60ef-4bb6-a3f3-c455047f3398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:09.646437 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2e7f7-60ef-4bb6-a3f3-c455047f3398 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:09.647311 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2e7f7-60ef-4bb6-a3f3-c455047f3398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:09.649272 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2e7f7-60ef-4bb6-a3f3-c455047f3398 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:09.778128 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170fc7a-bc72-40bd-ae44-c0593e203a76 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:09.780250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-7170fc7a-bc72-40bd-ae44-c0593e203a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:09.795632 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170fc7a-bc72-40bd-ae44-c0593e203a76 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:09.802822 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335a2b0-3154-4545-a267-55a8878bb696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:09.803470 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335a2b0-3154-4545-a267-55a8878bb696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:09.812986 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335a2b0-3154-4545-a267-55a8878bb696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:09.812986 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335a2b0-3154-4545-a267-55a8878bb696 admin admin] PATH_INFO: `/v3/users/8630c30478604680abf18a4c42ac5471` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:09.812986 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335a2b0-3154-4545-a267-55a8878bb696 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8630c30478604680abf18a4c42ac5471)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:09.812986 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335a2b0-3154-4545-a267-55a8878bb696 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:09.813588 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 954/1894] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:39:09 2022] POST /identity/v3/users => generated 291 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:39:09.816249 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2e7f7-60ef-4bb6-a3f3-c455047f3398 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:09.827040 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2e7f7-60ef-4bb6-a3f3-c455047f3398 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:09.832568 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c7b6f-f37d-410e-812d-ea701ff5827e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:09.833264 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c7b6f-f37d-410e-812d-ea701ff5827e admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:09.844980 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c7b6f-f37d-410e-812d-ea701ff5827e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:09.844980 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c7b6f-f37d-410e-812d-ea701ff5827e admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:09.844980 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c7b6f-f37d-410e-812d-ea701ff5827e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:09.846652 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c7b6f-f37d-410e-812d-ea701ff5827e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:09.860295 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 955/1895] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:09.865508 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c7b6f-f37d-410e-812d-ea701ff5827e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:09.879193 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c7b6f-f37d-410e-812d-ea701ff5827e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:09.885227 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6dc97-3c3e-43de-a489-aa3d7c5d1e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:09.886031 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6dc97-3c3e-43de-a489-aa3d7c5d1e5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:09.886392 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6dc97-3c3e-43de-a489-aa3d7c5d1e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:09.886774 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6dc97-3c3e-43de-a489-aa3d7c5d1e5c admin admin] PATH_INFO: `/v3/projects/61889178174e4082b6916b3d5f3befec/users/4a148f26f27b4892aa4b9a492805567c/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:09.905642 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6dc97-3c3e-43de-a489-aa3d7c5d1e5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=61889178174e4082b6916b3d5f3befec, user_id=4a148f26f27b4892aa4b9a492805567c, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:09.909484 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6dc97-3c3e-43de-a489-aa3d7c5d1e5c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:10.021220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 956/1896] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:09 2022] PUT /identity/v3/projects/61889178174e4082b6916b3d5f3befec/users/4a148f26f27b4892aa4b9a492805567c/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:10.037409 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6dc97-3c3e-43de-a489-aa3d7c5d1e5c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:10.043718 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e335a2b0-3154-4545-a267-55a8878bb696 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8630c30478604680abf18a4c42ac5471'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:10.045400 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e335a2b0-3154-4545-a267-55a8878bb696 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8630c30478604680abf18a4c42ac5471'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:10.061543 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e335a2b0-3154-4545-a267-55a8878bb696 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8630c30478604680abf18a4c42ac5471'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:10.062722 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e335a2b0-3154-4545-a267-55a8878bb696 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8630c30478604680abf18a4c42ac5471'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:10.110709 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6dc97-3c3e-43de-a489-aa3d7c5d1e5c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:10.117046 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe1ea8-ede1-4331-9a02-a777284dd112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:10.117596 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe1ea8-ede1-4331-9a02-a777284dd112 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:10.117909 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe1ea8-ede1-4331-9a02-a777284dd112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:10.118184 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe1ea8-ede1-4331-9a02-a777284dd112 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:10.118835 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe1ea8-ede1-4331-9a02-a777284dd112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:10.120433 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe1ea8-ede1-4331-9a02-a777284dd112 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:10.131535 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 957/1897] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:10.135742 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe1ea8-ede1-4331-9a02-a777284dd112 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:10.137479 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-66fe1ea8-ede1-4331-9a02-a777284dd112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:10.150812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe1ea8-ede1-4331-9a02-a777284dd112 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:10.155598 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8d0f2-ded5-44e2-b5d9-f1989649e370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:10.157388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8d0f2-ded5-44e2-b5d9-f1989649e370 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:10.157388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8d0f2-ded5-44e2-b5d9-f1989649e370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:10.157388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8d0f2-ded5-44e2-b5d9-f1989649e370 admin admin] PATH_INFO: `/v3/projects/61889178174e4082b6916b3d5f3befec/users/4a148f26f27b4892aa4b9a492805567c/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:10.157681 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e335a2b0-3154-4545-a267-55a8878bb696 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8630c30478604680abf18a4c42ac5471'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:10.159468 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8d0f2-ded5-44e2-b5d9-f1989649e370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61889178174e4082b6916b3d5f3befec, user_id=4a148f26f27b4892aa4b9a492805567c, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:10.162974 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8d0f2-ded5-44e2-b5d9-f1989649e370 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:10.168565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:10.174562 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 941/1898] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:39:09 2022] DELETE /identity/v3/users/8630c30478604680abf18a4c42ac5471 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:10.174916 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 958/1899] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:10 2022] PUT /identity/v3/projects/61889178174e4082b6916b3d5f3befec/users/4a148f26f27b4892aa4b9a492805567c/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:39:10.179355 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b602f-6793-4b4c-a0b0-ff7fc2d54a8c None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:10.179696 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b602f-6793-4b4c-a0b0-ff7fc2d54a8c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:10.180325 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b602f-6793-4b4c-a0b0-ff7fc2d54a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:10.186557 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815633b2-71a2-4c77-8808-053b52e895cd None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:10.187932 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815633b2-71a2-4c77-8808-053b52e895cd None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:10.187932 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815633b2-71a2-4c77-8808-053b52e895cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:10.200028 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-3c6b602f-6793-4b4c-a0b0-ff7fc2d54a8c None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:10.201258 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3c6b602f-6793-4b4c-a0b0-ff7fc2d54a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:10.217420 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-815633b2-71a2-4c77-8808-053b52e895cd None None] MFA Rules not processed for user `4a148f26f27b4892aa4b9a492805567c`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:10.218963 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-815633b2-71a2-4c77-8808-053b52e895cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:10.281987 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 942/1900] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:10.293268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b602f-6793-4b4c-a0b0-ff7fc2d54a8c None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:10.294819 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3c6b602f-6793-4b4c-a0b0-ff7fc2d54a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:10.316447 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 959/1901] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:10 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:39:10.355480 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815633b2-71a2-4c77-8808-053b52e895cd None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:10.356347 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-815633b2-71a2-4c77-8808-053b52e895cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:10.369197 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:10.387517 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b602f-6793-4b4c-a0b0-ff7fc2d54a8c None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:10.395387 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdba387-5491-457e-8a3f-6ffc7fe268c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:10.396458 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdba387-5491-457e-8a3f-6ffc7fe268c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:10.397073 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdba387-5491-457e-8a3f-6ffc7fe268c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:10.397571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdba387-5491-457e-8a3f-6ffc7fe268c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:10.410049 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdba387-5491-457e-8a3f-6ffc7fe268c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:10.411761 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdba387-5491-457e-8a3f-6ffc7fe268c1 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:10.424070 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 943/1902] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:39:10.437288 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815633b2-71a2-4c77-8808-053b52e895cd None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:10.441552 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187a9d7-6e0b-4c52-88a9-8b97a3b5fff7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:10.441911 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187a9d7-6e0b-4c52-88a9-8b97a3b5fff7 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:10.442193 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187a9d7-6e0b-4c52-88a9-8b97a3b5fff7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:10.442721 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187a9d7-6e0b-4c52-88a9-8b97a3b5fff7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:10.452149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187a9d7-6e0b-4c52-88a9-8b97a3b5fff7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:10.453515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187a9d7-6e0b-4c52-88a9-8b97a3b5fff7 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:10.464503 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 960/1903] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:10 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:39:10.597448 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdba387-5491-457e-8a3f-6ffc7fe268c1 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:10.614662 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdba387-5491-457e-8a3f-6ffc7fe268c1 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:10.614662 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568c53f-0548-44cf-9030-9ffea0c579eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:10.614662 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568c53f-0548-44cf-9030-9ffea0c579eb service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:10.614986 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568c53f-0548-44cf-9030-9ffea0c579eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:10.614986 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568c53f-0548-44cf-9030-9ffea0c579eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:10.616795 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1568c53f-0548-44cf-9030-9ffea0c579eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:10.683488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568c53f-0548-44cf-9030-9ffea0c579eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:10.685127 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568c53f-0548-44cf-9030-9ffea0c579eb service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:10.695247 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 944/1904] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:39:11.054517 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187a9d7-6e0b-4c52-88a9-8b97a3b5fff7 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:11.056541 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5187a9d7-6e0b-4c52-88a9-8b97a3b5fff7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:11.076088 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187a9d7-6e0b-4c52-88a9-8b97a3b5fff7 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:11.083785 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff1866-2d43-460d-b1be-d800e4d69d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:11.084552 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff1866-2d43-460d-b1be-d800e4d69d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:11.084802 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff1866-2d43-460d-b1be-d800e4d69d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:11.085073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff1866-2d43-460d-b1be-d800e4d69d00 admin admin] PATH_INFO: `/v3/projects/1e00946f0f0f46808a02c51a8e0e7ffe` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:11.086258 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff1866-2d43-460d-b1be-d800e4d69d00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e00946f0f0f46808a02c51a8e0e7ffe)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:11.088189 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff1866-2d43-460d-b1be-d800e4d69d00 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:11.221560 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-00ff1866-2d43-460d-b1be-d800e4d69d00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e00946f0f0f46808a02c51a8e0e7ffe', 'request_id': 'req-00ff1866-2d43-460d-b1be-d800e4d69d00'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:11.314784 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-00ff1866-2d43-460d-b1be-d800e4d69d00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e00946f0f0f46808a02c51a8e0e7ffe', 'request_id': 'req-00ff1866-2d43-460d-b1be-d800e4d69d00'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:11.321991 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-00ff1866-2d43-460d-b1be-d800e4d69d00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e00946f0f0f46808a02c51a8e0e7ffe', 'request_id': 'req-00ff1866-2d43-460d-b1be-d800e4d69d00'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:11.333893 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-00ff1866-2d43-460d-b1be-d800e4d69d00 admin admin] The token cache is being invalidate because project 1e00946f0f0f46808a02c51a8e0e7ffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:39:11.334190 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-00ff1866-2d43-460d-b1be-d800e4d69d00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:11.334858 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-00ff1866-2d43-460d-b1be-d800e4d69d00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:11.336357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 961/1905] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:39:11 2022] DELETE /identity/v3/projects/1e00946f0f0f46808a02c51a8e0e7ffe => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:11.341275 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aff46e-fda6-441e-8866-5b2155ced51d None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:11.341733 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aff46e-fda6-441e-8866-5b2155ced51d None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:11.341906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aff46e-fda6-441e-8866-5b2155ced51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:11.363936 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-63aff46e-fda6-441e-8866-5b2155ced51d None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:11.365491 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-63aff46e-fda6-441e-8866-5b2155ced51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:11.400823 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:11.428962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 945/1906] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:11.436369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ab122-8335-4c2f-b3a9-8f84c253dc07 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:11.437030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ab122-8335-4c2f-b3a9-8f84c253dc07 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:11.437030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ab122-8335-4c2f-b3a9-8f84c253dc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:11.457412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e31ab122-8335-4c2f-b3a9-8f84c253dc07 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:11.465511 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e31ab122-8335-4c2f-b3a9-8f84c253dc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:11.467748 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 962/1907] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:11.472733 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aff46e-fda6-441e-8866-5b2155ced51d None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:11.482694 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aff46e-fda6-441e-8866-5b2155ced51d None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:11.488155 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc565806-35cf-4e4f-bff4-a12d08a2ddbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:11.488764 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc565806-35cf-4e4f-bff4-a12d08a2ddbe admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:11.489247 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc565806-35cf-4e4f-bff4-a12d08a2ddbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:11.489637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc565806-35cf-4e4f-bff4-a12d08a2ddbe admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:11.490331 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc565806-35cf-4e4f-bff4-a12d08a2ddbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:11.490637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc565806-35cf-4e4f-bff4-a12d08a2ddbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:11.492234 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc565806-35cf-4e4f-bff4-a12d08a2ddbe admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:11.504322 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 946/1908] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:11.508766 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ab122-8335-4c2f-b3a9-8f84c253dc07 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:11.518340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ab122-8335-4c2f-b3a9-8f84c253dc07 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:11.523149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dea166-9f3b-46f4-a09a-7acca3e62651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:11.523748 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dea166-9f3b-46f4-a09a-7acca3e62651 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:11.524031 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dea166-9f3b-46f4-a09a-7acca3e62651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:11.524306 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dea166-9f3b-46f4-a09a-7acca3e62651 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:11.524942 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dea166-9f3b-46f4-a09a-7acca3e62651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:11.526933 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dea166-9f3b-46f4-a09a-7acca3e62651 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:11.642682 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 963/1909] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:39:11 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:11.642850 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc565806-35cf-4e4f-bff4-a12d08a2ddbe admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:11.650950 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc565806-35cf-4e4f-bff4-a12d08a2ddbe admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:11.732831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605d25d-a837-4dea-a2c6-55cf664b211c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:11.733902 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605d25d-a837-4dea-a2c6-55cf664b211c admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:11.734304 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605d25d-a837-4dea-a2c6-55cf664b211c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:11.735747 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605d25d-a837-4dea-a2c6-55cf664b211c admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:11.737411 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3605d25d-a837-4dea-a2c6-55cf664b211c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:11.740238 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3605d25d-a837-4dea-a2c6-55cf664b211c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:11.825641 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 947/1910] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:39:11 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:11.829796 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dea166-9f3b-46f4-a09a-7acca3e62651 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:11.845016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dea166-9f3b-46f4-a09a-7acca3e62651 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:11.855124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15a07a-d06b-4b57-b289-1bb617d9887b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:11.856463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15a07a-d06b-4b57-b289-1bb617d9887b admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:11.857103 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15a07a-d06b-4b57-b289-1bb617d9887b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:11.858824 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15a07a-d06b-4b57-b289-1bb617d9887b admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:11.860097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15a07a-d06b-4b57-b289-1bb617d9887b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:11.864992 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15a07a-d06b-4b57-b289-1bb617d9887b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:11.914463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 964/1911] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:11.917206 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605d25d-a837-4dea-a2c6-55cf664b211c admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:11.931189 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605d25d-a837-4dea-a2c6-55cf664b211c admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:11.958974 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520504ea-7b8c-4339-8047-f40caab77ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:11.959466 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520504ea-7b8c-4339-8047-f40caab77ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:11.959902 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520504ea-7b8c-4339-8047-f40caab77ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:11.960200 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520504ea-7b8c-4339-8047-f40caab77ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:11.961933 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520504ea-7b8c-4339-8047-f40caab77ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:11.963189 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520504ea-7b8c-4339-8047-f40caab77ff2 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:11.993921 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 948/1912] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:11.994277 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15a07a-d06b-4b57-b289-1bb617d9887b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:12.008677 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15a07a-d06b-4b57-b289-1bb617d9887b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:12.016550 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced032e1-ef08-4d34-8402-f10b01ad2b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:12.019439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced032e1-ef08-4d34-8402-f10b01ad2b0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:12.019439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced032e1-ef08-4d34-8402-f10b01ad2b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:12.019439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced032e1-ef08-4d34-8402-f10b01ad2b0a admin admin] PATH_INFO: `/v3/projects/8182341de47443a3963e55dc7ba7dfec/users/d725cea276e1482c92276324611869ff/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:12.045211 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced032e1-ef08-4d34-8402-f10b01ad2b0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8182341de47443a3963e55dc7ba7dfec, user_id=d725cea276e1482c92276324611869ff, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:12.050599 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced032e1-ef08-4d34-8402-f10b01ad2b0a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:12.189703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 965/1913] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:11 2022] PUT /identity/v3/projects/8182341de47443a3963e55dc7ba7dfec/users/d725cea276e1482c92276324611869ff/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:39:12.201262 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f883c-b9ea-4470-b93b-9ea5d8150d6f None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:12.201545 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f883c-b9ea-4470-b93b-9ea5d8150d6f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:12.201852 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f883c-b9ea-4470-b93b-9ea5d8150d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:12.233567 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-767f883c-b9ea-4470-b93b-9ea5d8150d6f None None] MFA Rules not processed for user `d725cea276e1482c92276324611869ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:12.233567 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-767f883c-b9ea-4470-b93b-9ea5d8150d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:12.301457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 949/1914] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:12.414439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced032e1-ef08-4d34-8402-f10b01ad2b0a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:12.416422 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ced032e1-ef08-4d34-8402-f10b01ad2b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:12.452744 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:12.482399 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced032e1-ef08-4d34-8402-f10b01ad2b0a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:12.486389 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca6113-8887-44c8-93ab-a53634d1f01d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:12.486994 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca6113-8887-44c8-93ab-a53634d1f01d service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:12.487274 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca6113-8887-44c8-93ab-a53634d1f01d service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:12.487556 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca6113-8887-44c8-93ab-a53634d1f01d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:12.496322 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca6113-8887-44c8-93ab-a53634d1f01d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:12.497836 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca6113-8887-44c8-93ab-a53634d1f01d service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:12.507072 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 966/1915] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:39:12.534382 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f883c-b9ea-4470-b93b-9ea5d8150d6f None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:12.595390 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:12.668785 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f883c-b9ea-4470-b93b-9ea5d8150d6f None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:12.683678 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca76b3-dd0c-4a59-94eb-c8841b48fdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:12.684456 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca76b3-dd0c-4a59-94eb-c8841b48fdee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:12.684870 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca76b3-dd0c-4a59-94eb-c8841b48fdee admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:12.685561 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca76b3-dd0c-4a59-94eb-c8841b48fdee admin admin] PATH_INFO: `/v3/users/d725cea276e1482c92276324611869ff` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:12.692008 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca76b3-dd0c-4a59-94eb-c8841b48fdee admin admin] RBAC: Authorizing `identity:delete_user(user_id=d725cea276e1482c92276324611869ff)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:12.698010 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca76b3-dd0c-4a59-94eb-c8841b48fdee admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:13.077712 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-36ca76b3-dd0c-4a59-94eb-c8841b48fdee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd725cea276e1482c92276324611869ff'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:13.079392 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-36ca76b3-dd0c-4a59-94eb-c8841b48fdee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd725cea276e1482c92276324611869ff'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:13.097159 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-36ca76b3-dd0c-4a59-94eb-c8841b48fdee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd725cea276e1482c92276324611869ff'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:13.098238 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-36ca76b3-dd0c-4a59-94eb-c8841b48fdee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd725cea276e1482c92276324611869ff'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:13.219966 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-36ca76b3-dd0c-4a59-94eb-c8841b48fdee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd725cea276e1482c92276324611869ff'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:13.225670 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 950/1916] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:39:12 2022] DELETE /identity/v3/users/d725cea276e1482c92276324611869ff => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:13.230451 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85344a6-e471-4894-a16a-10bfe5906761 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:13.231141 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85344a6-e471-4894-a16a-10bfe5906761 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:13.231667 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85344a6-e471-4894-a16a-10bfe5906761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:13.251681 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d85344a6-e471-4894-a16a-10bfe5906761 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:13.252999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d85344a6-e471-4894-a16a-10bfe5906761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:13.322512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 967/1917] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:39:13.338397 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca76b3-dd0c-4a59-94eb-c8841b48fdee admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:13.339818 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-36ca76b3-dd0c-4a59-94eb-c8841b48fdee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:13.399223 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca76b3-dd0c-4a59-94eb-c8841b48fdee admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:13.402905 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ebf8b-dc8f-4013-8ae9-5ee988031482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:13.403509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ebf8b-dc8f-4013-8ae9-5ee988031482 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:13.403786 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ebf8b-dc8f-4013-8ae9-5ee988031482 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:13.404060 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ebf8b-dc8f-4013-8ae9-5ee988031482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:13.414829 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ebf8b-dc8f-4013-8ae9-5ee988031482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:13.416348 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ebf8b-dc8f-4013-8ae9-5ee988031482 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:13.426005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 951/1918] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:39:13.885892 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85344a6-e471-4894-a16a-10bfe5906761 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:13.887149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d85344a6-e471-4894-a16a-10bfe5906761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:13.903129 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85344a6-e471-4894-a16a-10bfe5906761 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:13.910846 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d1bb4-2b3b-4214-abce-69f050c47f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:13.911867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d1bb4-2b3b-4214-abce-69f050c47f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:13.912647 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d1bb4-2b3b-4214-abce-69f050c47f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:13.912923 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d1bb4-2b3b-4214-abce-69f050c47f32 admin admin] PATH_INFO: `/v3/projects/8182341de47443a3963e55dc7ba7dfec` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:13.914166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d1bb4-2b3b-4214-abce-69f050c47f32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8182341de47443a3963e55dc7ba7dfec)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:13.917166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d1bb4-2b3b-4214-abce-69f050c47f32 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:14.061909 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-da1d1bb4-2b3b-4214-abce-69f050c47f32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8182341de47443a3963e55dc7ba7dfec', 'request_id': 'req-da1d1bb4-2b3b-4214-abce-69f050c47f32'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:14.145607 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-da1d1bb4-2b3b-4214-abce-69f050c47f32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8182341de47443a3963e55dc7ba7dfec', 'request_id': 'req-da1d1bb4-2b3b-4214-abce-69f050c47f32'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:14.152400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-da1d1bb4-2b3b-4214-abce-69f050c47f32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8182341de47443a3963e55dc7ba7dfec', 'request_id': 'req-da1d1bb4-2b3b-4214-abce-69f050c47f32'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:14.164182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-da1d1bb4-2b3b-4214-abce-69f050c47f32 admin admin] The token cache is being invalidate because project 8182341de47443a3963e55dc7ba7dfec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:39:14.164182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-da1d1bb4-2b3b-4214-abce-69f050c47f32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:14.164491 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-da1d1bb4-2b3b-4214-abce-69f050c47f32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:14.166259 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 968/1919] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:39:13 2022] DELETE /identity/v3/projects/8182341de47443a3963e55dc7ba7dfec => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:14.171144 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd910fa-6620-4563-830d-f4b65bdf5f2b None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:14.171553 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd910fa-6620-4563-830d-f4b65bdf5f2b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:14.171553 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd910fa-6620-4563-830d-f4b65bdf5f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:14.191510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-efd910fa-6620-4563-830d-f4b65bdf5f2b None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:14.192740 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-efd910fa-6620-4563-830d-f4b65bdf5f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:14.253634 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:14.267104 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 952/1920] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:14.275537 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46845e-9cd9-4193-a27f-1a534cec60a0 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:14.275930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46845e-9cd9-4193-a27f-1a534cec60a0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:14.276274 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46845e-9cd9-4193-a27f-1a534cec60a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:14.297320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4b46845e-9cd9-4193-a27f-1a534cec60a0 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:14.298737 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4b46845e-9cd9-4193-a27f-1a534cec60a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:14.307081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 969/1921] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:14.311449 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd910fa-6620-4563-830d-f4b65bdf5f2b None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:14.322288 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd910fa-6620-4563-830d-f4b65bdf5f2b None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:14.328443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dad0da-d57d-408f-a399-beaf87396e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:14.328443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dad0da-d57d-408f-a399-beaf87396e3d admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:14.328443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dad0da-d57d-408f-a399-beaf87396e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:14.328894 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dad0da-d57d-408f-a399-beaf87396e3d admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:14.329677 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dad0da-d57d-408f-a399-beaf87396e3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:14.330677 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dad0da-d57d-408f-a399-beaf87396e3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:14.332527 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dad0da-d57d-408f-a399-beaf87396e3d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:14.350740 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 953/1922] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:14.351830 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46845e-9cd9-4193-a27f-1a534cec60a0 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:14.362174 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46845e-9cd9-4193-a27f-1a534cec60a0 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:14.367200 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908f29e-b3b9-4a23-8239-e8920b4a5c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:14.367599 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908f29e-b3b9-4a23-8239-e8920b4a5c43 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:14.367886 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908f29e-b3b9-4a23-8239-e8920b4a5c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:14.368169 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908f29e-b3b9-4a23-8239-e8920b4a5c43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:14.368815 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908f29e-b3b9-4a23-8239-e8920b4a5c43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:14.370769 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908f29e-b3b9-4a23-8239-e8920b4a5c43 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:14.484997 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 970/1923] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:39:14 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:14.487931 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dad0da-d57d-408f-a399-beaf87396e3d admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:14.498337 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dad0da-d57d-408f-a399-beaf87396e3d admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:14.555027 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e593f-fe2f-410d-a291-acf7ee47c4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:14.555635 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e593f-fe2f-410d-a291-acf7ee47c4e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:14.555916 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e593f-fe2f-410d-a291-acf7ee47c4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:14.556188 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e593f-fe2f-410d-a291-acf7ee47c4e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:14.556820 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e593f-fe2f-410d-a291-acf7ee47c4e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:14.558839 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e593f-fe2f-410d-a291-acf7ee47c4e4 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:14.650244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 954/1924] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:39:14 2022] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:14.655573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908f29e-b3b9-4a23-8239-e8920b4a5c43 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:14.668687 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908f29e-b3b9-4a23-8239-e8920b4a5c43 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:14.675472 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b8f9b-188d-4dc9-bec0-c5712167163f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:14.676088 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b8f9b-188d-4dc9-bec0-c5712167163f admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:14.676371 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b8f9b-188d-4dc9-bec0-c5712167163f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:14.676642 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b8f9b-188d-4dc9-bec0-c5712167163f admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:14.677296 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b8f9b-188d-4dc9-bec0-c5712167163f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:14.685329 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b8f9b-188d-4dc9-bec0-c5712167163f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:14.695117 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 971/1925] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:14.699308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e593f-fe2f-410d-a291-acf7ee47c4e4 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:14.710888 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e593f-fe2f-410d-a291-acf7ee47c4e4 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:14.715713 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c0446-09e9-4adc-aea3-57d7eac6a27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:14.716323 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c0446-09e9-4adc-aea3-57d7eac6a27a admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:14.716603 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c0446-09e9-4adc-aea3-57d7eac6a27a admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:14.716880 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c0446-09e9-4adc-aea3-57d7eac6a27a admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:14.717537 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c0446-09e9-4adc-aea3-57d7eac6a27a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:14.719166 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c0446-09e9-4adc-aea3-57d7eac6a27a admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:14.731010 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 955/1926] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:14.735372 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b8f9b-188d-4dc9-bec0-c5712167163f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:14.746254 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b8f9b-188d-4dc9-bec0-c5712167163f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:14.751865 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca081ad-7f0a-446d-bbbd-a3459ee991e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:14.752736 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca081ad-7f0a-446d-bbbd-a3459ee991e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:14.753081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca081ad-7f0a-446d-bbbd-a3459ee991e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:14.753417 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca081ad-7f0a-446d-bbbd-a3459ee991e1 admin admin] PATH_INFO: `/v3/projects/b0330cc9f998471681b4e57260731dea/users/4cfb8ca73c954b479d2c8cd8b6fa72b7/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:14.765877 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:14.771309 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca081ad-7f0a-446d-bbbd-a3459ee991e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0330cc9f998471681b4e57260731dea, user_id=4cfb8ca73c954b479d2c8cd8b6fa72b7, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:14.774912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca081ad-7f0a-446d-bbbd-a3459ee991e1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:14.903409 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 972/1927] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:14 2022] PUT /identity/v3/projects/b0330cc9f998471681b4e57260731dea/users/4cfb8ca73c954b479d2c8cd8b6fa72b7/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:14.914000 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ff1da-f57d-4a83-a1b4-eb6d47501874 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:14.914287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ff1da-f57d-4a83-a1b4-eb6d47501874 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:14.914563 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ff1da-f57d-4a83-a1b4-eb6d47501874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:14.945170 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-125ff1da-f57d-4a83-a1b4-eb6d47501874 None None] MFA Rules not processed for user `4cfb8ca73c954b479d2c8cd8b6fa72b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:14.946509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-125ff1da-f57d-4a83-a1b4-eb6d47501874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:15.030302 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 956/1928] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:15.042731 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca081ad-7f0a-446d-bbbd-a3459ee991e1 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:15.044421 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0ca081ad-7f0a-446d-bbbd-a3459ee991e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:15.103539 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca081ad-7f0a-446d-bbbd-a3459ee991e1 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:15.107376 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96289cad-bfac-4ca1-8fbe-b1967d5991ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:15.108232 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96289cad-bfac-4ca1-8fbe-b1967d5991ce service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:15.108509 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96289cad-bfac-4ca1-8fbe-b1967d5991ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:15.108773 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96289cad-bfac-4ca1-8fbe-b1967d5991ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:15.117853 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96289cad-bfac-4ca1-8fbe-b1967d5991ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:15.119260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96289cad-bfac-4ca1-8fbe-b1967d5991ce service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:15.128279 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 973/1929] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:39:16.125637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ff1da-f57d-4a83-a1b4-eb6d47501874 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:16.127117 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-125ff1da-f57d-4a83-a1b4-eb6d47501874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:16.180956 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:16.194205 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ff1da-f57d-4a83-a1b4-eb6d47501874 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:16.198824 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bf922-5c40-45e7-983b-ad2afdfcefff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:16.199483 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bf922-5c40-45e7-983b-ad2afdfcefff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:16.199763 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bf922-5c40-45e7-983b-ad2afdfcefff admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:16.200058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bf922-5c40-45e7-983b-ad2afdfcefff admin admin] PATH_INFO: `/v3/users/f96c3ea910d74cd3a1034c36e0ce3817` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:16.201362 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bf922-5c40-45e7-983b-ad2afdfcefff admin admin] RBAC: Authorizing `identity:delete_user(user_id=f96c3ea910d74cd3a1034c36e0ce3817)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:16.203307 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bf922-5c40-45e7-983b-ad2afdfcefff admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:16.430994 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-929bf922-5c40-45e7-983b-ad2afdfcefff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f96c3ea910d74cd3a1034c36e0ce3817'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:16.431560 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-929bf922-5c40-45e7-983b-ad2afdfcefff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f96c3ea910d74cd3a1034c36e0ce3817'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:16.443478 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-929bf922-5c40-45e7-983b-ad2afdfcefff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f96c3ea910d74cd3a1034c36e0ce3817'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:16.444120 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-929bf922-5c40-45e7-983b-ad2afdfcefff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f96c3ea910d74cd3a1034c36e0ce3817'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:16.516636 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-929bf922-5c40-45e7-983b-ad2afdfcefff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f96c3ea910d74cd3a1034c36e0ce3817'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:16.532323 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 957/1930] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:39:16 2022] DELETE /identity/v3/users/f96c3ea910d74cd3a1034c36e0ce3817 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:16.537163 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025d14c-980c-4334-a349-61a279104f54 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:16.537621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025d14c-980c-4334-a349-61a279104f54 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:16.537864 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025d14c-980c-4334-a349-61a279104f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:16.558658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-5025d14c-980c-4334-a349-61a279104f54 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:16.559905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5025d14c-980c-4334-a349-61a279104f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:16.620403 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 974/1931] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:39:16.630757 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bf922-5c40-45e7-983b-ad2afdfcefff admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:16.632539 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-929bf922-5c40-45e7-983b-ad2afdfcefff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:16.694761 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bf922-5c40-45e7-983b-ad2afdfcefff admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:16.698447 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7acca-f651-433b-9c8e-5cdf9696bfd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:16.699055 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7acca-f651-433b-9c8e-5cdf9696bfd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:16.699337 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7acca-f651-433b-9c8e-5cdf9696bfd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:16.699608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7acca-f651-433b-9c8e-5cdf9696bfd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:16.709531 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7acca-f651-433b-9c8e-5cdf9696bfd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:16.710998 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7acca-f651-433b-9c8e-5cdf9696bfd0 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:16.721527 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 958/1932] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:39:17.148585 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025d14c-980c-4334-a349-61a279104f54 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:17.150465 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5025d14c-980c-4334-a349-61a279104f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:17.165022 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025d14c-980c-4334-a349-61a279104f54 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:17.173014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73199b1-f691-4c7c-9ef4-b6f426549f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:17.173014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73199b1-f691-4c7c-9ef4-b6f426549f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:17.173014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73199b1-f691-4c7c-9ef4-b6f426549f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:17.173722 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73199b1-f691-4c7c-9ef4-b6f426549f5b admin admin] PATH_INFO: `/v3/projects/9774adee07ae419f94e6c0b4c5e005c7` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:17.174355 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73199b1-f691-4c7c-9ef4-b6f426549f5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9774adee07ae419f94e6c0b4c5e005c7)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:17.177665 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73199b1-f691-4c7c-9ef4-b6f426549f5b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:17.323094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f73199b1-f691-4c7c-9ef4-b6f426549f5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9774adee07ae419f94e6c0b4c5e005c7', 'request_id': 'req-f73199b1-f691-4c7c-9ef4-b6f426549f5b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:17.402502 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f73199b1-f691-4c7c-9ef4-b6f426549f5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9774adee07ae419f94e6c0b4c5e005c7', 'request_id': 'req-f73199b1-f691-4c7c-9ef4-b6f426549f5b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:17.409466 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f73199b1-f691-4c7c-9ef4-b6f426549f5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9774adee07ae419f94e6c0b4c5e005c7', 'request_id': 'req-f73199b1-f691-4c7c-9ef4-b6f426549f5b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:17.419840 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f73199b1-f691-4c7c-9ef4-b6f426549f5b admin admin] The token cache is being invalidate because project 9774adee07ae419f94e6c0b4c5e005c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:39:17.420122 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f73199b1-f691-4c7c-9ef4-b6f426549f5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:17.420811 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f73199b1-f691-4c7c-9ef4-b6f426549f5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:17.422359 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 975/1933] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:39:17 2022] DELETE /identity/v3/projects/9774adee07ae419f94e6c0b4c5e005c7 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:39:17.426816 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7acca-f651-433b-9c8e-5cdf9696bfd0 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:17.436730 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7acca-f651-433b-9c8e-5cdf9696bfd0 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:17.494926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357ee07-d910-4d9f-b922-fa42ade1f35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:17.495464 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357ee07-d910-4d9f-b922-fa42ade1f35c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:17.495739 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357ee07-d910-4d9f-b922-fa42ade1f35c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:17.496007 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357ee07-d910-4d9f-b922-fa42ade1f35c admin admin] PATH_INFO: `/v3/users/4a148f26f27b4892aa4b9a492805567c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:17.497150 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357ee07-d910-4d9f-b922-fa42ade1f35c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a148f26f27b4892aa4b9a492805567c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:17.499076 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357ee07-d910-4d9f-b922-fa42ade1f35c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:17.515273 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:17.724805 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-5357ee07-d910-4d9f-b922-fa42ade1f35c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a148f26f27b4892aa4b9a492805567c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:17.725520 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-5357ee07-d910-4d9f-b922-fa42ade1f35c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a148f26f27b4892aa4b9a492805567c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:17.746365 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-5357ee07-d910-4d9f-b922-fa42ade1f35c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a148f26f27b4892aa4b9a492805567c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:17.753177 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-5357ee07-d910-4d9f-b922-fa42ade1f35c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a148f26f27b4892aa4b9a492805567c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:17.820119 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-5357ee07-d910-4d9f-b922-fa42ade1f35c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a148f26f27b4892aa4b9a492805567c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:17.837367 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 959/1934] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:39:17 2022] DELETE /identity/v3/users/4a148f26f27b4892aa4b9a492805567c => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:18.309868 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73199b1-f691-4c7c-9ef4-b6f426549f5b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:18.311336 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f73199b1-f691-4c7c-9ef4-b6f426549f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:18.327146 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73199b1-f691-4c7c-9ef4-b6f426549f5b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:18.342906 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:18.393907 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900707e-ca7f-4059-a3fd-38f3a1669651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:18.394548 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900707e-ca7f-4059-a3fd-38f3a1669651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:18.394823 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900707e-ca7f-4059-a3fd-38f3a1669651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:18.395093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900707e-ca7f-4059-a3fd-38f3a1669651 admin admin] PATH_INFO: `/v3/projects/61889178174e4082b6916b3d5f3befec` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:18.396272 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900707e-ca7f-4059-a3fd-38f3a1669651 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61889178174e4082b6916b3d5f3befec)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:18.398412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900707e-ca7f-4059-a3fd-38f3a1669651 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:18.506030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0900707e-ca7f-4059-a3fd-38f3a1669651 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61889178174e4082b6916b3d5f3befec', 'request_id': 'req-0900707e-ca7f-4059-a3fd-38f3a1669651'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:18.579831 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0900707e-ca7f-4059-a3fd-38f3a1669651 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61889178174e4082b6916b3d5f3befec', 'request_id': 'req-0900707e-ca7f-4059-a3fd-38f3a1669651'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:18.586710 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0900707e-ca7f-4059-a3fd-38f3a1669651 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61889178174e4082b6916b3d5f3befec', 'request_id': 'req-0900707e-ca7f-4059-a3fd-38f3a1669651'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:18.597297 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0900707e-ca7f-4059-a3fd-38f3a1669651 admin admin] The token cache is being invalidate because project 61889178174e4082b6916b3d5f3befec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:39:18.597609 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0900707e-ca7f-4059-a3fd-38f3a1669651 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:18.598296 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0900707e-ca7f-4059-a3fd-38f3a1669651 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:18.599787 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 976/1935] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:39:18 2022] DELETE /identity/v3/projects/61889178174e4082b6916b3d5f3befec => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:18.604938 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d27046-fe93-40a5-bc31-04c327eba007 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:18.608886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d27046-fe93-40a5-bc31-04c327eba007 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:18.608886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d27046-fe93-40a5-bc31-04c327eba007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:18.625663 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-90d27046-fe93-40a5-bc31-04c327eba007 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:18.627666 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-90d27046-fe93-40a5-bc31-04c327eba007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:18.687534 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 960/1936] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:18.696186 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad9c00-3e2c-4486-9d3d-e462d3a7c515 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:18.696502 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad9c00-3e2c-4486-9d3d-e462d3a7c515 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:18.696780 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad9c00-3e2c-4486-9d3d-e462d3a7c515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:18.717266 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-14ad9c00-3e2c-4486-9d3d-e462d3a7c515 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:18.718518 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-14ad9c00-3e2c-4486-9d3d-e462d3a7c515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:18.727963 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 977/1937] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:18.732280 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d27046-fe93-40a5-bc31-04c327eba007 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:18.742799 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d27046-fe93-40a5-bc31-04c327eba007 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:18.747724 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfdb39-54e8-4ea3-a5c1-c317d2d3029d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:18.748330 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfdb39-54e8-4ea3-a5c1-c317d2d3029d admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:18.748610 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfdb39-54e8-4ea3-a5c1-c317d2d3029d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:18.748881 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfdb39-54e8-4ea3-a5c1-c317d2d3029d admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:18.749626 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfdb39-54e8-4ea3-a5c1-c317d2d3029d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:18.749971 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfdb39-54e8-4ea3-a5c1-c317d2d3029d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:18.752200 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfdb39-54e8-4ea3-a5c1-c317d2d3029d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:18.764394 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 961/1938] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:18.769441 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad9c00-3e2c-4486-9d3d-e462d3a7c515 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:18.778806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad9c00-3e2c-4486-9d3d-e462d3a7c515 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:18.783594 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28890ad-b8f9-46e9-bad4-d4f201fa6ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:18.784191 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28890ad-b8f9-46e9-bad4-d4f201fa6ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:18.784472 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28890ad-b8f9-46e9-bad4-d4f201fa6ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:18.784748 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28890ad-b8f9-46e9-bad4-d4f201fa6ea3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:18.785384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28890ad-b8f9-46e9-bad4-d4f201fa6ea3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:18.787363 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28890ad-b8f9-46e9-bad4-d4f201fa6ea3 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:18.919664 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 978/1939] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:39:18 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:18.924109 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfdb39-54e8-4ea3-a5c1-c317d2d3029d admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:18.934802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfdb39-54e8-4ea3-a5c1-c317d2d3029d admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:18.997417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0ca1c-2cd5-436b-b3ec-fdf7318e4de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:18.998079 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0ca1c-2cd5-436b-b3ec-fdf7318e4de8 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:18.998371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0ca1c-2cd5-436b-b3ec-fdf7318e4de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:18.998677 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0ca1c-2cd5-436b-b3ec-fdf7318e4de8 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:18.999333 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0ca1c-2cd5-436b-b3ec-fdf7318e4de8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:19.002047 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0ca1c-2cd5-436b-b3ec-fdf7318e4de8 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:19.109523 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 962/1940] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:39:18 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:39:19.111454 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28890ad-b8f9-46e9-bad4-d4f201fa6ea3 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:19.125253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28890ad-b8f9-46e9-bad4-d4f201fa6ea3 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:19.132365 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e374b75-480e-412b-84d2-90c4e11bf6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:19.133119 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e374b75-480e-412b-84d2-90c4e11bf6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:19.133493 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e374b75-480e-412b-84d2-90c4e11bf6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:19.133904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e374b75-480e-412b-84d2-90c4e11bf6f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:19.134655 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e374b75-480e-412b-84d2-90c4e11bf6f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:19.136693 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e374b75-480e-412b-84d2-90c4e11bf6f1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:19.156170 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 979/1941] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:19.160989 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0ca1c-2cd5-436b-b3ec-fdf7318e4de8 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:19.176032 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0ca1c-2cd5-436b-b3ec-fdf7318e4de8 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:19.186738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487079e-139f-43a9-aa4b-3a05fc12cf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:19.187671 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487079e-139f-43a9-aa4b-3a05fc12cf71 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:19.188098 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487079e-139f-43a9-aa4b-3a05fc12cf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:19.188480 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487079e-139f-43a9-aa4b-3a05fc12cf71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:19.189704 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8487079e-139f-43a9-aa4b-3a05fc12cf71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:19.191662 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8487079e-139f-43a9-aa4b-3a05fc12cf71 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:19.212190 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:19.214006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 963/1942] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:39:19.220890 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e374b75-480e-412b-84d2-90c4e11bf6f1 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:19.234741 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e374b75-480e-412b-84d2-90c4e11bf6f1 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:19.240742 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0139c9-533e-4970-a3e6-5c9ffc8359d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:19.241705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0139c9-533e-4970-a3e6-5c9ffc8359d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:19.242022 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0139c9-533e-4970-a3e6-5c9ffc8359d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:19.242325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0139c9-533e-4970-a3e6-5c9ffc8359d0 admin admin] PATH_INFO: `/v3/projects/36bdb1d11c424179b595e88ed286ba08/users/8fe9eedd10fd4018adbebb7f67e11687/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:19.278578 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0139c9-533e-4970-a3e6-5c9ffc8359d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36bdb1d11c424179b595e88ed286ba08, user_id=8fe9eedd10fd4018adbebb7f67e11687, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:19.283547 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0139c9-533e-4970-a3e6-5c9ffc8359d0 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:19.373794 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 980/1943] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:19 2022] PUT /identity/v3/projects/36bdb1d11c424179b595e88ed286ba08/users/8fe9eedd10fd4018adbebb7f67e11687/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:19.384905 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1b4a7-5b01-4958-8249-569f4d3be922 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:19.385190 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1b4a7-5b01-4958-8249-569f4d3be922 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:19.385521 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1b4a7-5b01-4958-8249-569f4d3be922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:19.419608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a7c1b4a7-5b01-4958-8249-569f4d3be922 None None] MFA Rules not processed for user `8fe9eedd10fd4018adbebb7f67e11687`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:19.420864 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a7c1b4a7-5b01-4958-8249-569f4d3be922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:19.509241 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0139c9-533e-4970-a3e6-5c9ffc8359d0 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:19.510330 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 964/1944] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:19.569155 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:19.591804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0139c9-533e-4970-a3e6-5c9ffc8359d0 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:19.621391 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19493459-946c-48b9-a506-2e56f1c138fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:19.622072 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19493459-946c-48b9-a506-2e56f1c138fb admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:19.622353 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19493459-946c-48b9-a506-2e56f1c138fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:19.622641 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19493459-946c-48b9-a506-2e56f1c138fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:19.623281 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19493459-946c-48b9-a506-2e56f1c138fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:19.625326 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19493459-946c-48b9-a506-2e56f1c138fb admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:19.760595 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 981/1945] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:39:19 2022] POST /identity/v3/projects => generated 385 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:39:19.762310 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1b4a7-5b01-4958-8249-569f4d3be922 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:19.775078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1b4a7-5b01-4958-8249-569f4d3be922 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:19.838577 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab0abf-3c33-4f0b-9ed2-135261956e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:19.839342 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab0abf-3c33-4f0b-9ed2-135261956e3b admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:19.839930 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab0abf-3c33-4f0b-9ed2-135261956e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:19.840574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab0abf-3c33-4f0b-9ed2-135261956e3b admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:19.841617 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab0abf-3c33-4f0b-9ed2-135261956e3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:19.843575 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab0abf-3c33-4f0b-9ed2-135261956e3b admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:19.944952 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 965/1946] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:39:19 2022] POST /identity/v3/users => generated 299 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:19.949086 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19493459-946c-48b9-a506-2e56f1c138fb admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:19.959599 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19493459-946c-48b9-a506-2e56f1c138fb admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:19.968831 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5824e09-6a93-4b62-a6ae-248dd79488ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:19.968831 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5824e09-6a93-4b62-a6ae-248dd79488ca admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:19.968831 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5824e09-6a93-4b62-a6ae-248dd79488ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:19.968831 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5824e09-6a93-4b62-a6ae-248dd79488ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:19.969198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5824e09-6a93-4b62-a6ae-248dd79488ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:19.969198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5824e09-6a93-4b62-a6ae-248dd79488ca admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:19.980557 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 982/1947] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:19.985027 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab0abf-3c33-4f0b-9ed2-135261956e3b admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:19.995911 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab0abf-3c33-4f0b-9ed2-135261956e3b admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:20.000630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e01ff-4a0c-4e2e-8bf5-120fe3e19055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:20.002021 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e01ff-4a0c-4e2e-8bf5-120fe3e19055 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:20.002300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e01ff-4a0c-4e2e-8bf5-120fe3e19055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:20.002598 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e01ff-4a0c-4e2e-8bf5-120fe3e19055 admin admin] PATH_INFO: `/v3/projects/f06246b960d14fb094aa2199420596d3/users/1991c38b69814bceaebd1e461ded49c2/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:20.018774 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e01ff-4a0c-4e2e-8bf5-120fe3e19055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f06246b960d14fb094aa2199420596d3, user_id=1991c38b69814bceaebd1e461ded49c2, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:20.021625 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e01ff-4a0c-4e2e-8bf5-120fe3e19055 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:20.128155 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 966/1948] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:19 2022] PUT /identity/v3/projects/f06246b960d14fb094aa2199420596d3/users/1991c38b69814bceaebd1e461ded49c2/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:20.131877 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5824e09-6a93-4b62-a6ae-248dd79488ca admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:20.143019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5824e09-6a93-4b62-a6ae-248dd79488ca admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:20.207031 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30def73-7b39-468f-bd87-7182f7616519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:20.207764 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30def73-7b39-468f-bd87-7182f7616519 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:20.208038 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30def73-7b39-468f-bd87-7182f7616519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:20.208359 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30def73-7b39-468f-bd87-7182f7616519 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:20.209008 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30def73-7b39-468f-bd87-7182f7616519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:20.210648 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30def73-7b39-468f-bd87-7182f7616519 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:20.222952 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 983/1949] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:20.227289 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e01ff-4a0c-4e2e-8bf5-120fe3e19055 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:20.239516 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e01ff-4a0c-4e2e-8bf5-120fe3e19055 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:20.244879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf6f3e-cf06-43e6-aa15-fe6121504caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:20.245569 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf6f3e-cf06-43e6-aa15-fe6121504caa admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:20.245885 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf6f3e-cf06-43e6-aa15-fe6121504caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:20.246203 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf6f3e-cf06-43e6-aa15-fe6121504caa admin admin] PATH_INFO: `/v3/projects/f06246b960d14fb094aa2199420596d3/users/1991c38b69814bceaebd1e461ded49c2/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:20.248154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf6f3e-cf06-43e6-aa15-fe6121504caa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f06246b960d14fb094aa2199420596d3, user_id=1991c38b69814bceaebd1e461ded49c2, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:20.250889 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf6f3e-cf06-43e6-aa15-fe6121504caa admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:20.263845 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 967/1950] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:20 2022] PUT /identity/v3/projects/f06246b960d14fb094aa2199420596d3/users/1991c38b69814bceaebd1e461ded49c2/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:20.275356 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40af477-1b39-4c0a-bf71-1dd0de7da8e7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:20.275646 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40af477-1b39-4c0a-bf71-1dd0de7da8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:20.277970 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40af477-1b39-4c0a-bf71-1dd0de7da8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:20.313415 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d40af477-1b39-4c0a-bf71-1dd0de7da8e7 None None] MFA Rules not processed for user `1991c38b69814bceaebd1e461ded49c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:20.314979 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d40af477-1b39-4c0a-bf71-1dd0de7da8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:20.398229 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 984/1951] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:20.411283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf6f3e-cf06-43e6-aa15-fe6121504caa admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:20.413434 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-19cf6f3e-cf06-43e6-aa15-fe6121504caa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:20.464047 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:20.477274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf6f3e-cf06-43e6-aa15-fe6121504caa admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:20.481213 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74c8eb-e1e7-4c26-967a-c89f17eb5581 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:20.481898 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74c8eb-e1e7-4c26-967a-c89f17eb5581 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:20.482185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74c8eb-e1e7-4c26-967a-c89f17eb5581 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:20.482460 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74c8eb-e1e7-4c26-967a-c89f17eb5581 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:20.493577 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74c8eb-e1e7-4c26-967a-c89f17eb5581 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:20.498434 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74c8eb-e1e7-4c26-967a-c89f17eb5581 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:20.505429 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 968/1952] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:39:20.573728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40af477-1b39-4c0a-bf71-1dd0de7da8e7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:20.619302 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:20.639900 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40af477-1b39-4c0a-bf71-1dd0de7da8e7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:20.644864 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef1af9-93ce-4caa-9b5a-4b89e560a79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:20.645499 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef1af9-93ce-4caa-9b5a-4b89e560a79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:20.645904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef1af9-93ce-4caa-9b5a-4b89e560a79e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:20.646105 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef1af9-93ce-4caa-9b5a-4b89e560a79e admin admin] PATH_INFO: `/v3/users/8fe9eedd10fd4018adbebb7f67e11687` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:20.647252 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef1af9-93ce-4caa-9b5a-4b89e560a79e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fe9eedd10fd4018adbebb7f67e11687)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:20.649182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef1af9-93ce-4caa-9b5a-4b89e560a79e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:20.739337 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74c8eb-e1e7-4c26-967a-c89f17eb5581 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:20.740774 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3f74c8eb-e1e7-4c26-967a-c89f17eb5581 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:20.755395 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74c8eb-e1e7-4c26-967a-c89f17eb5581 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:20.760454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885c7fe-0dae-4249-9bf4-8b38478f4323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:20.761136 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885c7fe-0dae-4249-9bf4-8b38478f4323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:20.761407 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885c7fe-0dae-4249-9bf4-8b38478f4323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:20.761675 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885c7fe-0dae-4249-9bf4-8b38478f4323 admin admin] PATH_INFO: `/v3/users/6eff19c3fdc748fab080e897fe8d2c5a` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:20.762838 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885c7fe-0dae-4249-9bf4-8b38478f4323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eff19c3fdc748fab080e897fe8d2c5a)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:20.764813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885c7fe-0dae-4249-9bf4-8b38478f4323 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:20.836098 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2aef1af9-93ce-4caa-9b5a-4b89e560a79e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fe9eedd10fd4018adbebb7f67e11687'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:20.836782 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2aef1af9-93ce-4caa-9b5a-4b89e560a79e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fe9eedd10fd4018adbebb7f67e11687'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:20.837387 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2aef1af9-93ce-4caa-9b5a-4b89e560a79e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fe9eedd10fd4018adbebb7f67e11687'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:20.851919 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2aef1af9-93ce-4caa-9b5a-4b89e560a79e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fe9eedd10fd4018adbebb7f67e11687'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:20.940526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2aef1af9-93ce-4caa-9b5a-4b89e560a79e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fe9eedd10fd4018adbebb7f67e11687'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:20.960639 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 985/1953] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:39:20 2022] DELETE /identity/v3/users/8fe9eedd10fd4018adbebb7f67e11687 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:20.972836 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064feeba-0c39-463c-9fe8-a891524e50ea None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:20.972836 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064feeba-0c39-463c-9fe8-a891524e50ea None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:20.972836 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064feeba-0c39-463c-9fe8-a891524e50ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:20.986973 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-4885c7fe-0dae-4249-9bf4-8b38478f4323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eff19c3fdc748fab080e897fe8d2c5a'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:20.987674 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-4885c7fe-0dae-4249-9bf4-8b38478f4323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eff19c3fdc748fab080e897fe8d2c5a'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:21.008963 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-4885c7fe-0dae-4249-9bf4-8b38478f4323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eff19c3fdc748fab080e897fe8d2c5a'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:21.009704 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-4885c7fe-0dae-4249-9bf4-8b38478f4323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eff19c3fdc748fab080e897fe8d2c5a'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:21.012100 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-064feeba-0c39-463c-9fe8-a891524e50ea None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:21.013420 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-064feeba-0c39-463c-9fe8-a891524e50ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:21.078207 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 986/1954] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:21.089010 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064feeba-0c39-463c-9fe8-a891524e50ea None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:21.090413 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-064feeba-0c39-463c-9fe8-a891524e50ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:21.122823 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-4885c7fe-0dae-4249-9bf4-8b38478f4323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eff19c3fdc748fab080e897fe8d2c5a'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:21.140313 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 969/1955] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:39:20 2022] DELETE /identity/v3/users/6eff19c3fdc748fab080e897fe8d2c5a => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:39:21.142558 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5390d0-1e49-413c-96f8-fe0679e333b0 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:21.142852 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5390d0-1e49-413c-96f8-fe0679e333b0 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:21.143132 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5390d0-1e49-413c-96f8-fe0679e333b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:21.165788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064feeba-0c39-463c-9fe8-a891524e50ea None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:21.167531 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-bc5390d0-1e49-413c-96f8-fe0679e333b0 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:21.169084 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-bc5390d0-1e49-413c-96f8-fe0679e333b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:21.180764 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:21.268724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b31d04-e8e2-49e5-b699-bfab81f423a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:21.269308 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b31d04-e8e2-49e5-b699-bfab81f423a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:21.269720 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b31d04-e8e2-49e5-b699-bfab81f423a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:21.270274 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b31d04-e8e2-49e5-b699-bfab81f423a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:21.277026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 970/1956] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:21.289293 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b31d04-e8e2-49e5-b699-bfab81f423a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:21.291567 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b31d04-e8e2-49e5-b699-bfab81f423a5 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:21.291727 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5390d0-1e49-413c-96f8-fe0679e333b0 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:21.306044 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5390d0-1e49-413c-96f8-fe0679e333b0 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:21.307576 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 987/1957] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:39:21.330746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7c0c0-430a-4ed4-a79f-a152e3df4bd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:21.331126 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7c0c0-430a-4ed4-a79f-a152e3df4bd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:21.331398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7c0c0-430a-4ed4-a79f-a152e3df4bd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:21.331677 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7c0c0-430a-4ed4-a79f-a152e3df4bd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:21.366174 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c7c0c0-430a-4ed4-a79f-a152e3df4bd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:21.367899 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c7c0c0-430a-4ed4-a79f-a152e3df4bd8 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:21.382386 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 971/1958] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:39:22.011591 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b31d04-e8e2-49e5-b699-bfab81f423a5 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:22.013991 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-56b31d04-e8e2-49e5-b699-bfab81f423a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:22.032840 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b31d04-e8e2-49e5-b699-bfab81f423a5 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:22.040767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2ebd5-45c9-4e52-8608-a8162ddc34d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:22.040767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2ebd5-45c9-4e52-8608-a8162ddc34d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:22.040767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2ebd5-45c9-4e52-8608-a8162ddc34d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:22.040767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2ebd5-45c9-4e52-8608-a8162ddc34d4 admin admin] PATH_INFO: `/v3/projects/36bdb1d11c424179b595e88ed286ba08` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:22.043656 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2ebd5-45c9-4e52-8608-a8162ddc34d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36bdb1d11c424179b595e88ed286ba08)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:22.045038 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2ebd5-45c9-4e52-8608-a8162ddc34d4 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:22.148497 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7c0c0-430a-4ed4-a79f-a152e3df4bd8 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:22.150692 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f4c7c0c0-430a-4ed4-a79f-a152e3df4bd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:22.179699 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7c0c0-430a-4ed4-a79f-a152e3df4bd8 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:22.199554 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331a1c8-72f6-4ab3-aa13-aa66c78b182d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:22.200525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331a1c8-72f6-4ab3-aa13-aa66c78b182d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:22.200960 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331a1c8-72f6-4ab3-aa13-aa66c78b182d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:22.201392 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331a1c8-72f6-4ab3-aa13-aa66c78b182d admin admin] PATH_INFO: `/v3/projects/a19797b8e0344459a61c8d50d13e70bd` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:22.202982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331a1c8-72f6-4ab3-aa13-aa66c78b182d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a19797b8e0344459a61c8d50d13e70bd)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:22.206134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331a1c8-72f6-4ab3-aa13-aa66c78b182d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:22.264400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e1d2ebd5-45c9-4e52-8608-a8162ddc34d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36bdb1d11c424179b595e88ed286ba08', 'request_id': 'req-e1d2ebd5-45c9-4e52-8608-a8162ddc34d4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:22.333808 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:22.342221 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9331a1c8-72f6-4ab3-aa13-aa66c78b182d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a19797b8e0344459a61c8d50d13e70bd', 'request_id': 'req-9331a1c8-72f6-4ab3-aa13-aa66c78b182d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:22.379733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e1d2ebd5-45c9-4e52-8608-a8162ddc34d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36bdb1d11c424179b595e88ed286ba08', 'request_id': 'req-e1d2ebd5-45c9-4e52-8608-a8162ddc34d4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:22.387007 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e1d2ebd5-45c9-4e52-8608-a8162ddc34d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36bdb1d11c424179b595e88ed286ba08', 'request_id': 'req-e1d2ebd5-45c9-4e52-8608-a8162ddc34d4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:22.399230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e1d2ebd5-45c9-4e52-8608-a8162ddc34d4 admin admin] The token cache is being invalidate because project 36bdb1d11c424179b595e88ed286ba08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:39:22.399598 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e1d2ebd5-45c9-4e52-8608-a8162ddc34d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:22.400446 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e1d2ebd5-45c9-4e52-8608-a8162ddc34d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:22.402094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 988/1959] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:39:22 2022] DELETE /identity/v3/projects/36bdb1d11c424179b595e88ed286ba08 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:22.406091 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2ebd5-45c9-4e52-8608-a8162ddc34d4 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:22.408361 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e1d2ebd5-45c9-4e52-8608-a8162ddc34d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:22.463411 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9331a1c8-72f6-4ab3-aa13-aa66c78b182d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a19797b8e0344459a61c8d50d13e70bd', 'request_id': 'req-9331a1c8-72f6-4ab3-aa13-aa66c78b182d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:22.473232 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9331a1c8-72f6-4ab3-aa13-aa66c78b182d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a19797b8e0344459a61c8d50d13e70bd', 'request_id': 'req-9331a1c8-72f6-4ab3-aa13-aa66c78b182d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:22.479314 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2ebd5-45c9-4e52-8608-a8162ddc34d4 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:22.484912 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9331a1c8-72f6-4ab3-aa13-aa66c78b182d admin admin] The token cache is being invalidate because project a19797b8e0344459a61c8d50d13e70bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:39:22.485080 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9331a1c8-72f6-4ab3-aa13-aa66c78b182d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:22.486573 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9331a1c8-72f6-4ab3-aa13-aa66c78b182d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:22.491896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 972/1960] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:39:22 2022] DELETE /identity/v3/projects/a19797b8e0344459a61c8d50d13e70bd => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:22.493413 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69007a-69dd-46aa-a916-7f18ecbfcb41 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:22.493700 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69007a-69dd-46aa-a916-7f18ecbfcb41 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:22.494033 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69007a-69dd-46aa-a916-7f18ecbfcb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:22.517212 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-4c69007a-69dd-46aa-a916-7f18ecbfcb41 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:22.518801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4c69007a-69dd-46aa-a916-7f18ecbfcb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:22.530400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:22.543231 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a2e97-ca72-4999-a8bc-bbdc930778eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:22.543899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a2e97-ca72-4999-a8bc-bbdc930778eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:22.544299 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a2e97-ca72-4999-a8bc-bbdc930778eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:22.544480 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a2e97-ca72-4999-a8bc-bbdc930778eb admin admin] PATH_INFO: `/v3/users/1991c38b69814bceaebd1e461ded49c2` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:22.545687 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a2e97-ca72-4999-a8bc-bbdc930778eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1991c38b69814bceaebd1e461ded49c2)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:22.547812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a2e97-ca72-4999-a8bc-bbdc930778eb admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:22.592805 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 973/1961] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:22.601495 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cdac0-62e8-4588-8e47-12ab0501a5e6 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:22.601804 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cdac0-62e8-4588-8e47-12ab0501a5e6 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:22.602079 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cdac0-62e8-4588-8e47-12ab0501a5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:22.631167 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-4e6cdac0-62e8-4588-8e47-12ab0501a5e6 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:22.632373 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4e6cdac0-62e8-4588-8e47-12ab0501a5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:22.640761 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 974/1962] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:39:22.646315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cdac0-62e8-4588-8e47-12ab0501a5e6 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:22.657309 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cdac0-62e8-4588-8e47-12ab0501a5e6 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:22.662172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3c1fc-dba2-40b8-9d9a-3e8b11fdffd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:22.662804 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3c1fc-dba2-40b8-9d9a-3e8b11fdffd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:22.663068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3c1fc-dba2-40b8-9d9a-3e8b11fdffd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:22.663333 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3c1fc-dba2-40b8-9d9a-3e8b11fdffd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:22.663981 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3c1fc-dba2-40b8-9d9a-3e8b11fdffd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:22.664278 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3c1fc-dba2-40b8-9d9a-3e8b11fdffd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:22.665940 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3c1fc-dba2-40b8-9d9a-3e8b11fdffd2 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:22.682704 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 975/1963] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:22.687861 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3c1fc-dba2-40b8-9d9a-3e8b11fdffd2 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:22.706524 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3c1fc-dba2-40b8-9d9a-3e8b11fdffd2 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:22.711947 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f144f33-e086-4dde-8a0a-1fe17a9e5b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:22.712638 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f144f33-e086-4dde-8a0a-1fe17a9e5b26 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:22.712951 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f144f33-e086-4dde-8a0a-1fe17a9e5b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:22.713232 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f144f33-e086-4dde-8a0a-1fe17a9e5b26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:22.714010 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f144f33-e086-4dde-8a0a-1fe17a9e5b26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:22.716161 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f144f33-e086-4dde-8a0a-1fe17a9e5b26 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:22.747354 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e49a2e97-ca72-4999-a8bc-bbdc930778eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1991c38b69814bceaebd1e461ded49c2'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:22.748086 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e49a2e97-ca72-4999-a8bc-bbdc930778eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1991c38b69814bceaebd1e461ded49c2'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:22.748755 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e49a2e97-ca72-4999-a8bc-bbdc930778eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1991c38b69814bceaebd1e461ded49c2'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:22.765510 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e49a2e97-ca72-4999-a8bc-bbdc930778eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1991c38b69814bceaebd1e461ded49c2'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:22.839413 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e49a2e97-ca72-4999-a8bc-bbdc930778eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1991c38b69814bceaebd1e461ded49c2'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:22.862930 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 976/1964] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:39:22 2022] POST /identity/v3/projects => generated 375 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:22.866869 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f144f33-e086-4dde-8a0a-1fe17a9e5b26 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:22.870005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4f144f33-e086-4dde-8a0a-1fe17a9e5b26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:22.873452 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 989/1965] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:39:22 2022] DELETE /identity/v3/users/1991c38b69814bceaebd1e461ded49c2 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:39:22.959279 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f144f33-e086-4dde-8a0a-1fe17a9e5b26 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:23.052500 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ca6f6-5fd2-443f-876d-e0f4cb509bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:23.053436 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ca6f6-5fd2-443f-876d-e0f4cb509bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:23.054102 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ca6f6-5fd2-443f-876d-e0f4cb509bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:23.054669 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ca6f6-5fd2-443f-876d-e0f4cb509bc0 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:23.056006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ca6f6-5fd2-443f-876d-e0f4cb509bc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:23.062050 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ca6f6-5fd2-443f-876d-e0f4cb509bc0 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:23.195475 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:23.207686 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 977/1966] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:39:22 2022] POST /identity/v3/users => generated 288 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:23.211947 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a2e97-ca72-4999-a8bc-bbdc930778eb admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:23.226222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a2e97-ca72-4999-a8bc-bbdc930778eb admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:23.234221 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed8e2e-00d8-44fb-83cd-c7ec361dadbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:23.235327 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed8e2e-00d8-44fb-83cd-c7ec361dadbc admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:23.235686 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed8e2e-00d8-44fb-83cd-c7ec361dadbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:23.238060 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed8e2e-00d8-44fb-83cd-c7ec361dadbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:23.238060 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed8e2e-00d8-44fb-83cd-c7ec361dadbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:23.239140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed8e2e-00d8-44fb-83cd-c7ec361dadbc admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:23.252659 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 990/1967] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:39:23.257249 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ca6f6-5fd2-443f-876d-e0f4cb509bc0 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:23.269332 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ca6f6-5fd2-443f-876d-e0f4cb509bc0 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:23.278158 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10b7ad-09a4-46b8-89ee-4154842b461d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:23.279145 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10b7ad-09a4-46b8-89ee-4154842b461d admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:23.279637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10b7ad-09a4-46b8-89ee-4154842b461d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:23.280090 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10b7ad-09a4-46b8-89ee-4154842b461d admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:23.281114 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10b7ad-09a4-46b8-89ee-4154842b461d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:23.283017 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10b7ad-09a4-46b8-89ee-4154842b461d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:23.295830 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 978/1968] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:23.300566 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed8e2e-00d8-44fb-83cd-c7ec361dadbc admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:23.311773 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed8e2e-00d8-44fb-83cd-c7ec361dadbc admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:23.318017 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80377b75-8c09-4f62-b690-1007351509f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:23.318698 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80377b75-8c09-4f62-b690-1007351509f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:23.318974 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80377b75-8c09-4f62-b690-1007351509f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:23.319250 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80377b75-8c09-4f62-b690-1007351509f7 admin admin] PATH_INFO: `/v3/projects/e8f37931378240b8806b89e3343e7ba9/users/da72b906061e45fa8b47d8ff36eb462b/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:23.344278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80377b75-8c09-4f62-b690-1007351509f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f37931378240b8806b89e3343e7ba9, user_id=da72b906061e45fa8b47d8ff36eb462b, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:23.351651 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80377b75-8c09-4f62-b690-1007351509f7 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:23.411000 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10b7ad-09a4-46b8-89ee-4154842b461d admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:23.412822 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ae10b7ad-09a4-46b8-89ee-4154842b461d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:23.427208 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10b7ad-09a4-46b8-89ee-4154842b461d admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:23.432261 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f31c1-2e4e-4cd1-8fe6-f715560f7231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:23.432896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f31c1-2e4e-4cd1-8fe6-f715560f7231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:23.433354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f31c1-2e4e-4cd1-8fe6-f715560f7231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:23.433672 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f31c1-2e4e-4cd1-8fe6-f715560f7231 admin admin] PATH_INFO: `/v3/projects/f06246b960d14fb094aa2199420596d3` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:23.443025 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 991/1969] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:23 2022] PUT /identity/v3/projects/e8f37931378240b8806b89e3343e7ba9/users/da72b906061e45fa8b47d8ff36eb462b/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:23.443140 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f31c1-2e4e-4cd1-8fe6-f715560f7231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f06246b960d14fb094aa2199420596d3)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:23.444620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f31c1-2e4e-4cd1-8fe6-f715560f7231 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:23.456020 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f6cf5-7675-4786-918d-eabf2c17853b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:23.456130 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f6cf5-7675-4786-918d-eabf2c17853b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:23.456311 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f6cf5-7675-4786-918d-eabf2c17853b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:23.510418 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-1e0f6cf5-7675-4786-918d-eabf2c17853b None None] MFA Rules not processed for user `da72b906061e45fa8b47d8ff36eb462b`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:23.511627 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1e0f6cf5-7675-4786-918d-eabf2c17853b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:23.573037 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-440f31c1-2e4e-4cd1-8fe6-f715560f7231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f06246b960d14fb094aa2199420596d3', 'request_id': 'req-440f31c1-2e4e-4cd1-8fe6-f715560f7231'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:23.584296 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 992/1970] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:39:23.589256 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f6cf5-7675-4786-918d-eabf2c17853b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:23.621631 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:23.662740 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f6cf5-7675-4786-918d-eabf2c17853b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:23.676974 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-440f31c1-2e4e-4cd1-8fe6-f715560f7231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f06246b960d14fb094aa2199420596d3', 'request_id': 'req-440f31c1-2e4e-4cd1-8fe6-f715560f7231'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:23.685147 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-440f31c1-2e4e-4cd1-8fe6-f715560f7231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f06246b960d14fb094aa2199420596d3', 'request_id': 'req-440f31c1-2e4e-4cd1-8fe6-f715560f7231'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:23.709653 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-440f31c1-2e4e-4cd1-8fe6-f715560f7231 admin admin] The token cache is being invalidate because project f06246b960d14fb094aa2199420596d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:39:23.710014 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-440f31c1-2e4e-4cd1-8fe6-f715560f7231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:23.710727 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-440f31c1-2e4e-4cd1-8fe6-f715560f7231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:23.712510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 979/1971] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:39:23 2022] DELETE /identity/v3/projects/f06246b960d14fb094aa2199420596d3 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:39:23.728880 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bb981-ff06-4ac7-b178-bd58142eedb0 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:23.729710 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bb981-ff06-4ac7-b178-bd58142eedb0 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:23.731392 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df9209-fda7-4394-ad53-f1bd7bffaf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:23.731813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bb981-ff06-4ac7-b178-bd58142eedb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:23.732022 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df9209-fda7-4394-ad53-f1bd7bffaf75 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:23.732307 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df9209-fda7-4394-ad53-f1bd7bffaf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:23.732594 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df9209-fda7-4394-ad53-f1bd7bffaf75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:23.733655 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df9209-fda7-4394-ad53-f1bd7bffaf75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:23.736298 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df9209-fda7-4394-ad53-f1bd7bffaf75 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:23.758720 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-054bb981-ff06-4ac7-b178-bd58142eedb0 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:23.760098 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-054bb981-ff06-4ac7-b178-bd58142eedb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:23.770806 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 980/1972] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:23.778644 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85d3c0-ccd7-468f-9362-6f1f8887c645 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:23.779208 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85d3c0-ccd7-468f-9362-6f1f8887c645 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:23.786869 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85d3c0-ccd7-468f-9362-6f1f8887c645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:23.803546 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ba85d3c0-ccd7-468f-9362-6f1f8887c645 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:23.806099 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ba85d3c0-ccd7-468f-9362-6f1f8887c645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:23.819672 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 981/1973] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:39:23.834889 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85d3c0-ccd7-468f-9362-6f1f8887c645 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:23.868618 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 993/1974] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:39:23 2022] POST /identity/v3/projects => generated 377 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:39:23.869514 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df9209-fda7-4394-ad53-f1bd7bffaf75 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:23.874373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-30df9209-fda7-4394-ad53-f1bd7bffaf75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:23.880379 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85d3c0-ccd7-468f-9362-6f1f8887c645 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:23.968260 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b1fd0-bbb2-48dc-9870-8d4da051db3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:23.968889 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b1fd0-bbb2-48dc-9870-8d4da051db3e admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:23.969169 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b1fd0-bbb2-48dc-9870-8d4da051db3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:23.969439 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b1fd0-bbb2-48dc-9870-8d4da051db3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:23.970772 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b1fd0-bbb2-48dc-9870-8d4da051db3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:23.971075 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b1fd0-bbb2-48dc-9870-8d4da051db3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:23.972755 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b1fd0-bbb2-48dc-9870-8d4da051db3e admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:23.993806 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 982/1975] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:23.998740 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b1fd0-bbb2-48dc-9870-8d4da051db3e admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:24.005910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df9209-fda7-4394-ad53-f1bd7bffaf75 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:24.012536 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b1fd0-bbb2-48dc-9870-8d4da051db3e admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:24.015082 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d821c5-9892-4a12-ae93-54621f83e6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:24.016514 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d821c5-9892-4a12-ae93-54621f83e6b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:24.017903 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d821c5-9892-4a12-ae93-54621f83e6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:24.018685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d821c5-9892-4a12-ae93-54621f83e6b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:24.019500 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d821c5-9892-4a12-ae93-54621f83e6b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:24.022459 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d821c5-9892-4a12-ae93-54621f83e6b5 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:24.024352 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7bd20d-ec1e-44eb-8e4d-0b853d37447c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:24.025364 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bd20d-ec1e-44eb-8e4d-0b853d37447c admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:24.025785 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bd20d-ec1e-44eb-8e4d-0b853d37447c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:24.026139 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bd20d-ec1e-44eb-8e4d-0b853d37447c admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:24.026860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7bd20d-ec1e-44eb-8e4d-0b853d37447c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:24.028989 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7bd20d-ec1e-44eb-8e4d-0b853d37447c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:24.047335 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:24.231212 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 983/1976] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:39:23 2022] POST /identity/v3/projects => generated 381 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:39:24.237706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 994/1977] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:39:23 2022] POST /identity/v3/users => generated 289 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:24.239489 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d821c5-9892-4a12-ae93-54621f83e6b5 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:24.240486 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7bd20d-ec1e-44eb-8e4d-0b853d37447c admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:24.263410 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d821c5-9892-4a12-ae93-54621f83e6b5 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:24.319554 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:24.321467 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7bd20d-ec1e-44eb-8e4d-0b853d37447c admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:24.326707 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37740b-225d-4cee-a6ca-cb0a53165d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:24.327466 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37740b-225d-4cee-a6ca-cb0a53165d88 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:24.327917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37740b-225d-4cee-a6ca-cb0a53165d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:24.332971 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37740b-225d-4cee-a6ca-cb0a53165d88 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:24.332971 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37740b-225d-4cee-a6ca-cb0a53165d88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:24.332971 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37740b-225d-4cee-a6ca-cb0a53165d88 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:24.339919 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260142d0-6118-4601-b911-d94c29226ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:24.340546 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260142d0-6118-4601-b911-d94c29226ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:24.340830 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260142d0-6118-4601-b911-d94c29226ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:24.341108 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260142d0-6118-4601-b911-d94c29226ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:24.341778 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260142d0-6118-4601-b911-d94c29226ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:24.343736 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260142d0-6118-4601-b911-d94c29226ee8 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:24.357244 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 995/1978] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:24.359193 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260142d0-6118-4601-b911-d94c29226ee8 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:24.364166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-260142d0-6118-4601-b911-d94c29226ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:24.379579 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260142d0-6118-4601-b911-d94c29226ee8 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:24.385079 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c9302-a3b0-4139-a946-0cf565584ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:24.385728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c9302-a3b0-4139-a946-0cf565584ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:24.386132 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c9302-a3b0-4139-a946-0cf565584ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:24.386443 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c9302-a3b0-4139-a946-0cf565584ddc admin admin] PATH_INFO: `/v3/users/d0eca7a4531c43efa659da2739682c50` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:24.388194 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c9302-a3b0-4139-a946-0cf565584ddc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0eca7a4531c43efa659da2739682c50)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:24.390283 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c9302-a3b0-4139-a946-0cf565584ddc admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:24.456060 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 984/1979] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:39:24 2022] POST /identity/v3/users => generated 291 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:24.457229 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37740b-225d-4cee-a6ca-cb0a53165d88 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:24.476100 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37740b-225d-4cee-a6ca-cb0a53165d88 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:24.481357 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e4f16-5519-4f3a-86e9-82a7b6bea317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:24.482001 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e4f16-5519-4f3a-86e9-82a7b6bea317 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:24.482282 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e4f16-5519-4f3a-86e9-82a7b6bea317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:24.482561 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e4f16-5519-4f3a-86e9-82a7b6bea317 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:24.483660 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e4f16-5519-4f3a-86e9-82a7b6bea317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:24.485296 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e4f16-5519-4f3a-86e9-82a7b6bea317 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:24.497083 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 985/1980] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:24.498335 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e4f16-5519-4f3a-86e9-82a7b6bea317 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:24.511195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e4f16-5519-4f3a-86e9-82a7b6bea317 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:24.516284 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ceb8b-847e-4df6-9de5-6559c38f5ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:24.518175 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ceb8b-847e-4df6-9de5-6559c38f5ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:24.518599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ceb8b-847e-4df6-9de5-6559c38f5ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:24.518976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ceb8b-847e-4df6-9de5-6559c38f5ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:24.519817 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ceb8b-847e-4df6-9de5-6559c38f5ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:24.521693 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ceb8b-847e-4df6-9de5-6559c38f5ea5 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:24.535676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 986/1981] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:24.536928 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ceb8b-847e-4df6-9de5-6559c38f5ea5 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:24.549634 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ceb8b-847e-4df6-9de5-6559c38f5ea5 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:24.558353 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64040ab1-d668-4e36-967a-252281882870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:24.559521 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64040ab1-d668-4e36-967a-252281882870 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:24.560228 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64040ab1-d668-4e36-967a-252281882870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:24.561328 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64040ab1-d668-4e36-967a-252281882870 admin admin] PATH_INFO: `/v3/projects/bbc987ea9b8e4776aabb7e4bc03b1c4f/users/e76e35b8873143cf8861c541080ff6d0/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:24.582358 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64040ab1-d668-4e36-967a-252281882870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbc987ea9b8e4776aabb7e4bc03b1c4f, user_id=e76e35b8873143cf8861c541080ff6d0, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:24.585095 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64040ab1-d668-4e36-967a-252281882870 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:24.624030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d94c9302-a3b0-4139-a946-0cf565584ddc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0eca7a4531c43efa659da2739682c50'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:24.625036 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d94c9302-a3b0-4139-a946-0cf565584ddc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0eca7a4531c43efa659da2739682c50'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:24.626653 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d94c9302-a3b0-4139-a946-0cf565584ddc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0eca7a4531c43efa659da2739682c50'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:24.643893 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d94c9302-a3b0-4139-a946-0cf565584ddc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0eca7a4531c43efa659da2739682c50'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:24.688616 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 987/1982] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:24 2022] PUT /identity/v3/projects/bbc987ea9b8e4776aabb7e4bc03b1c4f/users/e76e35b8873143cf8861c541080ff6d0/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:24.690025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64040ab1-d668-4e36-967a-252281882870 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:24.691723 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-64040ab1-d668-4e36-967a-252281882870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:24.739391 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d94c9302-a3b0-4139-a946-0cf565584ddc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0eca7a4531c43efa659da2739682c50'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:24.753936 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 996/1983] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:39:24 2022] DELETE /identity/v3/users/d0eca7a4531c43efa659da2739682c50 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:24.755230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d097a33-7b33-49b9-aa0c-fa15ed210695 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:24.755579 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d097a33-7b33-49b9-aa0c-fa15ed210695 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:24.755864 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d097a33-7b33-49b9-aa0c-fa15ed210695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:24.759907 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64040ab1-d668-4e36-967a-252281882870 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:24.786289 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-3d097a33-7b33-49b9-aa0c-fa15ed210695 None None] MFA Rules not processed for user `e76e35b8873143cf8861c541080ff6d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:24.787508 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3d097a33-7b33-49b9-aa0c-fa15ed210695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:24.819740 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3a933-831c-44bc-8f73-fe5e552cf35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:24.820642 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3a933-831c-44bc-8f73-fe5e552cf35f admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:24.820642 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3a933-831c-44bc-8f73-fe5e552cf35f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:24.820901 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3a933-831c-44bc-8f73-fe5e552cf35f admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:24.821404 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3a933-831c-44bc-8f73-fe5e552cf35f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:24.823068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3a933-831c-44bc-8f73-fe5e552cf35f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:24.836780 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 988/1984] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:24.836780 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f72e5-7718-488d-86f7-a70a973b575e None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:24.836780 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f72e5-7718-488d-86f7-a70a973b575e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:24.836780 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f72e5-7718-488d-86f7-a70a973b575e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:24.855276 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-068f72e5-7718-488d-86f7-a70a973b575e None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:24.856758 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-068f72e5-7718-488d-86f7-a70a973b575e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:24.867190 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 997/1985] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:24.867190 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d097a33-7b33-49b9-aa0c-fa15ed210695 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:24.870351 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 989/1986] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:24.871260 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f72e5-7718-488d-86f7-a70a973b575e None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:24.872615 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-068f72e5-7718-488d-86f7-a70a973b575e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:24.877536 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d097a33-7b33-49b9-aa0c-fa15ed210695 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:24.882954 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48336faa-cc22-4a77-98ed-14c0366cd940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:24.883967 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48336faa-cc22-4a77-98ed-14c0366cd940 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:24.884314 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48336faa-cc22-4a77-98ed-14c0366cd940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:24.884664 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48336faa-cc22-4a77-98ed-14c0366cd940 admin admin] PATH_INFO: `/v3/projects/ffb6a7618c624fecacde6e3454140edf/users/8694e3239e3541a1ae47cef210e51928/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:24.888464 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f72e5-7718-488d-86f7-a70a973b575e None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:24.894011 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8b6ea-ca78-4a06-a0c8-b3da1230c3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:24.894628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8b6ea-ca78-4a06-a0c8-b3da1230c3ce admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:24.894905 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8b6ea-ca78-4a06-a0c8-b3da1230c3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:24.895178 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8b6ea-ca78-4a06-a0c8-b3da1230c3ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:24.895803 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f8b6ea-ca78-4a06-a0c8-b3da1230c3ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:24.897725 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f8b6ea-ca78-4a06-a0c8-b3da1230c3ce admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:24.903816 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48336faa-cc22-4a77-98ed-14c0366cd940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffb6a7618c624fecacde6e3454140edf, user_id=8694e3239e3541a1ae47cef210e51928, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:24.910010 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:24.910139 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48336faa-cc22-4a77-98ed-14c0366cd940 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:24.986966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 998/1987] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:24 2022] PUT /identity/v3/projects/ffb6a7618c624fecacde6e3454140edf/users/8694e3239e3541a1ae47cef210e51928/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:24.990237 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48336faa-cc22-4a77-98ed-14c0366cd940 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:24.990237 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-48336faa-cc22-4a77-98ed-14c0366cd940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:25.012343 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:25.021778 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 990/1988] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:39:24 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:25.022174 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416d1c4-7f3c-4ff6-a12e-c2c29059af67 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:25.022548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416d1c4-7f3c-4ff6-a12e-c2c29059af67 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:25.022808 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416d1c4-7f3c-4ff6-a12e-c2c29059af67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:25.058866 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48336faa-cc22-4a77-98ed-14c0366cd940 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:25.086746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-6416d1c4-7f3c-4ff6-a12e-c2c29059af67 None None] MFA Rules not processed for user `8694e3239e3541a1ae47cef210e51928`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:25.086746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6416d1c4-7f3c-4ff6-a12e-c2c29059af67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:25.119834 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323529d-95fb-412d-9ea2-fde307af96c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:25.120464 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323529d-95fb-412d-9ea2-fde307af96c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:25.120738 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323529d-95fb-412d-9ea2-fde307af96c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:25.121007 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323529d-95fb-412d-9ea2-fde307af96c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:25.201154 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323529d-95fb-412d-9ea2-fde307af96c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:25.202793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323529d-95fb-412d-9ea2-fde307af96c1 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:25.215390 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 999/1989] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:39:25.219713 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 991/1990] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:25.238936 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323529d-95fb-412d-9ea2-fde307af96c1 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:25.244771 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416d1c4-7f3c-4ff6-a12e-c2c29059af67 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:25.266638 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323529d-95fb-412d-9ea2-fde307af96c1 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:25.275472 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd29060-37ef-4efb-ab6f-f43102a7eba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:25.276627 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd29060-37ef-4efb-ab6f-f43102a7eba6 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:25.276915 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd29060-37ef-4efb-ab6f-f43102a7eba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:25.277210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd29060-37ef-4efb-ab6f-f43102a7eba6 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:25.277887 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd29060-37ef-4efb-ab6f-f43102a7eba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:25.277990 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416d1c4-7f3c-4ff6-a12e-c2c29059af67 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:25.281188 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd29060-37ef-4efb-ab6f-f43102a7eba6 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:25.293970 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6528aa-29d1-4b00-b572-63e65690cc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:25.294866 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6528aa-29d1-4b00-b572-63e65690cc2f admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:25.296806 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6528aa-29d1-4b00-b572-63e65690cc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:25.297191 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6528aa-29d1-4b00-b572-63e65690cc2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:25.298647 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6528aa-29d1-4b00-b572-63e65690cc2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:25.301268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6528aa-29d1-4b00-b572-63e65690cc2f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:25.459282 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1000/1991] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:39:25 2022] POST /identity/v3/users => generated 295 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:25.462960 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 992/1992] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:39:25 2022] POST /identity/v3/projects => generated 381 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:25.463851 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd29060-37ef-4efb-ab6f-f43102a7eba6 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:25.466518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6528aa-29d1-4b00-b572-63e65690cc2f admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:25.475478 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd29060-37ef-4efb-ab6f-f43102a7eba6 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:25.542401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6528aa-29d1-4b00-b572-63e65690cc2f admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:25.554477 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287ee6a-daec-408a-8366-7811833ae4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:25.554747 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005efb95-87cb-4da9-b959-f6d7b3cea769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:25.555155 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287ee6a-daec-408a-8366-7811833ae4ef admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:25.555644 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005efb95-87cb-4da9-b959-f6d7b3cea769 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:25.555784 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287ee6a-daec-408a-8366-7811833ae4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:25.556049 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287ee6a-daec-408a-8366-7811833ae4ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:25.556375 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005efb95-87cb-4da9-b959-f6d7b3cea769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:25.556743 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005efb95-87cb-4da9-b959-f6d7b3cea769 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:25.557112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3287ee6a-daec-408a-8366-7811833ae4ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:25.557652 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005efb95-87cb-4da9-b959-f6d7b3cea769 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:25.559402 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3287ee6a-daec-408a-8366-7811833ae4ef admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:25.562440 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005efb95-87cb-4da9-b959-f6d7b3cea769 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:25.584942 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1001/1993] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:25.590023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287ee6a-daec-408a-8366-7811833ae4ef admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:25.607576 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287ee6a-daec-408a-8366-7811833ae4ef admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:25.614238 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442a6a0-a40a-4ffb-8f19-4b16fe035249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:25.615121 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442a6a0-a40a-4ffb-8f19-4b16fe035249 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:25.615860 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442a6a0-a40a-4ffb-8f19-4b16fe035249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:25.616265 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442a6a0-a40a-4ffb-8f19-4b16fe035249 admin admin] PATH_INFO: `/v3/projects/fd1eba4e76da45579ff6cb5816c32001/users/182c416b9da342319455f2ab3f1d998f/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:25.636575 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5442a6a0-a40a-4ffb-8f19-4b16fe035249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd1eba4e76da45579ff6cb5816c32001, user_id=182c416b9da342319455f2ab3f1d998f, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:25.639773 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5442a6a0-a40a-4ffb-8f19-4b16fe035249 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:25.688086 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 993/1994] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:39:25 2022] POST /identity/v3/users => generated 297 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:25.691962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005efb95-87cb-4da9-b959-f6d7b3cea769 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:25.704347 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005efb95-87cb-4da9-b959-f6d7b3cea769 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:25.711179 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47a5c1-5d0c-4c80-86b6-15552a1e62e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:25.713038 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:25.713469 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47a5c1-5d0c-4c80-86b6-15552a1e62e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:25.714016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47a5c1-5d0c-4c80-86b6-15552a1e62e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:25.714491 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47a5c1-5d0c-4c80-86b6-15552a1e62e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:25.715375 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a47a5c1-5d0c-4c80-86b6-15552a1e62e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:25.718267 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a47a5c1-5d0c-4c80-86b6-15552a1e62e2 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:25.723504 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:25.727652 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1002/1995] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:25 2022] PUT /identity/v3/projects/fd1eba4e76da45579ff6cb5816c32001/users/182c416b9da342319455f2ab3f1d998f/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:39:25.731464 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442a6a0-a40a-4ffb-8f19-4b16fe035249 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:25.734865 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 994/1996] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:39:25.740604 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47a5c1-5d0c-4c80-86b6-15552a1e62e2 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:25.754368 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47a5c1-5d0c-4c80-86b6-15552a1e62e2 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:25.834497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442a6a0-a40a-4ffb-8f19-4b16fe035249 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:25.845187 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692613fc-8671-4825-b8b5-452b5ad42af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:25.847331 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692613fc-8671-4825-b8b5-452b5ad42af6 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:25.847721 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692613fc-8671-4825-b8b5-452b5ad42af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:25.848347 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692613fc-8671-4825-b8b5-452b5ad42af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:25.849110 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692613fc-8671-4825-b8b5-452b5ad42af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:25.850056 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd8141-2772-4339-8eda-9f9e7c5c9e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:25.850837 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd8141-2772-4339-8eda-9f9e7c5c9e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:25.850957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692613fc-8671-4825-b8b5-452b5ad42af6 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:25.851126 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd8141-2772-4339-8eda-9f9e7c5c9e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:25.851406 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd8141-2772-4339-8eda-9f9e7c5c9e8a admin admin] PATH_INFO: `/v3/projects/97f13af88dd646f5b879b4949190d752/users/4dd5de832f3948bfaa96084a9a7ebdee/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:25.871295 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1003/1997] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:39:25.874609 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692613fc-8671-4825-b8b5-452b5ad42af6 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:25.888276 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd8141-2772-4339-8eda-9f9e7c5c9e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=97f13af88dd646f5b879b4949190d752, user_id=4dd5de832f3948bfaa96084a9a7ebdee, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:25.894978 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd8141-2772-4339-8eda-9f9e7c5c9e8a admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:25.902281 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692613fc-8671-4825-b8b5-452b5ad42af6 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:25.910075 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c57fc-8788-415c-901e-9ba24363b684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:25.910765 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c57fc-8788-415c-901e-9ba24363b684 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:25.911047 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c57fc-8788-415c-901e-9ba24363b684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:25.911336 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c57fc-8788-415c-901e-9ba24363b684 admin admin] PATH_INFO: `/v3/projects/fd1eba4e76da45579ff6cb5816c32001/users/182c416b9da342319455f2ab3f1d998f/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:25.913713 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c57fc-8788-415c-901e-9ba24363b684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd1eba4e76da45579ff6cb5816c32001, user_id=182c416b9da342319455f2ab3f1d998f, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:25.917126 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c57fc-8788-415c-901e-9ba24363b684 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:25.931183 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1004/1998] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:25 2022] PUT /identity/v3/projects/fd1eba4e76da45579ff6cb5816c32001/users/182c416b9da342319455f2ab3f1d998f/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:25.943283 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88921815-006c-417a-82ce-b53ff00dedc2 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:25.943622 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88921815-006c-417a-82ce-b53ff00dedc2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:25.943999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88921815-006c-417a-82ce-b53ff00dedc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:25.988209 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-88921815-006c-417a-82ce-b53ff00dedc2 None None] MFA Rules not processed for user `182c416b9da342319455f2ab3f1d998f`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:25.989952 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-88921815-006c-417a-82ce-b53ff00dedc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:25.997430 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 995/1999] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:25 2022] PUT /identity/v3/projects/97f13af88dd646f5b879b4949190d752/users/4dd5de832f3948bfaa96084a9a7ebdee/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:39:26.002926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd8141-2772-4339-8eda-9f9e7c5c9e8a admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:26.103706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1005/2000] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:39:26.105619 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd8141-2772-4339-8eda-9f9e7c5c9e8a admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:26.129507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d67727-5ede-41a8-a5b8-f968c679e76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:26.130427 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d67727-5ede-41a8-a5b8-f968c679e76a admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:26.130836 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d67727-5ede-41a8-a5b8-f968c679e76a admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:26.131287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d67727-5ede-41a8-a5b8-f968c679e76a admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:26.132053 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d67727-5ede-41a8-a5b8-f968c679e76a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:26.134758 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d67727-5ede-41a8-a5b8-f968c679e76a admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:26.155185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 996/2001] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:39:26.167771 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d67727-5ede-41a8-a5b8-f968c679e76a admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:26.169038 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88921815-006c-417a-82ce-b53ff00dedc2 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:26.171400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-88921815-006c-417a-82ce-b53ff00dedc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:26.182434 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d67727-5ede-41a8-a5b8-f968c679e76a admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:26.192463 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca9432-fd56-4caa-898a-3d531d5efeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:26.193198 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca9432-fd56-4caa-898a-3d531d5efeda admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:26.193511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca9432-fd56-4caa-898a-3d531d5efeda admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:26.193848 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca9432-fd56-4caa-898a-3d531d5efeda admin admin] PATH_INFO: `/v3/projects/97f13af88dd646f5b879b4949190d752/users/4dd5de832f3948bfaa96084a9a7ebdee/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:26.196666 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca9432-fd56-4caa-898a-3d531d5efeda admin admin] RBAC: Authorizing `identity:create_grant(project_id=97f13af88dd646f5b879b4949190d752, user_id=4dd5de832f3948bfaa96084a9a7ebdee, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:26.200862 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca9432-fd56-4caa-898a-3d531d5efeda admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:26.213948 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 997/2002] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:26 2022] PUT /identity/v3/projects/97f13af88dd646f5b879b4949190d752/users/4dd5de832f3948bfaa96084a9a7ebdee/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:26.225071 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c2b3e-588d-494e-a93a-f51df99126dc None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:26.225333 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c2b3e-588d-494e-a93a-f51df99126dc None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:26.225713 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c2b3e-588d-494e-a93a-f51df99126dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:26.271201 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-bc9c2b3e-588d-494e-a93a-f51df99126dc None None] MFA Rules not processed for user `4dd5de832f3948bfaa96084a9a7ebdee`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:26.272567 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-bc9c2b3e-588d-494e-a93a-f51df99126dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:26.280171 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88921815-006c-417a-82ce-b53ff00dedc2 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:26.359931 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68deee2-4c3c-40e4-8c9f-c010b4187d80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:26.359931 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68deee2-4c3c-40e4-8c9f-c010b4187d80 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:26.359931 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68deee2-4c3c-40e4-8c9f-c010b4187d80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:26.360988 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68deee2-4c3c-40e4-8c9f-c010b4187d80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:26.371515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e68deee2-4c3c-40e4-8c9f-c010b4187d80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:26.401316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:26.418135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:26.507518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 998/2003] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:39:26.508990 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c2b3e-588d-494e-a93a-f51df99126dc None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:26.515709 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-bc9c2b3e-588d-494e-a93a-f51df99126dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:26.528500 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68deee2-4c3c-40e4-8c9f-c010b4187d80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:26.529908 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68deee2-4c3c-40e4-8c9f-c010b4187d80 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:26.555635 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1006/2004] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:39:26.605307 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68deee2-4c3c-40e4-8c9f-c010b4187d80 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:26.609961 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e68deee2-4c3c-40e4-8c9f-c010b4187d80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:26.624154 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68deee2-4c3c-40e4-8c9f-c010b4187d80 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:26.639249 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c2b3e-588d-494e-a93a-f51df99126dc None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:26.640351 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942a1be-b51e-476a-8ccc-3dc04c9bb56b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:26.643993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942a1be-b51e-476a-8ccc-3dc04c9bb56b service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:26.643993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942a1be-b51e-476a-8ccc-3dc04c9bb56b service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:26.643993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942a1be-b51e-476a-8ccc-3dc04c9bb56b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:26.646937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cda950-ad7b-44e0-b66a-757cd748863c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:26.650059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cda950-ad7b-44e0-b66a-757cd748863c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:26.650342 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cda950-ad7b-44e0-b66a-757cd748863c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:26.651148 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cda950-ad7b-44e0-b66a-757cd748863c admin admin] PATH_INFO: `/v3/projects/af8056a8427d4147b38dbd147d59c777` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:26.652601 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cda950-ad7b-44e0-b66a-757cd748863c admin admin] RBAC: Authorizing `identity:delete_project(project_id=af8056a8427d4147b38dbd147d59c777)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:26.654791 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cda950-ad7b-44e0-b66a-757cd748863c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:26.661986 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942a1be-b51e-476a-8ccc-3dc04c9bb56b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:26.666177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942a1be-b51e-476a-8ccc-3dc04c9bb56b service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:26.691463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1007/2005] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:39:26.815537 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a1cda950-ad7b-44e0-b66a-757cd748863c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af8056a8427d4147b38dbd147d59c777', 'request_id': 'req-a1cda950-ad7b-44e0-b66a-757cd748863c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:26.911420 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a1cda950-ad7b-44e0-b66a-757cd748863c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af8056a8427d4147b38dbd147d59c777', 'request_id': 'req-a1cda950-ad7b-44e0-b66a-757cd748863c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:26.922198 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a1cda950-ad7b-44e0-b66a-757cd748863c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af8056a8427d4147b38dbd147d59c777', 'request_id': 'req-a1cda950-ad7b-44e0-b66a-757cd748863c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:26.934315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a1cda950-ad7b-44e0-b66a-757cd748863c admin admin] The token cache is being invalidate because project af8056a8427d4147b38dbd147d59c777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:39:26.934680 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a1cda950-ad7b-44e0-b66a-757cd748863c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:26.935382 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a1cda950-ad7b-44e0-b66a-757cd748863c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:26.945103 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 999/2006] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:39:26 2022] DELETE /identity/v3/projects/af8056a8427d4147b38dbd147d59c777 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:26.945192 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942a1be-b51e-476a-8ccc-3dc04c9bb56b service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:26.952494 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942a1be-b51e-476a-8ccc-3dc04c9bb56b service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:27.018717 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd9464-9929-4895-9ec3-a05fe9a1d81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:27.019498 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd9464-9929-4895-9ec3-a05fe9a1d81b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:27.019872 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd9464-9929-4895-9ec3-a05fe9a1d81b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:27.020147 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd9464-9929-4895-9ec3-a05fe9a1d81b admin admin] PATH_INFO: `/v3/users/df940dad52ca49949a1e397f4e7a3757` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:27.021332 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd9464-9929-4895-9ec3-a05fe9a1d81b admin admin] RBAC: Authorizing `identity:delete_user(user_id=df940dad52ca49949a1e397f4e7a3757)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:27.023343 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd9464-9929-4895-9ec3-a05fe9a1d81b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:27.152085 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cda950-ad7b-44e0-b66a-757cd748863c admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:27.152085 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a1cda950-ad7b-44e0-b66a-757cd748863c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:27.233730 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cda950-ad7b-44e0-b66a-757cd748863c admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:27.238775 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50afe4-048e-45e8-86fe-1a5cc319275f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:27.239365 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50afe4-048e-45e8-86fe-1a5cc319275f service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:27.239717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50afe4-048e-45e8-86fe-1a5cc319275f service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:27.240358 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50afe4-048e-45e8-86fe-1a5cc319275f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:27.242225 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9a50afe4-048e-45e8-86fe-1a5cc319275f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:27.249388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:27.251378 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ccdd9464-9929-4895-9ec3-a05fe9a1d81b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df940dad52ca49949a1e397f4e7a3757'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:27.252203 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ccdd9464-9929-4895-9ec3-a05fe9a1d81b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df940dad52ca49949a1e397f4e7a3757'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:27.252833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ccdd9464-9929-4895-9ec3-a05fe9a1d81b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df940dad52ca49949a1e397f4e7a3757'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:27.272151 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ccdd9464-9929-4895-9ec3-a05fe9a1d81b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df940dad52ca49949a1e397f4e7a3757'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:27.288446 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:27.318373 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50afe4-048e-45e8-86fe-1a5cc319275f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:27.319727 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50afe4-048e-45e8-86fe-1a5cc319275f service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:27.330353 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1000/2007] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:39:27.361442 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ccdd9464-9929-4895-9ec3-a05fe9a1d81b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df940dad52ca49949a1e397f4e7a3757'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:27.378859 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1008/2008] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:39:26 2022] DELETE /identity/v3/users/df940dad52ca49949a1e397f4e7a3757 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:39:28.250717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50afe4-048e-45e8-86fe-1a5cc319275f service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:28.252359 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9a50afe4-048e-45e8-86fe-1a5cc319275f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:28.276065 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50afe4-048e-45e8-86fe-1a5cc319275f service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:28.363895 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72416c59-4af5-465e-add6-1dacd63262cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:28.364525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72416c59-4af5-465e-add6-1dacd63262cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:28.364802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72416c59-4af5-465e-add6-1dacd63262cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:28.365079 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72416c59-4af5-465e-add6-1dacd63262cc admin admin] PATH_INFO: `/v3/projects/ba8e67acfef2450cb3e77c1732683b96` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:28.366273 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72416c59-4af5-465e-add6-1dacd63262cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba8e67acfef2450cb3e77c1732683b96)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:28.368230 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72416c59-4af5-465e-add6-1dacd63262cc admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:28.470256 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-72416c59-4af5-465e-add6-1dacd63262cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba8e67acfef2450cb3e77c1732683b96', 'request_id': 'req-72416c59-4af5-465e-add6-1dacd63262cc'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:28.568383 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-72416c59-4af5-465e-add6-1dacd63262cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba8e67acfef2450cb3e77c1732683b96', 'request_id': 'req-72416c59-4af5-465e-add6-1dacd63262cc'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:28.583335 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-72416c59-4af5-465e-add6-1dacd63262cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba8e67acfef2450cb3e77c1732683b96', 'request_id': 'req-72416c59-4af5-465e-add6-1dacd63262cc'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:28.596641 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-72416c59-4af5-465e-add6-1dacd63262cc admin admin] The token cache is being invalidate because project ba8e67acfef2450cb3e77c1732683b96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:39:28.596930 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-72416c59-4af5-465e-add6-1dacd63262cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:28.598013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-72416c59-4af5-465e-add6-1dacd63262cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:28.599632 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1001/2009] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:39:28 2022] DELETE /identity/v3/projects/ba8e67acfef2450cb3e77c1732683b96 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:28.604967 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd305ae-4fe6-4dda-9e68-5fbaa110b1e0 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:28.606057 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd305ae-4fe6-4dda-9e68-5fbaa110b1e0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:28.607081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd305ae-4fe6-4dda-9e68-5fbaa110b1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:28.638174 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ecd305ae-4fe6-4dda-9e68-5fbaa110b1e0 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:28.640724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ecd305ae-4fe6-4dda-9e68-5fbaa110b1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:28.739289 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738dbad-1941-4359-ab56-6130af528d83 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:28.739583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738dbad-1941-4359-ab56-6130af528d83 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:28.739895 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738dbad-1941-4359-ab56-6130af528d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:28.744108 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1009/2010] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:28.777804 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-e738dbad-1941-4359-ab56-6130af528d83 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:28.777804 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e738dbad-1941-4359-ab56-6130af528d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:28.788369 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1002/2011] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:28.792668 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd305ae-4fe6-4dda-9e68-5fbaa110b1e0 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:28.806252 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd305ae-4fe6-4dda-9e68-5fbaa110b1e0 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:28.815977 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ea20a-92be-4693-bcd5-03180c7433ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:28.815977 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ea20a-92be-4693-bcd5-03180c7433ec admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:28.815977 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ea20a-92be-4693-bcd5-03180c7433ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:28.815977 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ea20a-92be-4693-bcd5-03180c7433ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:28.816319 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ea20a-92be-4693-bcd5-03180c7433ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:28.816319 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ea20a-92be-4693-bcd5-03180c7433ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:28.817478 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ea20a-92be-4693-bcd5-03180c7433ec admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:28.855938 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1010/2012] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:28.861893 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738dbad-1941-4359-ab56-6130af528d83 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:28.873778 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738dbad-1941-4359-ab56-6130af528d83 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:28.884184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1dd95-59d1-4a46-a37f-db83ca3ad0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:28.884746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1dd95-59d1-4a46-a37f-db83ca3ad0b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:28.885030 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1dd95-59d1-4a46-a37f-db83ca3ad0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:28.885306 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1dd95-59d1-4a46-a37f-db83ca3ad0b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:28.886001 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1dd95-59d1-4a46-a37f-db83ca3ad0b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:28.888980 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1dd95-59d1-4a46-a37f-db83ca3ad0b8 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:29.020026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1003/2013] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:39:28 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:29.021507 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ea20a-92be-4693-bcd5-03180c7433ec admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:29.035931 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ea20a-92be-4693-bcd5-03180c7433ec admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:29.147686 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c567f76-e6fa-4d96-9013-dffd872eb8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:29.148310 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c567f76-e6fa-4d96-9013-dffd872eb8ea admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:29.148600 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c567f76-e6fa-4d96-9013-dffd872eb8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:29.151087 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c567f76-e6fa-4d96-9013-dffd872eb8ea admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:29.151087 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c567f76-e6fa-4d96-9013-dffd872eb8ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:29.152810 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c567f76-e6fa-4d96-9013-dffd872eb8ea admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:29.322171 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1011/2014] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:39:29 2022] POST /identity/v3/users => generated 294 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:29.323416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1dd95-59d1-4a46-a37f-db83ca3ad0b8 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:29.334820 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1dd95-59d1-4a46-a37f-db83ca3ad0b8 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:29.340888 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747d5d8-ba0a-4d5e-b534-196964d6ed4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:29.341533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747d5d8-ba0a-4d5e-b534-196964d6ed4a admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:29.343669 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747d5d8-ba0a-4d5e-b534-196964d6ed4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:29.343669 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747d5d8-ba0a-4d5e-b534-196964d6ed4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:29.343669 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747d5d8-ba0a-4d5e-b534-196964d6ed4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:29.344988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747d5d8-ba0a-4d5e-b534-196964d6ed4a admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:29.359786 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1004/2015] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:39:29.362644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c567f76-e6fa-4d96-9013-dffd872eb8ea admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:29.373171 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c567f76-e6fa-4d96-9013-dffd872eb8ea admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:29.378250 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309cb174-230d-4987-ab1b-5e7e4545eb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:29.378955 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309cb174-230d-4987-ab1b-5e7e4545eb53 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:29.379233 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309cb174-230d-4987-ab1b-5e7e4545eb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:29.379551 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309cb174-230d-4987-ab1b-5e7e4545eb53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:29.380194 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309cb174-230d-4987-ab1b-5e7e4545eb53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:29.381896 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309cb174-230d-4987-ab1b-5e7e4545eb53 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:29.396854 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1012/2016] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:29.401266 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747d5d8-ba0a-4d5e-b534-196964d6ed4a admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:29.416267 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747d5d8-ba0a-4d5e-b534-196964d6ed4a admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:29.421661 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155fa08-7d87-48c0-bc8b-25e7dcf19c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:29.422443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155fa08-7d87-48c0-bc8b-25e7dcf19c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:29.423631 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155fa08-7d87-48c0-bc8b-25e7dcf19c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:29.424272 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155fa08-7d87-48c0-bc8b-25e7dcf19c3a admin admin] PATH_INFO: `/v3/projects/1fd3272ee67e4ae2944c180f2d55658b/users/9d76903466384a9c8100eea489f131f3/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:29.444744 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155fa08-7d87-48c0-bc8b-25e7dcf19c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fd3272ee67e4ae2944c180f2d55658b, user_id=9d76903466384a9c8100eea489f131f3, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:29.447555 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155fa08-7d87-48c0-bc8b-25e7dcf19c3a admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:29.510458 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:29.515448 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1005/2017] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:29 2022] PUT /identity/v3/projects/1fd3272ee67e4ae2944c180f2d55658b/users/9d76903466384a9c8100eea489f131f3/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:29.527391 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1198b-1525-42cd-8051-3dccf11cdde4 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:29.527727 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1198b-1525-42cd-8051-3dccf11cdde4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:29.527968 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1198b-1525-42cd-8051-3dccf11cdde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:29.570286 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-16a1198b-1525-42cd-8051-3dccf11cdde4 None None] MFA Rules not processed for user `9d76903466384a9c8100eea489f131f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:29.575578 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-16a1198b-1525-42cd-8051-3dccf11cdde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:29.605916 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:29.661031 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1013/2018] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:29.665280 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155fa08-7d87-48c0-bc8b-25e7dcf19c3a admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:29.754832 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155fa08-7d87-48c0-bc8b-25e7dcf19c3a admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:29.760498 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887135cb-cd25-494b-a556-52391970a812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:29.761228 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887135cb-cd25-494b-a556-52391970a812 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:29.761577 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887135cb-cd25-494b-a556-52391970a812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:29.761958 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887135cb-cd25-494b-a556-52391970a812 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:29.762606 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887135cb-cd25-494b-a556-52391970a812 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:29.765230 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887135cb-cd25-494b-a556-52391970a812 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:29.872970 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1006/2019] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:39:29 2022] POST /identity/v3/projects => generated 389 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:29.876514 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1198b-1525-42cd-8051-3dccf11cdde4 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:29.890406 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1198b-1525-42cd-8051-3dccf11cdde4 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:29.964506 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd00f3-5c6c-45b6-a490-22006d462184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:29.965248 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd00f3-5c6c-45b6-a490-22006d462184 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:29.965533 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd00f3-5c6c-45b6-a490-22006d462184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:29.965841 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd00f3-5c6c-45b6-a490-22006d462184 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:29.969915 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd00f3-5c6c-45b6-a490-22006d462184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:29.972140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd00f3-5c6c-45b6-a490-22006d462184 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:30.043412 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887135cb-cd25-494b-a556-52391970a812 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:30.046485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-887135cb-cd25-494b-a556-52391970a812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:30.057930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1014/2020] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:39:29 2022] POST /identity/v3/users => generated 301 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:30.061516 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd00f3-5c6c-45b6-a490-22006d462184 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:30.071525 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd00f3-5c6c-45b6-a490-22006d462184 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:30.076900 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b3ccb-84e9-419f-b175-ff28a66aa9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:30.077422 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b3ccb-84e9-419f-b175-ff28a66aa9fb admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:30.077741 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b3ccb-84e9-419f-b175-ff28a66aa9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:30.078035 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b3ccb-84e9-419f-b175-ff28a66aa9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:30.078677 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b3ccb-84e9-419f-b175-ff28a66aa9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:30.080529 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b3ccb-84e9-419f-b175-ff28a66aa9fb admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:30.093010 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1015/2021] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:39:30.097793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b3ccb-84e9-419f-b175-ff28a66aa9fb admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:30.109535 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b3ccb-84e9-419f-b175-ff28a66aa9fb admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:30.115198 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887135cb-cd25-494b-a556-52391970a812 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:30.116034 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595d4d6-3951-469c-89ba-a20366085c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:30.116734 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595d4d6-3951-469c-89ba-a20366085c3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:30.117018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595d4d6-3951-469c-89ba-a20366085c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:30.117292 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595d4d6-3951-469c-89ba-a20366085c3f admin admin] PATH_INFO: `/v3/projects/868752e06fba436d8fce74ab5e2568a9/users/ae4f70909d9a406385be29ae709d30cd/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:30.118989 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8a1fa-5be3-4e4c-9698-9127589a7153 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:30.119593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8a1fa-5be3-4e4c-9698-9127589a7153 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:30.119892 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8a1fa-5be3-4e4c-9698-9127589a7153 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:30.120151 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8a1fa-5be3-4e4c-9698-9127589a7153 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:30.122267 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-52c8a1fa-5be3-4e4c-9698-9127589a7153 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:30.134384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595d4d6-3951-469c-89ba-a20366085c3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=868752e06fba436d8fce74ab5e2568a9, user_id=ae4f70909d9a406385be29ae709d30cd, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:30.137077 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595d4d6-3951-469c-89ba-a20366085c3f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:30.184326 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8a1fa-5be3-4e4c-9698-9127589a7153 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:30.185876 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8a1fa-5be3-4e4c-9698-9127589a7153 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:30.196282 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1007/2022] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:39:30.229152 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1016/2023] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:30 2022] PUT /identity/v3/projects/868752e06fba436d8fce74ab5e2568a9/users/ae4f70909d9a406385be29ae709d30cd/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:30.234377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8a1fa-5be3-4e4c-9698-9127589a7153 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:30.248183 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8a1fa-5be3-4e4c-9698-9127589a7153 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:30.316589 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:30.350559 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768818f-f0de-4ea9-a94d-da10722524b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:30.351179 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768818f-f0de-4ea9-a94d-da10722524b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:30.351666 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768818f-f0de-4ea9-a94d-da10722524b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:30.351947 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768818f-f0de-4ea9-a94d-da10722524b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:30.352602 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768818f-f0de-4ea9-a94d-da10722524b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:30.354239 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768818f-f0de-4ea9-a94d-da10722524b7 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:30.366236 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1008/2024] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:30.370536 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595d4d6-3951-469c-89ba-a20366085c3f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:30.381798 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595d4d6-3951-469c-89ba-a20366085c3f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:30.386486 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a533bb-6522-40a7-8d7f-315d74d457f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:30.387143 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a533bb-6522-40a7-8d7f-315d74d457f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:30.387419 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a533bb-6522-40a7-8d7f-315d74d457f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:30.387693 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a533bb-6522-40a7-8d7f-315d74d457f9 admin admin] PATH_INFO: `/v3/projects/868752e06fba436d8fce74ab5e2568a9/users/ae4f70909d9a406385be29ae709d30cd/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:30.391129 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a533bb-6522-40a7-8d7f-315d74d457f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=868752e06fba436d8fce74ab5e2568a9, user_id=ae4f70909d9a406385be29ae709d30cd, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:30.394742 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a533bb-6522-40a7-8d7f-315d74d457f9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:30.405584 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1017/2025] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:30 2022] PUT /identity/v3/projects/868752e06fba436d8fce74ab5e2568a9/users/ae4f70909d9a406385be29ae709d30cd/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:30.416814 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e3dee-f962-4f5d-b5f0-53a18577fcac None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:30.417473 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e3dee-f962-4f5d-b5f0-53a18577fcac None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:30.417473 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e3dee-f962-4f5d-b5f0-53a18577fcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:30.460701 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-417e3dee-f962-4f5d-b5f0-53a18577fcac None None] MFA Rules not processed for user `ae4f70909d9a406385be29ae709d30cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:30.462008 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-417e3dee-f962-4f5d-b5f0-53a18577fcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:30.534587 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1009/2026] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:30 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:30.590870 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a533bb-6522-40a7-8d7f-315d74d457f9 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:30.592759 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d1a533bb-6522-40a7-8d7f-315d74d457f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:30.662513 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a533bb-6522-40a7-8d7f-315d74d457f9 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:30.666260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14baf6-16b2-405a-94cd-dcca4b3e967a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:30.666941 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14baf6-16b2-405a-94cd-dcca4b3e967a service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:30.667290 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14baf6-16b2-405a-94cd-dcca4b3e967a service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:30.667560 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14baf6-16b2-405a-94cd-dcca4b3e967a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:30.678365 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14baf6-16b2-405a-94cd-dcca4b3e967a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:30.680241 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14baf6-16b2-405a-94cd-dcca4b3e967a service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:30.695350 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1018/2027] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:30 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:39:31.259289 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e3dee-f962-4f5d-b5f0-53a18577fcac None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:31.347673 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e3dee-f962-4f5d-b5f0-53a18577fcac None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:31.352665 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff11cfd-1317-45bf-b8c6-72972e115aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:31.353432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff11cfd-1317-45bf-b8c6-72972e115aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:31.353710 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff11cfd-1317-45bf-b8c6-72972e115aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:31.354011 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff11cfd-1317-45bf-b8c6-72972e115aae admin admin] PATH_INFO: `/v3/users/9d76903466384a9c8100eea489f131f3` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:31.355194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff11cfd-1317-45bf-b8c6-72972e115aae admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d76903466384a9c8100eea489f131f3)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:31.357143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff11cfd-1317-45bf-b8c6-72972e115aae admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:31.565540 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dff11cfd-1317-45bf-b8c6-72972e115aae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d76903466384a9c8100eea489f131f3'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:31.566412 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dff11cfd-1317-45bf-b8c6-72972e115aae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d76903466384a9c8100eea489f131f3'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:31.586439 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:31.589863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dff11cfd-1317-45bf-b8c6-72972e115aae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d76903466384a9c8100eea489f131f3'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:31.592161 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dff11cfd-1317-45bf-b8c6-72972e115aae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d76903466384a9c8100eea489f131f3'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:31.705875 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dff11cfd-1317-45bf-b8c6-72972e115aae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d76903466384a9c8100eea489f131f3'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:31.729189 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1010/2028] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:39:31 2022] DELETE /identity/v3/users/9d76903466384a9c8100eea489f131f3 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:31.734056 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617d13e-2925-42d7-ba22-1e9cf9601956 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:31.734510 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617d13e-2925-42d7-ba22-1e9cf9601956 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:31.734731 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617d13e-2925-42d7-ba22-1e9cf9601956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:31.742869 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:31.754629 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-1617d13e-2925-42d7-ba22-1e9cf9601956 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:31.755852 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1617d13e-2925-42d7-ba22-1e9cf9601956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:31.821506 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1019/2029] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:31.836508 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff11cfd-1317-45bf-b8c6-72972e115aae admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:31.838308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-dff11cfd-1317-45bf-b8c6-72972e115aae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:31.915499 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff11cfd-1317-45bf-b8c6-72972e115aae admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:31.920902 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5049563-c4f0-419d-aae4-1bedd491d77b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:31.921515 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5049563-c4f0-419d-aae4-1bedd491d77b service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:31.921835 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5049563-c4f0-419d-aae4-1bedd491d77b service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:31.922113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5049563-c4f0-419d-aae4-1bedd491d77b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:31.934344 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5049563-c4f0-419d-aae4-1bedd491d77b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:31.935788 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5049563-c4f0-419d-aae4-1bedd491d77b service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:31.947909 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1011/2030] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:39:32.003979 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617d13e-2925-42d7-ba22-1e9cf9601956 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:32.005812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1617d13e-2925-42d7-ba22-1e9cf9601956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:32.073890 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617d13e-2925-42d7-ba22-1e9cf9601956 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:32.078296 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83f8ea-4f3e-49d7-b963-21f91b239152 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:32.078978 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83f8ea-4f3e-49d7-b963-21f91b239152 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:32.079259 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83f8ea-4f3e-49d7-b963-21f91b239152 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:32.079759 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83f8ea-4f3e-49d7-b963-21f91b239152 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:32.082025 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4d83f8ea-4f3e-49d7-b963-21f91b239152 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:32.168237 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d83f8ea-4f3e-49d7-b963-21f91b239152 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:32.169767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d83f8ea-4f3e-49d7-b963-21f91b239152 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:32.185785 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1020/2031] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:39:32.275337 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5049563-c4f0-419d-aae4-1bedd491d77b service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:32.277200 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d5049563-c4f0-419d-aae4-1bedd491d77b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:32.292405 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5049563-c4f0-419d-aae4-1bedd491d77b service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:32.297309 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a97f41-c433-46b4-b2b9-4d5bcedcec15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:32.299565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a97f41-c433-46b4-b2b9-4d5bcedcec15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:32.300274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a97f41-c433-46b4-b2b9-4d5bcedcec15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:32.300651 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a97f41-c433-46b4-b2b9-4d5bcedcec15 admin admin] PATH_INFO: `/v3/users/8694e3239e3541a1ae47cef210e51928` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:32.302234 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a97f41-c433-46b4-b2b9-4d5bcedcec15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8694e3239e3541a1ae47cef210e51928)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:32.304663 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a97f41-c433-46b4-b2b9-4d5bcedcec15 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:32.444963 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83f8ea-4f3e-49d7-b963-21f91b239152 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:32.446551 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4d83f8ea-4f3e-49d7-b963-21f91b239152 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:32.471898 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83f8ea-4f3e-49d7-b963-21f91b239152 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:32.478134 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e2de7-1476-4ffc-abb2-90b13b9bf196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:32.478804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e2de7-1476-4ffc-abb2-90b13b9bf196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:32.479269 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e2de7-1476-4ffc-abb2-90b13b9bf196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:32.479547 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e2de7-1476-4ffc-abb2-90b13b9bf196 admin admin] PATH_INFO: `/v3/projects/1fd3272ee67e4ae2944c180f2d55658b` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:32.480785 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e2de7-1476-4ffc-abb2-90b13b9bf196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fd3272ee67e4ae2944c180f2d55658b)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:32.483165 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e2de7-1476-4ffc-abb2-90b13b9bf196 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:32.540783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d8a97f41-c433-46b4-b2b9-4d5bcedcec15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8694e3239e3541a1ae47cef210e51928'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:32.541453 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d8a97f41-c433-46b4-b2b9-4d5bcedcec15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8694e3239e3541a1ae47cef210e51928'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:32.557841 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d8a97f41-c433-46b4-b2b9-4d5bcedcec15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8694e3239e3541a1ae47cef210e51928'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:32.558671 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d8a97f41-c433-46b4-b2b9-4d5bcedcec15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8694e3239e3541a1ae47cef210e51928'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:32.601939 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:32.603330 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b71e2de7-1476-4ffc-abb2-90b13b9bf196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fd3272ee67e4ae2944c180f2d55658b', 'request_id': 'req-b71e2de7-1476-4ffc-abb2-90b13b9bf196'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:32.677882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d8a97f41-c433-46b4-b2b9-4d5bcedcec15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8694e3239e3541a1ae47cef210e51928'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:32.695826 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1012/2032] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:39:32 2022] DELETE /identity/v3/users/8694e3239e3541a1ae47cef210e51928 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:32.700637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3bda6-38e7-47e7-85e5-292a88225557 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:32.701078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3bda6-38e7-47e7-85e5-292a88225557 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:32.701458 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3bda6-38e7-47e7-85e5-292a88225557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:32.723451 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-efe3bda6-38e7-47e7-85e5-292a88225557 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:32.724766 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-efe3bda6-38e7-47e7-85e5-292a88225557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:32.762400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b71e2de7-1476-4ffc-abb2-90b13b9bf196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fd3272ee67e4ae2944c180f2d55658b', 'request_id': 'req-b71e2de7-1476-4ffc-abb2-90b13b9bf196'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:32.770136 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b71e2de7-1476-4ffc-abb2-90b13b9bf196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fd3272ee67e4ae2944c180f2d55658b', 'request_id': 'req-b71e2de7-1476-4ffc-abb2-90b13b9bf196'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:32.783443 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b71e2de7-1476-4ffc-abb2-90b13b9bf196 admin admin] The token cache is being invalidate because project 1fd3272ee67e4ae2944c180f2d55658b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:39:32.784038 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b71e2de7-1476-4ffc-abb2-90b13b9bf196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:32.784992 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b71e2de7-1476-4ffc-abb2-90b13b9bf196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:32.787096 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1021/2033] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:39:32 2022] DELETE /identity/v3/projects/1fd3272ee67e4ae2944c180f2d55658b => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:32.791079 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e2de7-1476-4ffc-abb2-90b13b9bf196 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:32.797586 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b71e2de7-1476-4ffc-abb2-90b13b9bf196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:32.820890 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:32.848512 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1013/2034] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:39:32.860142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3bda6-38e7-47e7-85e5-292a88225557 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:32.862716 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-efe3bda6-38e7-47e7-85e5-292a88225557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:32.897353 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e2de7-1476-4ffc-abb2-90b13b9bf196 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:32.903338 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1d795-944f-479b-badf-d9580397adfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:32.903980 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1d795-944f-479b-badf-d9580397adfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:32.904257 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1d795-944f-479b-badf-d9580397adfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:32.904529 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1d795-944f-479b-badf-d9580397adfc admin admin] PATH_INFO: `/v3/users/ae4f70909d9a406385be29ae709d30cd` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:32.911182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed1d795-944f-479b-badf-d9580397adfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae4f70909d9a406385be29ae709d30cd)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:32.913184 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed1d795-944f-479b-badf-d9580397adfc admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:32.930748 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3bda6-38e7-47e7-85e5-292a88225557 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:32.935728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec653368-5aa3-4ee8-b384-6ed6d8b91068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:32.936371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec653368-5aa3-4ee8-b384-6ed6d8b91068 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:32.937288 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec653368-5aa3-4ee8-b384-6ed6d8b91068 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:32.937288 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec653368-5aa3-4ee8-b384-6ed6d8b91068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:32.947610 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec653368-5aa3-4ee8-b384-6ed6d8b91068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:32.949121 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec653368-5aa3-4ee8-b384-6ed6d8b91068 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:32.960017 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1014/2035] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:39:33.118087 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-bed1d795-944f-479b-badf-d9580397adfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae4f70909d9a406385be29ae709d30cd'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:33.118903 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-bed1d795-944f-479b-badf-d9580397adfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae4f70909d9a406385be29ae709d30cd'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:33.119526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-bed1d795-944f-479b-badf-d9580397adfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae4f70909d9a406385be29ae709d30cd'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:33.142445 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-bed1d795-944f-479b-badf-d9580397adfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae4f70909d9a406385be29ae709d30cd'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:33.143534 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec653368-5aa3-4ee8-b384-6ed6d8b91068 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:33.145265 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ec653368-5aa3-4ee8-b384-6ed6d8b91068 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:33.159872 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec653368-5aa3-4ee8-b384-6ed6d8b91068 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:33.164793 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da07e1e-be1a-46c3-9300-2e8556b41548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:33.165451 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da07e1e-be1a-46c3-9300-2e8556b41548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:33.170571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da07e1e-be1a-46c3-9300-2e8556b41548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:33.170571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da07e1e-be1a-46c3-9300-2e8556b41548 admin admin] PATH_INFO: `/v3/users/4cfb8ca73c954b479d2c8cd8b6fa72b7` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:33.170571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da07e1e-be1a-46c3-9300-2e8556b41548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cfb8ca73c954b479d2c8cd8b6fa72b7)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:33.170571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da07e1e-be1a-46c3-9300-2e8556b41548 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:33.248482 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-bed1d795-944f-479b-badf-d9580397adfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae4f70909d9a406385be29ae709d30cd'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:33.274278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1022/2036] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:39:32 2022] DELETE /identity/v3/users/ae4f70909d9a406385be29ae709d30cd => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:33.381604 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9da07e1e-be1a-46c3-9300-2e8556b41548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cfb8ca73c954b479d2c8cd8b6fa72b7'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:33.382752 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1d795-944f-479b-badf-d9580397adfc admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:33.384357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-bed1d795-944f-479b-badf-d9580397adfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:33.385832 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9da07e1e-be1a-46c3-9300-2e8556b41548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cfb8ca73c954b479d2c8cd8b6fa72b7'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:33.405215 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9da07e1e-be1a-46c3-9300-2e8556b41548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cfb8ca73c954b479d2c8cd8b6fa72b7'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:33.406214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9da07e1e-be1a-46c3-9300-2e8556b41548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cfb8ca73c954b479d2c8cd8b6fa72b7'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:33.483053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:33.489285 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1d795-944f-479b-badf-d9580397adfc admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:33.491784 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9da07e1e-be1a-46c3-9300-2e8556b41548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cfb8ca73c954b479d2c8cd8b6fa72b7'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:33.501201 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e92cc2-884b-4e98-a6bb-c2c19ae38f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:33.502075 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e92cc2-884b-4e98-a6bb-c2c19ae38f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:33.502463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e92cc2-884b-4e98-a6bb-c2c19ae38f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:33.502836 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e92cc2-884b-4e98-a6bb-c2c19ae38f46 admin admin] PATH_INFO: `/v3/projects/ffb6a7618c624fecacde6e3454140edf` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:33.504295 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e92cc2-884b-4e98-a6bb-c2c19ae38f46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffb6a7618c624fecacde6e3454140edf)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:33.506660 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e92cc2-884b-4e98-a6bb-c2c19ae38f46 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:33.509782 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1015/2037] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:39:33 2022] DELETE /identity/v3/users/4cfb8ca73c954b479d2c8cd8b6fa72b7 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:39:33.513730 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30957a-c886-4e93-a28d-5a1300ff6a4b None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:33.514691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30957a-c886-4e93-a28d-5a1300ff6a4b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:33.514965 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30957a-c886-4e93-a28d-5a1300ff6a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:33.543698 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-6e30957a-c886-4e93-a28d-5a1300ff6a4b None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:33.545162 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6e30957a-c886-4e93-a28d-5a1300ff6a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:33.628432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1016/2038] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:39:33.638104 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30957a-c886-4e93-a28d-5a1300ff6a4b None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:33.640174 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6e30957a-c886-4e93-a28d-5a1300ff6a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:33.654801 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-13e92cc2-884b-4e98-a6bb-c2c19ae38f46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffb6a7618c624fecacde6e3454140edf', 'request_id': 'req-13e92cc2-884b-4e98-a6bb-c2c19ae38f46'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:33.656581 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:33.709681 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30957a-c886-4e93-a28d-5a1300ff6a4b None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:33.738695 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-13e92cc2-884b-4e98-a6bb-c2c19ae38f46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffb6a7618c624fecacde6e3454140edf', 'request_id': 'req-13e92cc2-884b-4e98-a6bb-c2c19ae38f46'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:33.748572 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-13e92cc2-884b-4e98-a6bb-c2c19ae38f46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffb6a7618c624fecacde6e3454140edf', 'request_id': 'req-13e92cc2-884b-4e98-a6bb-c2c19ae38f46'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:33.769869 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-13e92cc2-884b-4e98-a6bb-c2c19ae38f46 admin admin] The token cache is being invalidate because project ffb6a7618c624fecacde6e3454140edf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:39:33.770515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-13e92cc2-884b-4e98-a6bb-c2c19ae38f46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:33.771122 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-13e92cc2-884b-4e98-a6bb-c2c19ae38f46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:33.773061 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1023/2039] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:39:33 2022] DELETE /identity/v3/projects/ffb6a7618c624fecacde6e3454140edf => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:39:33.775717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8665e7-bce8-4f46-a5b2-c19947738403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:33.776592 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8665e7-bce8-4f46-a5b2-c19947738403 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:33.776875 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8665e7-bce8-4f46-a5b2-c19947738403 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:33.777026 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e92cc2-884b-4e98-a6bb-c2c19ae38f46 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:33.777135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8665e7-bce8-4f46-a5b2-c19947738403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:33.779342 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6c8665e7-bce8-4f46-a5b2-c19947738403 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:33.779503 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-13e92cc2-884b-4e98-a6bb-c2c19ae38f46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:33.874738 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e92cc2-884b-4e98-a6bb-c2c19ae38f46 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:33.875075 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8665e7-bce8-4f46-a5b2-c19947738403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:33.876799 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8665e7-bce8-4f46-a5b2-c19947738403 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:33.882729 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711551f2-ed54-4812-8349-581ebabd5355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:33.883655 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711551f2-ed54-4812-8349-581ebabd5355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:33.884972 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711551f2-ed54-4812-8349-581ebabd5355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:33.884972 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711551f2-ed54-4812-8349-581ebabd5355 admin admin] PATH_INFO: `/v3/users/4dd5de832f3948bfaa96084a9a7ebdee` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:33.887958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711551f2-ed54-4812-8349-581ebabd5355 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dd5de832f3948bfaa96084a9a7ebdee)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:33.892648 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1017/2040] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:39:33.893056 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711551f2-ed54-4812-8349-581ebabd5355 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:33.893870 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8665e7-bce8-4f46-a5b2-c19947738403 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:33.895716 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6c8665e7-bce8-4f46-a5b2-c19947738403 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:33.912002 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8665e7-bce8-4f46-a5b2-c19947738403 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:33.920536 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf44c6-fd30-4bae-a9c6-2bbd3f7fbce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:33.928059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf44c6-fd30-4bae-a9c6-2bbd3f7fbce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:33.928059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf44c6-fd30-4bae-a9c6-2bbd3f7fbce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:33.928059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf44c6-fd30-4bae-a9c6-2bbd3f7fbce1 admin admin] PATH_INFO: `/v3/projects/868752e06fba436d8fce74ab5e2568a9` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:33.928059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf44c6-fd30-4bae-a9c6-2bbd3f7fbce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=868752e06fba436d8fce74ab5e2568a9)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:33.929180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf44c6-fd30-4bae-a9c6-2bbd3f7fbce1 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:34.139841 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-711551f2-ed54-4812-8349-581ebabd5355 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dd5de832f3948bfaa96084a9a7ebdee'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:34.141924 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-711551f2-ed54-4812-8349-581ebabd5355 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dd5de832f3948bfaa96084a9a7ebdee'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:34.143085 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-711551f2-ed54-4812-8349-581ebabd5355 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dd5de832f3948bfaa96084a9a7ebdee'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:34.154057 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c1bf44c6-fd30-4bae-a9c6-2bbd3f7fbce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '868752e06fba436d8fce74ab5e2568a9', 'request_id': 'req-c1bf44c6-fd30-4bae-a9c6-2bbd3f7fbce1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:34.163311 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-711551f2-ed54-4812-8349-581ebabd5355 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dd5de832f3948bfaa96084a9a7ebdee'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:34.289048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c1bf44c6-fd30-4bae-a9c6-2bbd3f7fbce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '868752e06fba436d8fce74ab5e2568a9', 'request_id': 'req-c1bf44c6-fd30-4bae-a9c6-2bbd3f7fbce1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:34.297419 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c1bf44c6-fd30-4bae-a9c6-2bbd3f7fbce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '868752e06fba436d8fce74ab5e2568a9', 'request_id': 'req-c1bf44c6-fd30-4bae-a9c6-2bbd3f7fbce1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:34.308472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c1bf44c6-fd30-4bae-a9c6-2bbd3f7fbce1 admin admin] The token cache is being invalidate because project 868752e06fba436d8fce74ab5e2568a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:39:34.308717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c1bf44c6-fd30-4bae-a9c6-2bbd3f7fbce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:34.309536 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c1bf44c6-fd30-4bae-a9c6-2bbd3f7fbce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:34.311625 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1018/2041] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:39:33 2022] DELETE /identity/v3/projects/868752e06fba436d8fce74ab5e2568a9 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:34.316680 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd0fa5-3977-43a9-8b6a-851f9e9ab961 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:34.316960 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd0fa5-3977-43a9-8b6a-851f9e9ab961 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:34.317260 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd0fa5-3977-43a9-8b6a-851f9e9ab961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:34.339475 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-41bd0fa5-3977-43a9-8b6a-851f9e9ab961 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:34.340456 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-41bd0fa5-3977-43a9-8b6a-851f9e9ab961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:34.351194 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-711551f2-ed54-4812-8349-581ebabd5355 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dd5de832f3948bfaa96084a9a7ebdee'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:34.366718 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1024/2042] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:39:33 2022] DELETE /identity/v3/users/4dd5de832f3948bfaa96084a9a7ebdee => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:39:34.425154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1019/2043] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:34.434839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297c322-c631-49e8-9ccb-d4d98603754b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:34.435041 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297c322-c631-49e8-9ccb-d4d98603754b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:34.435345 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297c322-c631-49e8-9ccb-d4d98603754b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:34.444525 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:34.457004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4297c322-c631-49e8-9ccb-d4d98603754b None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:34.459043 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4297c322-c631-49e8-9ccb-d4d98603754b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:34.480860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:34.526013 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1025/2044] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:34.527483 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd0fa5-3977-43a9-8b6a-851f9e9ab961 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:34.538209 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd0fa5-3977-43a9-8b6a-851f9e9ab961 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:34.544272 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50bb25-cc54-45e9-b8cb-6b3c3556f4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:34.545160 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50bb25-cc54-45e9-b8cb-6b3c3556f4ca admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:34.545592 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50bb25-cc54-45e9-b8cb-6b3c3556f4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:34.546064 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50bb25-cc54-45e9-b8cb-6b3c3556f4ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:34.546875 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c50bb25-cc54-45e9-b8cb-6b3c3556f4ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:34.547409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c50bb25-cc54-45e9-b8cb-6b3c3556f4ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:34.549630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c50bb25-cc54-45e9-b8cb-6b3c3556f4ca admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:34.568518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1020/2045] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:34.569679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297c322-c631-49e8-9ccb-d4d98603754b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:34.580137 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297c322-c631-49e8-9ccb-d4d98603754b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:34.585957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836ee7a-4c99-4258-a6da-62e1b6c59fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:34.586709 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836ee7a-4c99-4258-a6da-62e1b6c59fbd admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:34.587001 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836ee7a-4c99-4258-a6da-62e1b6c59fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:34.587270 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836ee7a-4c99-4258-a6da-62e1b6c59fbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:34.587915 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836ee7a-4c99-4258-a6da-62e1b6c59fbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:34.589937 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836ee7a-4c99-4258-a6da-62e1b6c59fbd admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:34.691347 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1026/2046] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:39:34 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:34.696194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50bb25-cc54-45e9-b8cb-6b3c3556f4ca admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:34.696763 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836ee7a-4c99-4258-a6da-62e1b6c59fbd admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:34.698788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a836ee7a-4c99-4258-a6da-62e1b6c59fbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:34.720700 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50bb25-cc54-45e9-b8cb-6b3c3556f4ca admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:34.800713 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836ee7a-4c99-4258-a6da-62e1b6c59fbd admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:34.806532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86721043-f9b4-4264-add9-bd767737fd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:34.807169 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86721043-f9b4-4264-add9-bd767737fd8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:34.808270 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86721043-f9b4-4264-add9-bd767737fd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:34.808270 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86721043-f9b4-4264-add9-bd767737fd8d admin admin] PATH_INFO: `/v3/projects/b0330cc9f998471681b4e57260731dea` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:34.809033 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86721043-f9b4-4264-add9-bd767737fd8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0330cc9f998471681b4e57260731dea)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:34.810888 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89feee-b042-4191-a3e5-1f568cb7d9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:34.811890 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89feee-b042-4191-a3e5-1f568cb7d9ad admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:34.812313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86721043-f9b4-4264-add9-bd767737fd8d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:34.812752 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89feee-b042-4191-a3e5-1f568cb7d9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:34.813988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89feee-b042-4191-a3e5-1f568cb7d9ad admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:34.815160 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89feee-b042-4191-a3e5-1f568cb7d9ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:34.818804 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89feee-b042-4191-a3e5-1f568cb7d9ad admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:35.009379 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1021/2047] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:39:34 2022] POST /identity/v3/users => generated 293 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:35.013593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89feee-b042-4191-a3e5-1f568cb7d9ad admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:35.022527 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-86721043-f9b4-4264-add9-bd767737fd8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0330cc9f998471681b4e57260731dea', 'request_id': 'req-86721043-f9b4-4264-add9-bd767737fd8d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:35.023633 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89feee-b042-4191-a3e5-1f568cb7d9ad admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:35.096013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57df9f7-eda4-4ce9-ba00-ba6a1a9edff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:35.096830 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57df9f7-eda4-4ce9-ba00-ba6a1a9edff1 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:35.102318 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57df9f7-eda4-4ce9-ba00-ba6a1a9edff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:35.102318 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57df9f7-eda4-4ce9-ba00-ba6a1a9edff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:35.102318 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57df9f7-eda4-4ce9-ba00-ba6a1a9edff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:35.102318 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57df9f7-eda4-4ce9-ba00-ba6a1a9edff1 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:35.110939 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1022/2048] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:39:35.114694 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57df9f7-eda4-4ce9-ba00-ba6a1a9edff1 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:35.116874 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c57df9f7-eda4-4ce9-ba00-ba6a1a9edff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:35.119807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-86721043-f9b4-4264-add9-bd767737fd8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0330cc9f998471681b4e57260731dea', 'request_id': 'req-86721043-f9b4-4264-add9-bd767737fd8d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:35.128042 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-86721043-f9b4-4264-add9-bd767737fd8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0330cc9f998471681b4e57260731dea', 'request_id': 'req-86721043-f9b4-4264-add9-bd767737fd8d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:35.131540 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57df9f7-eda4-4ce9-ba00-ba6a1a9edff1 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:35.136807 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69768058-55a5-43d6-b2af-e2dd675c76be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:35.137482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69768058-55a5-43d6-b2af-e2dd675c76be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:35.137844 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69768058-55a5-43d6-b2af-e2dd675c76be admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:35.138200 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69768058-55a5-43d6-b2af-e2dd675c76be admin admin] PATH_INFO: `/v3/projects/97f13af88dd646f5b879b4949190d752` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:35.139489 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69768058-55a5-43d6-b2af-e2dd675c76be admin admin] RBAC: Authorizing `identity:delete_project(project_id=97f13af88dd646f5b879b4949190d752)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:35.139996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-86721043-f9b4-4264-add9-bd767737fd8d admin admin] The token cache is being invalidate because project b0330cc9f998471681b4e57260731dea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:39:35.140270 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-86721043-f9b4-4264-add9-bd767737fd8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:35.142030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-86721043-f9b4-4264-add9-bd767737fd8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:35.142138 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69768058-55a5-43d6-b2af-e2dd675c76be admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:35.143632 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1027/2049] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:39:34 2022] DELETE /identity/v3/projects/b0330cc9f998471681b4e57260731dea => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:35.144397 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86721043-f9b4-4264-add9-bd767737fd8d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:35.146017 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-86721043-f9b4-4264-add9-bd767737fd8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:35.162399 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86721043-f9b4-4264-add9-bd767737fd8d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:35.167526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b99453-e5ac-4f6b-baf7-a79519e574fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:35.168387 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b99453-e5ac-4f6b-baf7-a79519e574fb admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:35.168665 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b99453-e5ac-4f6b-baf7-a79519e574fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:35.168935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b99453-e5ac-4f6b-baf7-a79519e574fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:35.169567 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b99453-e5ac-4f6b-baf7-a79519e574fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:35.171277 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b99453-e5ac-4f6b-baf7-a79519e574fb admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:35.181405 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1028/2050] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:35.182609 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769310c-57ce-4e3d-a797-24d63d22f824 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:35.182887 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769310c-57ce-4e3d-a797-24d63d22f824 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:35.183157 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769310c-57ce-4e3d-a797-24d63d22f824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:35.201924 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4769310c-57ce-4e3d-a797-24d63d22f824 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:35.203133 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4769310c-57ce-4e3d-a797-24d63d22f824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:35.211483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1029/2051] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:35.212211 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769310c-57ce-4e3d-a797-24d63d22f824 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:35.222535 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769310c-57ce-4e3d-a797-24d63d22f824 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:35.227318 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6becc3-5234-4064-8b10-6e3b7496fd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:35.228230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6becc3-5234-4064-8b10-6e3b7496fd73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:35.228385 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6becc3-5234-4064-8b10-6e3b7496fd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:35.228695 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6becc3-5234-4064-8b10-6e3b7496fd73 admin admin] PATH_INFO: `/v3/projects/e08b1aabade74d1bbf72feb31415291a/users/2ad99cbce8f34e819ce2ed9924a13645/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:35.244495 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6becc3-5234-4064-8b10-6e3b7496fd73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e08b1aabade74d1bbf72feb31415291a, user_id=2ad99cbce8f34e819ce2ed9924a13645, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:35.247220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6becc3-5234-4064-8b10-6e3b7496fd73 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:35.354140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1030/2052] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:35 2022] PUT /identity/v3/projects/e08b1aabade74d1bbf72feb31415291a/users/2ad99cbce8f34e819ce2ed9924a13645/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:35.355502 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1ad20-f27a-4771-9e74-e3edc952c377 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:35.355783 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1ad20-f27a-4771-9e74-e3edc952c377 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:35.356085 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1ad20-f27a-4771-9e74-e3edc952c377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:35.372616 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:35.377401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-69768058-55a5-43d6-b2af-e2dd675c76be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97f13af88dd646f5b879b4949190d752', 'request_id': 'req-69768058-55a5-43d6-b2af-e2dd675c76be'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:35.385237 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-7fe1ad20-f27a-4771-9e74-e3edc952c377 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:35.390463 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7fe1ad20-f27a-4771-9e74-e3edc952c377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:35.441066 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-69768058-55a5-43d6-b2af-e2dd675c76be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97f13af88dd646f5b879b4949190d752', 'request_id': 'req-69768058-55a5-43d6-b2af-e2dd675c76be'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:35.451398 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1031/2053] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:35.452678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907a77b-5690-4f67-9a03-3cbdf1a3ed48 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:35.452970 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907a77b-5690-4f67-9a03-3cbdf1a3ed48 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:35.453270 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907a77b-5690-4f67-9a03-3cbdf1a3ed48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:35.455973 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-69768058-55a5-43d6-b2af-e2dd675c76be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97f13af88dd646f5b879b4949190d752', 'request_id': 'req-69768058-55a5-43d6-b2af-e2dd675c76be'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:35.471286 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-69768058-55a5-43d6-b2af-e2dd675c76be admin admin] The token cache is being invalidate because project 97f13af88dd646f5b879b4949190d752 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:39:35.471805 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-69768058-55a5-43d6-b2af-e2dd675c76be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:35.472530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-69768058-55a5-43d6-b2af-e2dd675c76be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:35.474305 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1023/2054] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:39:35 2022] DELETE /identity/v3/projects/97f13af88dd646f5b879b4949190d752 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:35.475106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69768058-55a5-43d6-b2af-e2dd675c76be admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:35.476585 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-69768058-55a5-43d6-b2af-e2dd675c76be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:35.486229 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-6907a77b-5690-4f67-9a03-3cbdf1a3ed48 None None] MFA Rules not processed for user `2ad99cbce8f34e819ce2ed9924a13645`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:35.488320 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:35.488715 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6907a77b-5690-4f67-9a03-3cbdf1a3ed48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:35.494334 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69768058-55a5-43d6-b2af-e2dd675c76be admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:35.500056 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f4ede-a3a5-424c-a41a-5473a01e9d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:35.500912 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f4ede-a3a5-424c-a41a-5473a01e9d88 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:35.501216 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f4ede-a3a5-424c-a41a-5473a01e9d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:35.501639 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f4ede-a3a5-424c-a41a-5473a01e9d88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:35.502614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f4ede-a3a5-424c-a41a-5473a01e9d88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:35.502765 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f4ede-a3a5-424c-a41a-5473a01e9d88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:35.504433 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f4ede-a3a5-424c-a41a-5473a01e9d88 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:35.518512 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1024/2055] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:35.518699 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aad827-5800-4e4c-b3a4-9f99c47003c2 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:35.518892 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aad827-5800-4e4c-b3a4-9f99c47003c2 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:35.519105 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aad827-5800-4e4c-b3a4-9f99c47003c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:35.543421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-94aad827-5800-4e4c-b3a4-9f99c47003c2 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:35.544661 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-94aad827-5800-4e4c-b3a4-9f99c47003c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:35.560722 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1025/2056] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:35.560722 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aad827-5800-4e4c-b3a4-9f99c47003c2 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:35.565985 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aad827-5800-4e4c-b3a4-9f99c47003c2 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:35.571274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27c1a6-8b1c-4e24-a449-64942341452d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:35.572164 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27c1a6-8b1c-4e24-a449-64942341452d admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:35.572443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27c1a6-8b1c-4e24-a449-64942341452d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:35.572719 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27c1a6-8b1c-4e24-a449-64942341452d admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:35.573359 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27c1a6-8b1c-4e24-a449-64942341452d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:35.576462 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27c1a6-8b1c-4e24-a449-64942341452d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:35.578468 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1032/2057] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:35.582061 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f09f8-7573-4633-a6f1-1fba8e467274 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:35.582061 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f09f8-7573-4633-a6f1-1fba8e467274 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:35.582061 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f09f8-7573-4633-a6f1-1fba8e467274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:35.607763 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-822f09f8-7573-4633-a6f1-1fba8e467274 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:35.608985 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-822f09f8-7573-4633-a6f1-1fba8e467274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:35.618255 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1033/2058] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:35.623873 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f09f8-7573-4633-a6f1-1fba8e467274 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:35.623873 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-822f09f8-7573-4633-a6f1-1fba8e467274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:35.632989 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f09f8-7573-4633-a6f1-1fba8e467274 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:35.638151 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ce5b8-11b3-4a88-baf4-42fa7d492c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:35.639473 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ce5b8-11b3-4a88-baf4-42fa7d492c2c admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:35.639817 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ce5b8-11b3-4a88-baf4-42fa7d492c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:35.640143 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ce5b8-11b3-4a88-baf4-42fa7d492c2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:35.640715 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ce5b8-11b3-4a88-baf4-42fa7d492c2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:35.643619 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ce5b8-11b3-4a88-baf4-42fa7d492c2c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:35.668303 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1026/2059] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:39:35 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:35.672654 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27c1a6-8b1c-4e24-a449-64942341452d admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:35.739605 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27c1a6-8b1c-4e24-a449-64942341452d admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:35.744507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53903952-ea9a-41f1-a987-32b79c6ac669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:35.745118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53903952-ea9a-41f1-a987-32b79c6ac669 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:35.745398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53903952-ea9a-41f1-a987-32b79c6ac669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:35.745670 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53903952-ea9a-41f1-a987-32b79c6ac669 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:35.746583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53903952-ea9a-41f1-a987-32b79c6ac669 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:35.746879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53903952-ea9a-41f1-a987-32b79c6ac669 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:35.747564 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1034/2060] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:39:35 2022] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:35.748674 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53903952-ea9a-41f1-a987-32b79c6ac669 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:35.749073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ce5b8-11b3-4a88-baf4-42fa7d492c2c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:35.765948 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1027/2061] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:35.767772 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53903952-ea9a-41f1-a987-32b79c6ac669 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:35.779836 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53903952-ea9a-41f1-a987-32b79c6ac669 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:35.819880 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ce5b8-11b3-4a88-baf4-42fa7d492c2c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:35.824706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e69ed-5c38-42b1-9793-970091d7259b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:35.825346 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e69ed-5c38-42b1-9793-970091d7259b admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:35.825627 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e69ed-5c38-42b1-9793-970091d7259b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:35.825935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e69ed-5c38-42b1-9793-970091d7259b admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:35.826566 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e69ed-5c38-42b1-9793-970091d7259b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:35.828531 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e69ed-5c38-42b1-9793-970091d7259b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:35.850312 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612978ec-6cb7-474f-9052-54c680a80a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:35.850312 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612978ec-6cb7-474f-9052-54c680a80a75 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:35.850312 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612978ec-6cb7-474f-9052-54c680a80a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:35.850312 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612978ec-6cb7-474f-9052-54c680a80a75 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:35.857138 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612978ec-6cb7-474f-9052-54c680a80a75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:35.857138 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612978ec-6cb7-474f-9052-54c680a80a75 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:35.937730 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1035/2062] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:39:35 2022] POST /identity/v3/users => generated 290 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:35.938901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e69ed-5c38-42b1-9793-970091d7259b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:35.949293 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e69ed-5c38-42b1-9793-970091d7259b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:35.954836 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f2f54-35b2-4e4d-9e38-690b0e6e7a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:35.955440 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f2f54-35b2-4e4d-9e38-690b0e6e7a22 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:35.955719 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f2f54-35b2-4e4d-9e38-690b0e6e7a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:35.955993 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f2f54-35b2-4e4d-9e38-690b0e6e7a22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:35.956620 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f2f54-35b2-4e4d-9e38-690b0e6e7a22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:35.958676 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f2f54-35b2-4e4d-9e38-690b0e6e7a22 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:35.971018 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1028/2063] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:39:35 2022] POST /identity/v3/users => generated 300 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:35.972049 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612978ec-6cb7-474f-9052-54c680a80a75 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:35.989627 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612978ec-6cb7-474f-9052-54c680a80a75 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:36.005057 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827fe88-9b55-4440-b01f-93cba7d66177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:36.005057 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827fe88-9b55-4440-b01f-93cba7d66177 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:36.005057 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827fe88-9b55-4440-b01f-93cba7d66177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:36.005057 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827fe88-9b55-4440-b01f-93cba7d66177 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:36.005430 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827fe88-9b55-4440-b01f-93cba7d66177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:36.005430 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827fe88-9b55-4440-b01f-93cba7d66177 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:36.015019 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1029/2064] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:36.015019 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827fe88-9b55-4440-b01f-93cba7d66177 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:36.024074 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827fe88-9b55-4440-b01f-93cba7d66177 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:36.029037 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1f2bd-3762-4a06-9789-22734e519ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:36.029633 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1f2bd-3762-4a06-9789-22734e519ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:36.034155 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1f2bd-3762-4a06-9789-22734e519ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:36.034155 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1f2bd-3762-4a06-9789-22734e519ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:36.034155 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1f2bd-3762-4a06-9789-22734e519ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:36.034155 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1f2bd-3762-4a06-9789-22734e519ef9 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:36.043429 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1030/2065] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:36.044364 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1f2bd-3762-4a06-9789-22734e519ef9 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:36.055435 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1f2bd-3762-4a06-9789-22734e519ef9 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:36.060412 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe0150-3938-461a-84ae-71ce2df96b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:36.061024 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe0150-3938-461a-84ae-71ce2df96b43 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:36.061322 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe0150-3938-461a-84ae-71ce2df96b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:36.061570 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe0150-3938-461a-84ae-71ce2df96b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:36.062244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe0150-3938-461a-84ae-71ce2df96b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:36.064463 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe0150-3938-461a-84ae-71ce2df96b43 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:36.076835 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1031/2066] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:36.076835 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe0150-3938-461a-84ae-71ce2df96b43 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:36.088611 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe0150-3938-461a-84ae-71ce2df96b43 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:36.093454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3886fc5-db9c-4811-90b1-41d58bcaed1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:36.094150 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3886fc5-db9c-4811-90b1-41d58bcaed1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:36.094554 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3886fc5-db9c-4811-90b1-41d58bcaed1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:36.095138 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3886fc5-db9c-4811-90b1-41d58bcaed1b admin admin] PATH_INFO: `/v3/projects/e522c8e977fb4a299bdb2a4215732728/users/4e3b7f1303f14265a104d7e6552ab354/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:36.107879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1036/2067] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:39:35 2022] POST /identity/v3/projects => generated 371 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:36.109052 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f2f54-35b2-4e4d-9e38-690b0e6e7a22 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:36.119783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3886fc5-db9c-4811-90b1-41d58bcaed1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e522c8e977fb4a299bdb2a4215732728, user_id=4e3b7f1303f14265a104d7e6552ab354, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:36.122962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3886fc5-db9c-4811-90b1-41d58bcaed1b admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:36.131322 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:36.192606 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f2f54-35b2-4e4d-9e38-690b0e6e7a22 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:36.197575 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cbb79-58cd-4b9d-b47d-071e8ff36b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:36.198329 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cbb79-58cd-4b9d-b47d-071e8ff36b2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:36.198616 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cbb79-58cd-4b9d-b47d-071e8ff36b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:36.198895 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cbb79-58cd-4b9d-b47d-071e8ff36b2d admin admin] PATH_INFO: `/v3/projects/f22a1cf1a07c47a29772e70e4586a77b/users/3b7c54ebd95f4b3eb396982d75615f23/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:36.218186 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121cbb79-58cd-4b9d-b47d-071e8ff36b2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f22a1cf1a07c47a29772e70e4586a77b, user_id=3b7c54ebd95f4b3eb396982d75615f23, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:36.221126 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121cbb79-58cd-4b9d-b47d-071e8ff36b2d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:36.228470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:36.229112 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1032/2068] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:36 2022] PUT /identity/v3/projects/e522c8e977fb4a299bdb2a4215732728/users/4e3b7f1303f14265a104d7e6552ab354/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:36.230204 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3886fc5-db9c-4811-90b1-41d58bcaed1b admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:36.308236 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3886fc5-db9c-4811-90b1-41d58bcaed1b admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:36.308890 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1037/2069] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:36 2022] PUT /identity/v3/projects/f22a1cf1a07c47a29772e70e4586a77b/users/3b7c54ebd95f4b3eb396982d75615f23/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:36.309668 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cbb79-58cd-4b9d-b47d-071e8ff36b2d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:36.377550 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2bd5e-d3e2-4e63-a63c-cf7d0718b758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:36.378386 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2bd5e-d3e2-4e63-a63c-cf7d0718b758 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:36.381912 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2bd5e-d3e2-4e63-a63c-cf7d0718b758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:36.382335 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2bd5e-d3e2-4e63-a63c-cf7d0718b758 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:36.382984 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2bd5e-d3e2-4e63-a63c-cf7d0718b758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:36.385634 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2bd5e-d3e2-4e63-a63c-cf7d0718b758 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:36.387072 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cbb79-58cd-4b9d-b47d-071e8ff36b2d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:36.392961 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475edf55-ca37-4361-ae91-69e82cf96434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:36.396117 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475edf55-ca37-4361-ae91-69e82cf96434 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:36.396410 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475edf55-ca37-4361-ae91-69e82cf96434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:36.396691 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475edf55-ca37-4361-ae91-69e82cf96434 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:36.397358 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475edf55-ca37-4361-ae91-69e82cf96434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:36.399336 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475edf55-ca37-4361-ae91-69e82cf96434 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:36.413735 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1038/2070] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:36.414392 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc0ca1-16ac-44ee-85e2-ff12d1222645 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:36.414742 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc0ca1-16ac-44ee-85e2-ff12d1222645 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:36.415253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc0ca1-16ac-44ee-85e2-ff12d1222645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:36.439338 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c3cc0ca1-16ac-44ee-85e2-ff12d1222645 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:36.439338 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c3cc0ca1-16ac-44ee-85e2-ff12d1222645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:36.447477 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1039/2071] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:36.451495 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc0ca1-16ac-44ee-85e2-ff12d1222645 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:36.462824 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc0ca1-16ac-44ee-85e2-ff12d1222645 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:36.469843 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1033/2072] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:39:36 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:36.474387 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2bd5e-d3e2-4e63-a63c-cf7d0718b758 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:36.474498 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4606f-a4e6-438d-b2a2-ef9416c845dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:36.474498 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4606f-a4e6-438d-b2a2-ef9416c845dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:36.474703 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-82e2bd5e-d3e2-4e63-a63c-cf7d0718b758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:36.474795 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4606f-a4e6-438d-b2a2-ef9416c845dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:36.474795 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4606f-a4e6-438d-b2a2-ef9416c845dd admin admin] PATH_INFO: `/v3/projects/e522c8e977fb4a299bdb2a4215732728/users/4e3b7f1303f14265a104d7e6552ab354/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:36.477386 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4606f-a4e6-438d-b2a2-ef9416c845dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e522c8e977fb4a299bdb2a4215732728, user_id=4e3b7f1303f14265a104d7e6552ab354, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:36.483352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4606f-a4e6-438d-b2a2-ef9416c845dd admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:36.496367 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:36.513666 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1040/2073] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:36 2022] PUT /identity/v3/projects/e522c8e977fb4a299bdb2a4215732728/users/4e3b7f1303f14265a104d7e6552ab354/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:36.514300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:36.514940 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4606f-a4e6-438d-b2a2-ef9416c845dd admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:36.578766 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2bd5e-d3e2-4e63-a63c-cf7d0718b758 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:36.627421 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4606f-a4e6-438d-b2a2-ef9416c845dd admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:36.636714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855e548-f57e-47a5-af38-fa36b07ef069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:36.637351 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855e548-f57e-47a5-af38-fa36b07ef069 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:36.637822 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855e548-f57e-47a5-af38-fa36b07ef069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:36.638013 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855e548-f57e-47a5-af38-fa36b07ef069 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:36.638766 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855e548-f57e-47a5-af38-fa36b07ef069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:36.641406 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855e548-f57e-47a5-af38-fa36b07ef069 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:36.658722 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1041/2074] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:36.658722 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f3c4f-dd60-4f4c-95a5-a40a15f3cb53 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:36.658722 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f3c4f-dd60-4f4c-95a5-a40a15f3cb53 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:36.658722 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f3c4f-dd60-4f4c-95a5-a40a15f3cb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:36.670747 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bf9fe-6fd6-4c51-9efd-2331a5a39363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:36.671884 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bf9fe-6fd6-4c51-9efd-2331a5a39363 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:36.673007 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bf9fe-6fd6-4c51-9efd-2331a5a39363 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:36.673494 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bf9fe-6fd6-4c51-9efd-2331a5a39363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:36.694069 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207bf9fe-6fd6-4c51-9efd-2331a5a39363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:36.697116 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207bf9fe-6fd6-4c51-9efd-2331a5a39363 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:36.713003 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e04f3c4f-dd60-4f4c-95a5-a40a15f3cb53 None None] MFA Rules not processed for user `4e3b7f1303f14265a104d7e6552ab354`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:36.713784 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1034/2075] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:39:36.714629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bf9fe-6fd6-4c51-9efd-2331a5a39363 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:36.715287 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e04f3c4f-dd60-4f4c-95a5-a40a15f3cb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:36.731021 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bf9fe-6fd6-4c51-9efd-2331a5a39363 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:36.740559 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0019d-3600-494a-aef2-51a41185abfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:36.745434 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0019d-3600-494a-aef2-51a41185abfd admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:36.745434 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0019d-3600-494a-aef2-51a41185abfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:36.745434 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0019d-3600-494a-aef2-51a41185abfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:36.745434 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0019d-3600-494a-aef2-51a41185abfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:36.746815 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0019d-3600-494a-aef2-51a41185abfd admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:36.766159 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1035/2076] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:36.772938 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0019d-3600-494a-aef2-51a41185abfd admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:36.786335 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0019d-3600-494a-aef2-51a41185abfd admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:36.791263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a2f0e-43ba-4022-b7d6-12bdbc4bd798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:36.791921 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a2f0e-43ba-4022-b7d6-12bdbc4bd798 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:36.792202 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a2f0e-43ba-4022-b7d6-12bdbc4bd798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:36.792477 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a2f0e-43ba-4022-b7d6-12bdbc4bd798 admin admin] PATH_INFO: `/v3/projects/e7c0bba1348f403295047c76ab8e5de0/users/ce93a993a49041d89ff13279d7503168/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:36.810999 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a2f0e-43ba-4022-b7d6-12bdbc4bd798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7c0bba1348f403295047c76ab8e5de0, user_id=ce93a993a49041d89ff13279d7503168, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:36.818101 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1042/2077] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:36 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:36.818386 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a2f0e-43ba-4022-b7d6-12bdbc4bd798 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:36.826490 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f3c4f-dd60-4f4c-95a5-a40a15f3cb53 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:36.827914 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e04f3c4f-dd60-4f4c-95a5-a40a15f3cb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:36.888840 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1036/2078] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:36 2022] PUT /identity/v3/projects/e7c0bba1348f403295047c76ab8e5de0/users/ce93a993a49041d89ff13279d7503168/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:36.894313 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd4ce4-7e9d-4d4b-a54a-c72e976cbbb0 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:36.895000 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd4ce4-7e9d-4d4b-a54a-c72e976cbbb0 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:36.897863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd4ce4-7e9d-4d4b-a54a-c72e976cbbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:36.917480 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f3c4f-dd60-4f4c-95a5-a40a15f3cb53 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:36.926980 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-92bd4ce4-7e9d-4d4b-a54a-c72e976cbbb0 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:36.928684 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-92bd4ce4-7e9d-4d4b-a54a-c72e976cbbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:36.967883 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:36.988218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6b9e1-78ae-4c98-899b-2a2a9d5e12c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:36.989302 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6b9e1-78ae-4c98-899b-2a2a9d5e12c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:36.989825 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6b9e1-78ae-4c98-899b-2a2a9d5e12c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:36.990322 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6b9e1-78ae-4c98-899b-2a2a9d5e12c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:37.010168 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1037/2079] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:39:37.021307 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd4ce4-7e9d-4d4b-a54a-c72e976cbbb0 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:37.059530 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6b9e1-78ae-4c98-899b-2a2a9d5e12c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:37.061261 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6b9e1-78ae-4c98-899b-2a2a9d5e12c5 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:37.073477 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:37.074670 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1043/2080] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:36 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:39:37.097949 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd4ce4-7e9d-4d4b-a54a-c72e976cbbb0 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:37.104426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee054b44-d407-42c6-bede-800c361c3d67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:37.105150 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee054b44-d407-42c6-bede-800c361c3d67 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:37.105431 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee054b44-d407-42c6-bede-800c361c3d67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:37.105728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee054b44-d407-42c6-bede-800c361c3d67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:37.124404 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee054b44-d407-42c6-bede-800c361c3d67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:37.124404 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee054b44-d407-42c6-bede-800c361c3d67 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:37.133061 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1038/2081] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:39:38.251875 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6b9e1-78ae-4c98-899b-2a2a9d5e12c5 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:38.253444 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-47f6b9e1-78ae-4c98-899b-2a2a9d5e12c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:38.275530 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6b9e1-78ae-4c98-899b-2a2a9d5e12c5 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:38.291025 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a51689-7312-45e9-bc39-6934bbf3907d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:38.291944 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a51689-7312-45e9-bc39-6934bbf3907d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:38.292232 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a51689-7312-45e9-bc39-6934bbf3907d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:38.293650 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a51689-7312-45e9-bc39-6934bbf3907d admin admin] PATH_INFO: `/v3/users/da72b906061e45fa8b47d8ff36eb462b` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:38.294967 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a51689-7312-45e9-bc39-6934bbf3907d admin admin] RBAC: Authorizing `identity:delete_user(user_id=da72b906061e45fa8b47d8ff36eb462b)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:38.297334 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a51689-7312-45e9-bc39-6934bbf3907d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:38.546729 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-95a51689-7312-45e9-bc39-6934bbf3907d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da72b906061e45fa8b47d8ff36eb462b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:38.548308 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-95a51689-7312-45e9-bc39-6934bbf3907d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da72b906061e45fa8b47d8ff36eb462b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:38.549103 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-95a51689-7312-45e9-bc39-6934bbf3907d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da72b906061e45fa8b47d8ff36eb462b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:38.573541 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-95a51689-7312-45e9-bc39-6934bbf3907d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da72b906061e45fa8b47d8ff36eb462b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:38.648495 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee054b44-d407-42c6-bede-800c361c3d67 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:38.665337 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee054b44-d407-42c6-bede-800c361c3d67 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:38.668237 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-95a51689-7312-45e9-bc39-6934bbf3907d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da72b906061e45fa8b47d8ff36eb462b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:38.670473 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37c61c-dbeb-4e50-8ee9-e916fe886646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:38.671330 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37c61c-dbeb-4e50-8ee9-e916fe886646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:38.671786 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37c61c-dbeb-4e50-8ee9-e916fe886646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:38.672740 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37c61c-dbeb-4e50-8ee9-e916fe886646 admin admin] PATH_INFO: `/v3/users/2ad99cbce8f34e819ce2ed9924a13645` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:38.674091 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37c61c-dbeb-4e50-8ee9-e916fe886646 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ad99cbce8f34e819ce2ed9924a13645)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:38.676388 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37c61c-dbeb-4e50-8ee9-e916fe886646 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:38.694979 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1044/2082] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:39:38 2022] DELETE /identity/v3/users/da72b906061e45fa8b47d8ff36eb462b => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:38.714879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f184a-cc1f-448c-99ae-a96ef2483cf4 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:38.715610 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f184a-cc1f-448c-99ae-a96ef2483cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:38.716592 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f184a-cc1f-448c-99ae-a96ef2483cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:38.748705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b60f184a-cc1f-448c-99ae-a96ef2483cf4 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:38.750363 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b60f184a-cc1f-448c-99ae-a96ef2483cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:38.819193 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:38.830618 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1045/2083] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:38.843277 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f184a-cc1f-448c-99ae-a96ef2483cf4 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:38.845501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b60f184a-cc1f-448c-99ae-a96ef2483cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:38.913658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f184a-cc1f-448c-99ae-a96ef2483cf4 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:38.918147 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba6142-8fbe-478e-9340-17ed73d488f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:38.918773 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba6142-8fbe-478e-9340-17ed73d488f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:38.919051 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba6142-8fbe-478e-9340-17ed73d488f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:38.919323 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba6142-8fbe-478e-9340-17ed73d488f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:38.929572 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba6142-8fbe-478e-9340-17ed73d488f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:38.931196 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba6142-8fbe-478e-9340-17ed73d488f5 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:38.941725 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1046/2084] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:39:39.194535 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8f37c61c-dbeb-4e50-8ee9-e916fe886646 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ad99cbce8f34e819ce2ed9924a13645'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:39.195664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8f37c61c-dbeb-4e50-8ee9-e916fe886646 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ad99cbce8f34e819ce2ed9924a13645'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:39.215410 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8f37c61c-dbeb-4e50-8ee9-e916fe886646 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ad99cbce8f34e819ce2ed9924a13645'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:39.216483 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8f37c61c-dbeb-4e50-8ee9-e916fe886646 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ad99cbce8f34e819ce2ed9924a13645'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:39.338512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b18948-e5e3-40b3-aaf0-a3246538a130 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:39.342333 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b18948-e5e3-40b3-aaf0-a3246538a130 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:39.342333 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b18948-e5e3-40b3-aaf0-a3246538a130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:39.346583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8f37c61c-dbeb-4e50-8ee9-e916fe886646 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ad99cbce8f34e819ce2ed9924a13645'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:39.407870 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-74b18948-e5e3-40b3-aaf0-a3246538a130 None None] MFA Rules not processed for user `ce93a993a49041d89ff13279d7503168`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:39.413494 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-74b18948-e5e3-40b3-aaf0-a3246538a130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:39.413702 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1039/2085] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:39:38 2022] DELETE /identity/v3/users/2ad99cbce8f34e819ce2ed9924a13645 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:39.415693 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0006a-2504-47a8-84d1-aa6f6970b6a3 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:39.416075 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0006a-2504-47a8-84d1-aa6f6970b6a3 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:39.416356 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0006a-2504-47a8-84d1-aa6f6970b6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:39.443744 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-46b0006a-2504-47a8-84d1-aa6f6970b6a3 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:39.445246 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-46b0006a-2504-47a8-84d1-aa6f6970b6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:39.569255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1040/2086] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:39.569600 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1047/2087] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:39:39.583206 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0006a-2504-47a8-84d1-aa6f6970b6a3 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:39.586506 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b18948-e5e3-40b3-aaf0-a3246538a130 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:39.588242 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-74b18948-e5e3-40b3-aaf0-a3246538a130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:39.591530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-46b0006a-2504-47a8-84d1-aa6f6970b6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:39.609601 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0006a-2504-47a8-84d1-aa6f6970b6a3 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:39.614879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c5f4a-b80e-49da-8b2a-7fd88680d9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:39.616500 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c5f4a-b80e-49da-8b2a-7fd88680d9f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:39.616500 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c5f4a-b80e-49da-8b2a-7fd88680d9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:39.616500 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c5f4a-b80e-49da-8b2a-7fd88680d9f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:39.616942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c5f4a-b80e-49da-8b2a-7fd88680d9f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:39.620206 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c5f4a-b80e-49da-8b2a-7fd88680d9f9 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:39.668700 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b18948-e5e3-40b3-aaf0-a3246538a130 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:39.670585 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53623145-ff73-4242-9901-0df8f24dede3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:39.671385 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53623145-ff73-4242-9901-0df8f24dede3 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:39.671792 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53623145-ff73-4242-9901-0df8f24dede3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:39.671933 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53623145-ff73-4242-9901-0df8f24dede3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:39.689819 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53623145-ff73-4242-9901-0df8f24dede3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:39.691320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53623145-ff73-4242-9901-0df8f24dede3 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:39.710131 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1048/2088] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:39:39.767930 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1041/2089] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:39:39 2022] POST /identity/v3/projects => generated 373 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:39.771827 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53623145-ff73-4242-9901-0df8f24dede3 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:39.784447 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53623145-ff73-4242-9901-0df8f24dede3 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:39.895677 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:39.959838 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f0e04-e8e4-4022-a4ab-cfbe491a00d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:39.960537 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f0e04-e8e4-4022-a4ab-cfbe491a00d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:39.960975 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f0e04-e8e4-4022-a4ab-cfbe491a00d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:39.961309 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f0e04-e8e4-4022-a4ab-cfbe491a00d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:39.962126 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f0e04-e8e4-4022-a4ab-cfbe491a00d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:39.969762 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f0e04-e8e4-4022-a4ab-cfbe491a00d6 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:40.066030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1049/2090] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:39:39 2022] POST /identity/v3/users => generated 293 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:40.068076 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c5f4a-b80e-49da-8b2a-7fd88680d9f9 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:40.106017 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c5f4a-b80e-49da-8b2a-7fd88680d9f9 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:40.124010 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84772e-5643-4698-a99b-aa3cb5411a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:40.124010 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84772e-5643-4698-a99b-aa3cb5411a91 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:40.124010 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84772e-5643-4698-a99b-aa3cb5411a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:40.124010 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84772e-5643-4698-a99b-aa3cb5411a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:40.124432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84772e-5643-4698-a99b-aa3cb5411a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:40.125037 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84772e-5643-4698-a99b-aa3cb5411a91 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:40.138012 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1042/2091] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:40.142603 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f0e04-e8e4-4022-a4ab-cfbe491a00d6 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:40.158871 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f0e04-e8e4-4022-a4ab-cfbe491a00d6 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:40.163966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9515e5-64c6-4be2-8003-c8cf3bc41f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:40.164636 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9515e5-64c6-4be2-8003-c8cf3bc41f41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:40.164910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9515e5-64c6-4be2-8003-c8cf3bc41f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:40.165181 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9515e5-64c6-4be2-8003-c8cf3bc41f41 admin admin] PATH_INFO: `/v3/projects/008fe20b770d4afcbc2bf8cce1e56343/users/4cd25eba0a1549abbd2e8135ac537ba9/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:40.184897 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9515e5-64c6-4be2-8003-c8cf3bc41f41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=008fe20b770d4afcbc2bf8cce1e56343, user_id=4cd25eba0a1549abbd2e8135ac537ba9, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:40.187714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9515e5-64c6-4be2-8003-c8cf3bc41f41 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:40.289521 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84772e-5643-4698-a99b-aa3cb5411a91 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:40.292089 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-8d84772e-5643-4698-a99b-aa3cb5411a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:40.293204 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1050/2092] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:40 2022] PUT /identity/v3/projects/008fe20b770d4afcbc2bf8cce1e56343/users/4cd25eba0a1549abbd2e8135ac537ba9/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:40.297688 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9515e5-64c6-4be2-8003-c8cf3bc41f41 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:40.312719 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84772e-5643-4698-a99b-aa3cb5411a91 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:40.354538 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:40.422446 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e99af-7c5d-4d3d-a621-be3d183b9f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:40.423386 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e99af-7c5d-4d3d-a621-be3d183b9f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:40.423624 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e99af-7c5d-4d3d-a621-be3d183b9f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:40.424386 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e99af-7c5d-4d3d-a621-be3d183b9f9d admin admin] PATH_INFO: `/v3/projects/e8f37931378240b8806b89e3343e7ba9` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:40.425589 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e99af-7c5d-4d3d-a621-be3d183b9f9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8f37931378240b8806b89e3343e7ba9)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:40.427483 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e99af-7c5d-4d3d-a621-be3d183b9f9d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:40.466893 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9515e5-64c6-4be2-8003-c8cf3bc41f41 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:40.504598 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6b014-25eb-4973-8331-8a5c5be0dad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:40.505476 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6b014-25eb-4973-8331-8a5c5be0dad3 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:40.505948 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6b014-25eb-4973-8331-8a5c5be0dad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:40.506382 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6b014-25eb-4973-8331-8a5c5be0dad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:40.507232 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6b014-25eb-4973-8331-8a5c5be0dad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:40.508997 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6b014-25eb-4973-8331-8a5c5be0dad3 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:40.527929 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1051/2093] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:39:40.532934 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6b014-25eb-4973-8331-8a5c5be0dad3 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:40.564806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6b014-25eb-4973-8331-8a5c5be0dad3 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:40.583281 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ecae4-2427-4941-8596-2ee38a5facf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:40.584756 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ecae4-2427-4941-8596-2ee38a5facf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:40.585051 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ecae4-2427-4941-8596-2ee38a5facf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:40.586562 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ecae4-2427-4941-8596-2ee38a5facf0 admin admin] PATH_INFO: `/v3/projects/008fe20b770d4afcbc2bf8cce1e56343/users/4cd25eba0a1549abbd2e8135ac537ba9/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:40.592460 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ecae4-2427-4941-8596-2ee38a5facf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=008fe20b770d4afcbc2bf8cce1e56343, user_id=4cd25eba0a1549abbd2e8135ac537ba9, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:40.604552 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ecae4-2427-4941-8596-2ee38a5facf0 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:40.618479 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-6a5e99af-7c5d-4d3d-a621-be3d183b9f9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8f37931378240b8806b89e3343e7ba9', 'request_id': 'req-6a5e99af-7c5d-4d3d-a621-be3d183b9f9d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:40.652998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1052/2094] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:40 2022] PUT /identity/v3/projects/008fe20b770d4afcbc2bf8cce1e56343/users/4cd25eba0a1549abbd2e8135ac537ba9/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:39:40.705990 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-6a5e99af-7c5d-4d3d-a621-be3d183b9f9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8f37931378240b8806b89e3343e7ba9', 'request_id': 'req-6a5e99af-7c5d-4d3d-a621-be3d183b9f9d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:40.717346 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ecae4-2427-4941-8596-2ee38a5facf0 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:40.719989 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-6a5e99af-7c5d-4d3d-a621-be3d183b9f9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8f37931378240b8806b89e3343e7ba9', 'request_id': 'req-6a5e99af-7c5d-4d3d-a621-be3d183b9f9d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:40.724436 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b85ecae4-2427-4941-8596-2ee38a5facf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:40.742108 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-6a5e99af-7c5d-4d3d-a621-be3d183b9f9d admin admin] The token cache is being invalidate because project e8f37931378240b8806b89e3343e7ba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:39:40.745651 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-6a5e99af-7c5d-4d3d-a621-be3d183b9f9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:40.745651 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-6a5e99af-7c5d-4d3d-a621-be3d183b9f9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:40.747265 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1043/2095] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:39:40 2022] DELETE /identity/v3/projects/e8f37931378240b8806b89e3343e7ba9 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:40.751872 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e99af-7c5d-4d3d-a621-be3d183b9f9d admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:40.757354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6a5e99af-7c5d-4d3d-a621-be3d183b9f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:40.851118 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ecae4-2427-4941-8596-2ee38a5facf0 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:40.857102 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3025e-afc7-47e7-b9cc-f9a0b3017208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:40.858420 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3025e-afc7-47e7-b9cc-f9a0b3017208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:40.860930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3025e-afc7-47e7-b9cc-f9a0b3017208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:40.861340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3025e-afc7-47e7-b9cc-f9a0b3017208 admin admin] PATH_INFO: `/v3/projects/e08b1aabade74d1bbf72feb31415291a` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:40.861526 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e99af-7c5d-4d3d-a621-be3d183b9f9d admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:40.862832 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3025e-afc7-47e7-b9cc-f9a0b3017208 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e08b1aabade74d1bbf72feb31415291a)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:40.865102 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3025e-afc7-47e7-b9cc-f9a0b3017208 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:40.877837 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799de9a2-ff01-4679-96f6-39cc56577402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:40.878633 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799de9a2-ff01-4679-96f6-39cc56577402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:40.879004 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799de9a2-ff01-4679-96f6-39cc56577402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:40.879405 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799de9a2-ff01-4679-96f6-39cc56577402 admin admin] PATH_INFO: `/v3/users/e76e35b8873143cf8861c541080ff6d0` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:40.880787 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799de9a2-ff01-4679-96f6-39cc56577402 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e76e35b8873143cf8861c541080ff6d0)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:40.882955 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799de9a2-ff01-4679-96f6-39cc56577402 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:41.020637 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:41.130976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-799de9a2-ff01-4679-96f6-39cc56577402 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e76e35b8873143cf8861c541080ff6d0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:41.131840 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-799de9a2-ff01-4679-96f6-39cc56577402 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e76e35b8873143cf8861c541080ff6d0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:41.140880 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7eb3025e-afc7-47e7-b9cc-f9a0b3017208 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e08b1aabade74d1bbf72feb31415291a', 'request_id': 'req-7eb3025e-afc7-47e7-b9cc-f9a0b3017208'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:41.160007 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-799de9a2-ff01-4679-96f6-39cc56577402 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e76e35b8873143cf8861c541080ff6d0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:41.161076 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-799de9a2-ff01-4679-96f6-39cc56577402 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e76e35b8873143cf8861c541080ff6d0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:41.249343 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7eb3025e-afc7-47e7-b9cc-f9a0b3017208 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e08b1aabade74d1bbf72feb31415291a', 'request_id': 'req-7eb3025e-afc7-47e7-b9cc-f9a0b3017208'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:41.261879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7eb3025e-afc7-47e7-b9cc-f9a0b3017208 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e08b1aabade74d1bbf72feb31415291a', 'request_id': 'req-7eb3025e-afc7-47e7-b9cc-f9a0b3017208'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:41.279530 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7eb3025e-afc7-47e7-b9cc-f9a0b3017208 admin admin] The token cache is being invalidate because project e08b1aabade74d1bbf72feb31415291a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:39:41.279876 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7eb3025e-afc7-47e7-b9cc-f9a0b3017208 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:41.280565 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7eb3025e-afc7-47e7-b9cc-f9a0b3017208 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:41.283495 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1053/2096] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:39:40 2022] DELETE /identity/v3/projects/e08b1aabade74d1bbf72feb31415291a => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:41.292578 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3025e-afc7-47e7-b9cc-f9a0b3017208 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:41.292578 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7eb3025e-afc7-47e7-b9cc-f9a0b3017208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:41.344010 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-799de9a2-ff01-4679-96f6-39cc56577402 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e76e35b8873143cf8861c541080ff6d0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:41.370205 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1044/2097] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:39:40 2022] DELETE /identity/v3/users/e76e35b8873143cf8861c541080ff6d0 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:41.404768 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3025e-afc7-47e7-b9cc-f9a0b3017208 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:41.499017 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ca882-fda1-4f36-bcc0-e47cce803078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:41.502082 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ca882-fda1-4f36-bcc0-e47cce803078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:41.502082 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ca882-fda1-4f36-bcc0-e47cce803078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:41.502929 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ca882-fda1-4f36-bcc0-e47cce803078 admin admin] PATH_INFO: `/v3/users/4e3b7f1303f14265a104d7e6552ab354` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:41.506937 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ca882-fda1-4f36-bcc0-e47cce803078 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e3b7f1303f14265a104d7e6552ab354)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:41.509809 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ca882-fda1-4f36-bcc0-e47cce803078 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:41.742659 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-489ca882-fda1-4f36-bcc0-e47cce803078 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e3b7f1303f14265a104d7e6552ab354'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:41.743379 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-489ca882-fda1-4f36-bcc0-e47cce803078 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e3b7f1303f14265a104d7e6552ab354'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:41.743921 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-489ca882-fda1-4f36-bcc0-e47cce803078 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e3b7f1303f14265a104d7e6552ab354'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:41.775952 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-489ca882-fda1-4f36-bcc0-e47cce803078 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e3b7f1303f14265a104d7e6552ab354'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:41.859447 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-489ca882-fda1-4f36-bcc0-e47cce803078 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e3b7f1303f14265a104d7e6552ab354'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:41.881582 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1054/2098] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:39:41 2022] DELETE /identity/v3/users/4e3b7f1303f14265a104d7e6552ab354 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:39:42.274291 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799de9a2-ff01-4679-96f6-39cc56577402 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:42.277373 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-799de9a2-ff01-4679-96f6-39cc56577402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:42.309843 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799de9a2-ff01-4679-96f6-39cc56577402 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:42.443790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:42.494347 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937effae-49f8-4f57-99b5-18d7364b9852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:42.495137 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937effae-49f8-4f57-99b5-18d7364b9852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:42.495425 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937effae-49f8-4f57-99b5-18d7364b9852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:42.495706 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937effae-49f8-4f57-99b5-18d7364b9852 admin admin] PATH_INFO: `/v3/projects/bbc987ea9b8e4776aabb7e4bc03b1c4f` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:42.497419 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937effae-49f8-4f57-99b5-18d7364b9852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbc987ea9b8e4776aabb7e4bc03b1c4f)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:42.501195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937effae-49f8-4f57-99b5-18d7364b9852 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:42.674027 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-937effae-49f8-4f57-99b5-18d7364b9852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbc987ea9b8e4776aabb7e4bc03b1c4f', 'request_id': 'req-937effae-49f8-4f57-99b5-18d7364b9852'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:42.768824 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-937effae-49f8-4f57-99b5-18d7364b9852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbc987ea9b8e4776aabb7e4bc03b1c4f', 'request_id': 'req-937effae-49f8-4f57-99b5-18d7364b9852'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:42.781998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ca882-fda1-4f36-bcc0-e47cce803078 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:42.782665 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-937effae-49f8-4f57-99b5-18d7364b9852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbc987ea9b8e4776aabb7e4bc03b1c4f', 'request_id': 'req-937effae-49f8-4f57-99b5-18d7364b9852'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:42.784888 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-489ca882-fda1-4f36-bcc0-e47cce803078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:42.807993 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-937effae-49f8-4f57-99b5-18d7364b9852 admin admin] The token cache is being invalidate because project bbc987ea9b8e4776aabb7e4bc03b1c4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:39:42.808296 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-937effae-49f8-4f57-99b5-18d7364b9852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:42.817627 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-937effae-49f8-4f57-99b5-18d7364b9852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:42.822615 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1045/2099] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:39:42 2022] DELETE /identity/v3/projects/bbc987ea9b8e4776aabb7e4bc03b1c4f => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:42.828279 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937effae-49f8-4f57-99b5-18d7364b9852 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:42.833634 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ca882-fda1-4f36-bcc0-e47cce803078 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:42.833886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-937effae-49f8-4f57-99b5-18d7364b9852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:42.929967 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:43.030550 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d04da2-644e-45ba-befe-63ba14e80236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:43.032877 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d04da2-644e-45ba-befe-63ba14e80236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:43.035097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d04da2-644e-45ba-befe-63ba14e80236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:43.035783 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d04da2-644e-45ba-befe-63ba14e80236 admin admin] PATH_INFO: `/v3/projects/e522c8e977fb4a299bdb2a4215732728` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:43.038700 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d04da2-644e-45ba-befe-63ba14e80236 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e522c8e977fb4a299bdb2a4215732728)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:43.045287 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d04da2-644e-45ba-befe-63ba14e80236 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:43.050627 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937effae-49f8-4f57-99b5-18d7364b9852 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:43.060705 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac4c7e-32af-46aa-a2c8-08f7649c83c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:43.064225 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac4c7e-32af-46aa-a2c8-08f7649c83c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:43.064225 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac4c7e-32af-46aa-a2c8-08f7649c83c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:43.064225 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac4c7e-32af-46aa-a2c8-08f7649c83c9 admin admin] PATH_INFO: `/v3/users/182c416b9da342319455f2ab3f1d998f` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:43.065296 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac4c7e-32af-46aa-a2c8-08f7649c83c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=182c416b9da342319455f2ab3f1d998f)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:43.067833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac4c7e-32af-46aa-a2c8-08f7649c83c9 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:43.316530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-10ac4c7e-32af-46aa-a2c8-08f7649c83c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '182c416b9da342319455f2ab3f1d998f'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:43.318122 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-10ac4c7e-32af-46aa-a2c8-08f7649c83c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '182c416b9da342319455f2ab3f1d998f'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:43.329366 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-83d04da2-644e-45ba-befe-63ba14e80236 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e522c8e977fb4a299bdb2a4215732728', 'request_id': 'req-83d04da2-644e-45ba-befe-63ba14e80236'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:43.343305 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-10ac4c7e-32af-46aa-a2c8-08f7649c83c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '182c416b9da342319455f2ab3f1d998f'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:43.345446 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-10ac4c7e-32af-46aa-a2c8-08f7649c83c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '182c416b9da342319455f2ab3f1d998f'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:43.417893 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-83d04da2-644e-45ba-befe-63ba14e80236 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e522c8e977fb4a299bdb2a4215732728', 'request_id': 'req-83d04da2-644e-45ba-befe-63ba14e80236'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:43.426285 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-83d04da2-644e-45ba-befe-63ba14e80236 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e522c8e977fb4a299bdb2a4215732728', 'request_id': 'req-83d04da2-644e-45ba-befe-63ba14e80236'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:43.467234 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-83d04da2-644e-45ba-befe-63ba14e80236 admin admin] The token cache is being invalidate because project e522c8e977fb4a299bdb2a4215732728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:39:43.467234 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-83d04da2-644e-45ba-befe-63ba14e80236 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:43.467234 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-83d04da2-644e-45ba-befe-63ba14e80236 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:43.468496 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1055/2100] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:39:42 2022] DELETE /identity/v3/projects/e522c8e977fb4a299bdb2a4215732728 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:43.470496 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbb793-f5a0-41d3-9cb0-71277f2e26a6 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:43.471012 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbb793-f5a0-41d3-9cb0-71277f2e26a6 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:43.471291 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbb793-f5a0-41d3-9cb0-71277f2e26a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:43.505540 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-68bbb793-f5a0-41d3-9cb0-71277f2e26a6 None None] MFA Rules not processed for user `4cd25eba0a1549abbd2e8135ac537ba9`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:43.507179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-68bbb793-f5a0-41d3-9cb0-71277f2e26a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:43.519895 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-10ac4c7e-32af-46aa-a2c8-08f7649c83c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '182c416b9da342319455f2ab3f1d998f'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:43.535698 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1046/2101] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:39:42 2022] DELETE /identity/v3/users/182c416b9da342319455f2ab3f1d998f => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:43.541042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05893818-219b-4e3b-90c6-74dfebb8ede3 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:43.541543 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05893818-219b-4e3b-90c6-74dfebb8ede3 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:43.542024 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05893818-219b-4e3b-90c6-74dfebb8ede3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:43.574139 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-05893818-219b-4e3b-90c6-74dfebb8ede3 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:43.574630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-05893818-219b-4e3b-90c6-74dfebb8ede3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:43.653712 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1056/2102] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:43.666425 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbb793-f5a0-41d3-9cb0-71277f2e26a6 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:43.667933 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-68bbb793-f5a0-41d3-9cb0-71277f2e26a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:43.738860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1047/2103] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:43.741899 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc355e-1cff-46f6-94d0-18c15dbeb11a None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:43.742675 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc355e-1cff-46f6-94d0-18c15dbeb11a None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:43.744119 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc355e-1cff-46f6-94d0-18c15dbeb11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:43.778785 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbb793-f5a0-41d3-9cb0-71277f2e26a6 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:43.788138 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-3dcc355e-1cff-46f6-94d0-18c15dbeb11a None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:43.789899 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3dcc355e-1cff-46f6-94d0-18c15dbeb11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:43.801599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1048/2104] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:39:43.807482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc355e-1cff-46f6-94d0-18c15dbeb11a None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:43.820435 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc355e-1cff-46f6-94d0-18c15dbeb11a None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:43.826197 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922fed5-9df7-4d51-bd52-69463841eeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:43.827108 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922fed5-9df7-4d51-bd52-69463841eeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:43.827424 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922fed5-9df7-4d51-bd52-69463841eeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:43.830334 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922fed5-9df7-4d51-bd52-69463841eeb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:43.831030 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922fed5-9df7-4d51-bd52-69463841eeb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:43.831343 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922fed5-9df7-4d51-bd52-69463841eeb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:43.833630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922fed5-9df7-4d51-bd52-69463841eeb6 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:43.852931 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1049/2105] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:43.858115 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922fed5-9df7-4d51-bd52-69463841eeb6 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:43.864980 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd55398-bc2e-44a8-9479-0edeae86e804 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:43.866343 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd55398-bc2e-44a8-9479-0edeae86e804 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:43.867583 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd55398-bc2e-44a8-9479-0edeae86e804 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:43.868049 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd55398-bc2e-44a8-9479-0edeae86e804 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:43.872044 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4cd55398-bc2e-44a8-9479-0edeae86e804 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:43.882974 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922fed5-9df7-4d51-bd52-69463841eeb6 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:43.892308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59153cdf-163b-4e13-9d41-9090045f8aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:43.893358 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59153cdf-163b-4e13-9d41-9090045f8aec admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:43.893913 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59153cdf-163b-4e13-9d41-9090045f8aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:43.893913 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59153cdf-163b-4e13-9d41-9090045f8aec admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:43.894742 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59153cdf-163b-4e13-9d41-9090045f8aec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:43.897504 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59153cdf-163b-4e13-9d41-9090045f8aec admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:43.975245 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd55398-bc2e-44a8-9479-0edeae86e804 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:43.977500 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd55398-bc2e-44a8-9479-0edeae86e804 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:43.991095 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1057/2106] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:39:44.022880 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd55398-bc2e-44a8-9479-0edeae86e804 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:44.030303 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1050/2107] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:39:43 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:44.038303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd55398-bc2e-44a8-9479-0edeae86e804 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:44.136084 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2f3b2-20c5-46cd-8d11-7307dcab29d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:44.136084 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2f3b2-20c5-46cd-8d11-7307dcab29d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:44.136084 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2f3b2-20c5-46cd-8d11-7307dcab29d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:44.136084 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2f3b2-20c5-46cd-8d11-7307dcab29d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:44.136581 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2f3b2-20c5-46cd-8d11-7307dcab29d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:44.138076 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2f3b2-20c5-46cd-8d11-7307dcab29d3 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:44.293929 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1058/2108] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:39:44 2022] POST /identity/v3/users => generated 287 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:44.295037 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59153cdf-163b-4e13-9d41-9090045f8aec admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:44.296430 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2f3b2-20c5-46cd-8d11-7307dcab29d3 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:44.303978 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-59153cdf-163b-4e13-9d41-9090045f8aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:44.320745 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59153cdf-163b-4e13-9d41-9090045f8aec admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:44.321454 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2f3b2-20c5-46cd-8d11-7307dcab29d3 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:44.331459 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e69068-17c3-4446-9bc2-58fc8b525938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:44.331459 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e69068-17c3-4446-9bc2-58fc8b525938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:44.331459 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e69068-17c3-4446-9bc2-58fc8b525938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:44.331459 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e69068-17c3-4446-9bc2-58fc8b525938 admin admin] PATH_INFO: `/v3/projects/fd1eba4e76da45579ff6cb5816c32001` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:44.332435 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e69068-17c3-4446-9bc2-58fc8b525938 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd1eba4e76da45579ff6cb5816c32001)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:44.337985 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211728f-064d-42f0-b4b6-b576976ad922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:44.338857 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211728f-064d-42f0-b4b6-b576976ad922 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:44.339215 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211728f-064d-42f0-b4b6-b576976ad922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:44.339322 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211728f-064d-42f0-b4b6-b576976ad922 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:44.340029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211728f-064d-42f0-b4b6-b576976ad922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:44.346791 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211728f-064d-42f0-b4b6-b576976ad922 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:44.380737 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1059/2109] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:44.401275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211728f-064d-42f0-b4b6-b576976ad922 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:44.401364 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e69068-17c3-4446-9bc2-58fc8b525938 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:44.425220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211728f-064d-42f0-b4b6-b576976ad922 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:44.437417 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3552096-c98b-4dfe-a240-50847144550d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:44.439067 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3552096-c98b-4dfe-a240-50847144550d admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:44.440968 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3552096-c98b-4dfe-a240-50847144550d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:44.441885 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3552096-c98b-4dfe-a240-50847144550d admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:44.446435 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3552096-c98b-4dfe-a240-50847144550d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:44.448295 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3552096-c98b-4dfe-a240-50847144550d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:44.478105 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:44.480972 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1060/2110] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:44.483608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3552096-c98b-4dfe-a240-50847144550d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:44.507327 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3552096-c98b-4dfe-a240-50847144550d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:44.529742 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce3013-1019-44b6-8eaf-aa6c99fae88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:44.531854 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce3013-1019-44b6-8eaf-aa6c99fae88a admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:44.538897 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce3013-1019-44b6-8eaf-aa6c99fae88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:44.538897 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce3013-1019-44b6-8eaf-aa6c99fae88a admin admin] PATH_INFO: `/v3/projects/6281af7f1ff0448da89fdf72523fcffd/users/3c8cd4bee330490e8f08ff24a2d0933e/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:44.676445 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ce3013-1019-44b6-8eaf-aa6c99fae88a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6281af7f1ff0448da89fdf72523fcffd, user_id=3c8cd4bee330490e8f08ff24a2d0933e, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:44.691824 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ce3013-1019-44b6-8eaf-aa6c99fae88a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:44.722557 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-13e69068-17c3-4446-9bc2-58fc8b525938 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd1eba4e76da45579ff6cb5816c32001', 'request_id': 'req-13e69068-17c3-4446-9bc2-58fc8b525938'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:44.815903 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1061/2111] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:44 2022] PUT /identity/v3/projects/6281af7f1ff0448da89fdf72523fcffd/users/3c8cd4bee330490e8f08ff24a2d0933e/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:44.828673 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc733637-57cd-4fa4-81f6-f0cce54f4698 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:44.829524 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc733637-57cd-4fa4-81f6-f0cce54f4698 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:44.831124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc733637-57cd-4fa4-81f6-f0cce54f4698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:44.835666 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-13e69068-17c3-4446-9bc2-58fc8b525938 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd1eba4e76da45579ff6cb5816c32001', 'request_id': 'req-13e69068-17c3-4446-9bc2-58fc8b525938'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:44.858078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-13e69068-17c3-4446-9bc2-58fc8b525938 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd1eba4e76da45579ff6cb5816c32001', 'request_id': 'req-13e69068-17c3-4446-9bc2-58fc8b525938'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:44.870180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-13e69068-17c3-4446-9bc2-58fc8b525938 admin admin] The token cache is being invalidate because project fd1eba4e76da45579ff6cb5816c32001 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:39:44.870483 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-13e69068-17c3-4446-9bc2-58fc8b525938 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:44.871192 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-13e69068-17c3-4446-9bc2-58fc8b525938 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:44.878719 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1051/2112] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:39:44 2022] DELETE /identity/v3/projects/fd1eba4e76da45579ff6cb5816c32001 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:44.881723 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982395f-7719-417c-b8cf-ab3bd3e3d027 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:44.882093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982395f-7719-417c-b8cf-ab3bd3e3d027 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:44.882380 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982395f-7719-417c-b8cf-ab3bd3e3d027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:44.891867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-fc733637-57cd-4fa4-81f6-f0cce54f4698 None None] MFA Rules not processed for user `3c8cd4bee330490e8f08ff24a2d0933e`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:44.892918 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fc733637-57cd-4fa4-81f6-f0cce54f4698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:44.915402 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-f982395f-7719-417c-b8cf-ab3bd3e3d027 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:44.917316 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f982395f-7719-417c-b8cf-ab3bd3e3d027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:45.001807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1062/2113] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:39:45.006451 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc733637-57cd-4fa4-81f6-f0cce54f4698 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:45.013254 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fc733637-57cd-4fa4-81f6-f0cce54f4698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:45.017140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:45.102731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1052/2114] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:45.104362 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf02b70-b482-4041-9154-3f84d0beb763 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:45.104646 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf02b70-b482-4041-9154-3f84d0beb763 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:45.104913 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf02b70-b482-4041-9154-3f84d0beb763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:45.150515 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-3cf02b70-b482-4041-9154-3f84d0beb763 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:45.152274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3cf02b70-b482-4041-9154-3f84d0beb763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:45.163472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1053/2115] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:45.170716 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf02b70-b482-4041-9154-3f84d0beb763 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:45.180566 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc733637-57cd-4fa4-81f6-f0cce54f4698 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:45.184853 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf02b70-b482-4041-9154-3f84d0beb763 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:45.187234 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4a712-689a-4ab0-8181-369f067ecb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:45.189346 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4a712-689a-4ab0-8181-369f067ecb31 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:45.189665 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4a712-689a-4ab0-8181-369f067ecb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:45.189978 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4a712-689a-4ab0-8181-369f067ecb31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:45.190702 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4a712-689a-4ab0-8181-369f067ecb31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:45.193322 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4a712-689a-4ab0-8181-369f067ecb31 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:45.193807 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e000cdd-9f8b-4d62-9ba0-afb3b32d5572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:45.194742 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e000cdd-9f8b-4d62-9ba0-afb3b32d5572 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:45.195328 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e000cdd-9f8b-4d62-9ba0-afb3b32d5572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:45.196689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e000cdd-9f8b-4d62-9ba0-afb3b32d5572 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:45.197858 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e000cdd-9f8b-4d62-9ba0-afb3b32d5572 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:45.197858 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e000cdd-9f8b-4d62-9ba0-afb3b32d5572 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:45.208092 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e000cdd-9f8b-4d62-9ba0-afb3b32d5572 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:45.226309 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1054/2116] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:39:45.236784 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e000cdd-9f8b-4d62-9ba0-afb3b32d5572 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:45.252879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e000cdd-9f8b-4d62-9ba0-afb3b32d5572 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:45.258706 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cf6f5-32b9-425e-8360-a76dd655a9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:45.259407 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cf6f5-32b9-425e-8360-a76dd655a9e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:45.259769 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cf6f5-32b9-425e-8360-a76dd655a9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:45.260100 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cf6f5-32b9-425e-8360-a76dd655a9e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:45.262789 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cf6f5-32b9-425e-8360-a76dd655a9e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:45.264825 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cf6f5-32b9-425e-8360-a76dd655a9e3 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:45.339848 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1063/2117] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:39:45 2022] POST /identity/v3/projects => generated 375 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:45.344789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4a712-689a-4ab0-8181-369f067ecb31 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:45.388331 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1055/2118] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:39:45 2022] POST /identity/v3/projects => generated 365 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:45.390153 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cf6f5-32b9-425e-8360-a76dd655a9e3 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:45.447622 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4a712-689a-4ab0-8181-369f067ecb31 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:45.506633 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cf6f5-32b9-425e-8360-a76dd655a9e3 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:45.513033 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd7a64-41d4-4cb9-83b2-bc81e9a6137a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:45.513833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd7a64-41d4-4cb9-83b2-bc81e9a6137a admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:45.514306 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd7a64-41d4-4cb9-83b2-bc81e9a6137a admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:45.514589 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd7a64-41d4-4cb9-83b2-bc81e9a6137a admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:45.515233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd7a64-41d4-4cb9-83b2-bc81e9a6137a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:45.517277 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd7a64-41d4-4cb9-83b2-bc81e9a6137a admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:45.535559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7cf7f2-0672-4fcd-8ef7-ef581e156d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:45.536644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cf7f2-0672-4fcd-8ef7-ef581e156d04 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:45.537045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cf7f2-0672-4fcd-8ef7-ef581e156d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:45.537517 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cf7f2-0672-4fcd-8ef7-ef581e156d04 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:45.538525 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7cf7f2-0672-4fcd-8ef7-ef581e156d04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:45.541161 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7cf7f2-0672-4fcd-8ef7-ef581e156d04 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:45.599109 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1056/2119] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:39:45 2022] POST /identity/v3/users => generated 283 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:45.599109 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd7a64-41d4-4cb9-83b2-bc81e9a6137a admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:45.609286 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd7a64-41d4-4cb9-83b2-bc81e9a6137a admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:45.614264 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe3234-467e-4a99-aebe-c551c65ba7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:45.614849 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe3234-467e-4a99-aebe-c551c65ba7be admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:45.615716 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe3234-467e-4a99-aebe-c551c65ba7be admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:45.616240 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe3234-467e-4a99-aebe-c551c65ba7be admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:45.617068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe3234-467e-4a99-aebe-c551c65ba7be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:45.618948 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe3234-467e-4a99-aebe-c551c65ba7be admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:45.626942 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1064/2120] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:39:45 2022] POST /identity/v3/users => generated 294 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:39:45.631084 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7cf7f2-0672-4fcd-8ef7-ef581e156d04 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:45.632274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1057/2121] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:45.637594 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe3234-467e-4a99-aebe-c551c65ba7be admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:45.645914 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7cf7f2-0672-4fcd-8ef7-ef581e156d04 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:45.649641 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe3234-467e-4a99-aebe-c551c65ba7be admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:45.652187 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446705b-2a03-471b-a0ff-c4437c8741fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:45.652998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446705b-2a03-471b-a0ff-c4437c8741fc admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:45.653279 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446705b-2a03-471b-a0ff-c4437c8741fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:45.653661 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446705b-2a03-471b-a0ff-c4437c8741fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:45.655073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446705b-2a03-471b-a0ff-c4437c8741fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:45.657255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206f3c6-827c-4817-bacb-038561823f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:45.657495 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446705b-2a03-471b-a0ff-c4437c8741fc admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:45.657792 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206f3c6-827c-4817-bacb-038561823f0a admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:45.658105 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206f3c6-827c-4817-bacb-038561823f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:45.658570 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206f3c6-827c-4817-bacb-038561823f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:45.659409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206f3c6-827c-4817-bacb-038561823f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:45.661023 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206f3c6-827c-4817-bacb-038561823f0a admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:45.671795 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1065/2122] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:45.676399 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446705b-2a03-471b-a0ff-c4437c8741fc admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:45.676948 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1058/2123] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:45.684182 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206f3c6-827c-4817-bacb-038561823f0a admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:45.694428 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446705b-2a03-471b-a0ff-c4437c8741fc admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:45.696843 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206f3c6-827c-4817-bacb-038561823f0a admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:45.700022 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be8903-ef65-4696-8c27-5e1eed82fa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:45.700772 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be8903-ef65-4696-8c27-5e1eed82fa42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:45.701161 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be8903-ef65-4696-8c27-5e1eed82fa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:45.701427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be8903-ef65-4696-8c27-5e1eed82fa42 admin admin] PATH_INFO: `/v3/projects/305f087cdca241738e01e08de0d3cbb1/users/2d8b44fbe6f34990a6dd809de96d8fae/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:45.702175 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf41d1a-7f11-4f6b-9d82-98ca5df8c78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:45.702967 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf41d1a-7f11-4f6b-9d82-98ca5df8c78c admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:45.703985 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf41d1a-7f11-4f6b-9d82-98ca5df8c78c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:45.704340 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf41d1a-7f11-4f6b-9d82-98ca5df8c78c admin admin] PATH_INFO: `/v3/projects/7bc9f58d0c7b4e91bfb2930b59f17c70/users/7c507fff096b4796bf63803f3b961e1c/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:45.721063 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be8903-ef65-4696-8c27-5e1eed82fa42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=305f087cdca241738e01e08de0d3cbb1, user_id=2d8b44fbe6f34990a6dd809de96d8fae, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:45.723810 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf41d1a-7f11-4f6b-9d82-98ca5df8c78c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bc9f58d0c7b4e91bfb2930b59f17c70, user_id=7c507fff096b4796bf63803f3b961e1c, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:45.724006 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be8903-ef65-4696-8c27-5e1eed82fa42 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:45.726775 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf41d1a-7f11-4f6b-9d82-98ca5df8c78c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:45.807824 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1059/2124] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:45 2022] PUT /identity/v3/projects/7bc9f58d0c7b4e91bfb2930b59f17c70/users/7c507fff096b4796bf63803f3b961e1c/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:45.809806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1066/2125] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:45 2022] PUT /identity/v3/projects/305f087cdca241738e01e08de0d3cbb1/users/2d8b44fbe6f34990a6dd809de96d8fae/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:45.820397 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf41d1a-7f11-4f6b-9d82-98ca5df8c78c admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:45.822393 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79555f10-cc73-4cc8-b1f0-3d3cc74f4b17 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:45.823105 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79555f10-cc73-4cc8-b1f0-3d3cc74f4b17 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:45.823600 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79555f10-cc73-4cc8-b1f0-3d3cc74f4b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:45.861913 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-79555f10-cc73-4cc8-b1f0-3d3cc74f4b17 None None] MFA Rules not processed for user `7c507fff096b4796bf63803f3b961e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:45.864586 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-79555f10-cc73-4cc8-b1f0-3d3cc74f4b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:45.920469 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf41d1a-7f11-4f6b-9d82-98ca5df8c78c admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:45.970630 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1067/2126] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:45.980629 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79555f10-cc73-4cc8-b1f0-3d3cc74f4b17 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:45.982103 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-79555f10-cc73-4cc8-b1f0-3d3cc74f4b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:46.003000 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:46.027895 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21696e3-9c29-4610-b8a4-1e2f4c3c3142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:46.028514 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21696e3-9c29-4610-b8a4-1e2f4c3c3142 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:46.028792 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21696e3-9c29-4610-b8a4-1e2f4c3c3142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:46.029103 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21696e3-9c29-4610-b8a4-1e2f4c3c3142 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:46.029779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21696e3-9c29-4610-b8a4-1e2f4c3c3142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:46.032583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21696e3-9c29-4610-b8a4-1e2f4c3c3142 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:46.044211 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1060/2127] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:46.049465 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21696e3-9c29-4610-b8a4-1e2f4c3c3142 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:46.058219 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79555f10-cc73-4cc8-b1f0-3d3cc74f4b17 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:46.060949 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21696e3-9c29-4610-b8a4-1e2f4c3c3142 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:46.062169 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de385b53-59a9-45da-a4e7-4ffb3139a2b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:46.063546 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de385b53-59a9-45da-a4e7-4ffb3139a2b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:46.063923 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de385b53-59a9-45da-a4e7-4ffb3139a2b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:46.064170 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de385b53-59a9-45da-a4e7-4ffb3139a2b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:46.067742 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4adaab8-049f-41a4-b8a8-d44065ec8e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:46.068539 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4adaab8-049f-41a4-b8a8-d44065ec8e99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:46.068888 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4adaab8-049f-41a4-b8a8-d44065ec8e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:46.069228 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4adaab8-049f-41a4-b8a8-d44065ec8e99 admin admin] PATH_INFO: `/v3/projects/305f087cdca241738e01e08de0d3cbb1/users/2d8b44fbe6f34990a6dd809de96d8fae/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:46.072101 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4adaab8-049f-41a4-b8a8-d44065ec8e99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=305f087cdca241738e01e08de0d3cbb1, user_id=2d8b44fbe6f34990a6dd809de96d8fae, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:46.073626 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de385b53-59a9-45da-a4e7-4ffb3139a2b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:46.074945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de385b53-59a9-45da-a4e7-4ffb3139a2b8 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:46.075111 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4adaab8-049f-41a4-b8a8-d44065ec8e99 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:46.099474 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1068/2129] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:39:46.103727 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1061/2129] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:46 2022] PUT /identity/v3/projects/305f087cdca241738e01e08de0d3cbb1/users/2d8b44fbe6f34990a6dd809de96d8fae/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:46.105768 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d262c2-f175-4f80-85b9-7c8429a5be86 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:46.106136 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d262c2-f175-4f80-85b9-7c8429a5be86 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:46.106477 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d262c2-f175-4f80-85b9-7c8429a5be86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:46.118387 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:46.176517 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-43d262c2-f175-4f80-85b9-7c8429a5be86 None None] MFA Rules not processed for user `2d8b44fbe6f34990a6dd809de96d8fae`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:46.178148 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-43d262c2-f175-4f80-85b9-7c8429a5be86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:46.279721 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1069/2130] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:46.294929 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4adaab8-049f-41a4-b8a8-d44065ec8e99 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:46.299584 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e4adaab8-049f-41a4-b8a8-d44065ec8e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:46.380404 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4adaab8-049f-41a4-b8a8-d44065ec8e99 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:46.393262 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a10b8-735c-4c97-90d4-f7880e1ad504 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:46.393964 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a10b8-735c-4c97-90d4-f7880e1ad504 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:46.394198 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a10b8-735c-4c97-90d4-f7880e1ad504 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:46.395095 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a10b8-735c-4c97-90d4-f7880e1ad504 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:46.514637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a10b8-735c-4c97-90d4-f7880e1ad504 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:46.519806 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a10b8-735c-4c97-90d4-f7880e1ad504 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:46.537615 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1062/2131] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:39:46.720546 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:46.877188 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:46.877469 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9911e8f-2885-49c3-b852-2411f6987d10 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:46.877777 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9911e8f-2885-49c3-b852-2411f6987d10 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:46.881182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9911e8f-2885-49c3-b852-2411f6987d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:46.916592 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f9911e8f-2885-49c3-b852-2411f6987d10 None None] MFA Rules not processed for user `3b7c54ebd95f4b3eb396982d75615f23`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:46.917995 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f9911e8f-2885-49c3-b852-2411f6987d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:47.062128 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1070/2132] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:39:47.072535 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a10b8-735c-4c97-90d4-f7880e1ad504 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:47.072535 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d90a10b8-735c-4c97-90d4-f7880e1ad504 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:47.199423 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a10b8-735c-4c97-90d4-f7880e1ad504 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:47.213978 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ece20-fdb3-49f2-a824-cb7cb8fc4e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:47.215006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ece20-fdb3-49f2-a824-cb7cb8fc4e7b admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:47.215293 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ece20-fdb3-49f2-a824-cb7cb8fc4e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:47.215569 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ece20-fdb3-49f2-a824-cb7cb8fc4e7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:47.216276 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ece20-fdb3-49f2-a824-cb7cb8fc4e7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:47.220422 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ece20-fdb3-49f2-a824-cb7cb8fc4e7b admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:47.295249 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9911e8f-2885-49c3-b852-2411f6987d10 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:47.311470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9911e8f-2885-49c3-b852-2411f6987d10 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:47.325599 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c06562c-6500-42d5-ab2f-b8cfafac0c78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:47.329503 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06562c-6500-42d5-ab2f-b8cfafac0c78 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:47.329503 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06562c-6500-42d5-ab2f-b8cfafac0c78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:47.329802 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06562c-6500-42d5-ab2f-b8cfafac0c78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:47.339392 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6c06562c-6500-42d5-ab2f-b8cfafac0c78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:47.433778 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c06562c-6500-42d5-ab2f-b8cfafac0c78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:47.435602 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c06562c-6500-42d5-ab2f-b8cfafac0c78 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:47.449187 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1071/2133] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:39:47.460528 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1063/2134] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:39:47 2022] POST /identity/v3/projects => generated 379 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:39:47.461522 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c06562c-6500-42d5-ab2f-b8cfafac0c78 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:47.480746 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c06562c-6500-42d5-ab2f-b8cfafac0c78 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:47.490933 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:47.565290 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830283a2-4e71-4d70-acb8-271c8a1a406b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:47.565684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830283a2-4e71-4d70-acb8-271c8a1a406b admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:47.566194 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830283a2-4e71-4d70-acb8-271c8a1a406b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:47.566489 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830283a2-4e71-4d70-acb8-271c8a1a406b admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:47.567182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830283a2-4e71-4d70-acb8-271c8a1a406b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:47.569168 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830283a2-4e71-4d70-acb8-271c8a1a406b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:47.673157 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ece20-fdb3-49f2-a824-cb7cb8fc4e7b admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:47.673633 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1072/2135] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:39:47 2022] POST /identity/v3/users => generated 296 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:39:47.686112 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ece20-fdb3-49f2-a824-cb7cb8fc4e7b admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:47.692489 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f635e3-aa8e-493a-a7d3-da142ae307d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:47.693565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f635e3-aa8e-493a-a7d3-da142ae307d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:47.694106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f635e3-aa8e-493a-a7d3-da142ae307d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:47.695150 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f635e3-aa8e-493a-a7d3-da142ae307d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:47.696509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f635e3-aa8e-493a-a7d3-da142ae307d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:47.698497 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f635e3-aa8e-493a-a7d3-da142ae307d4 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:47.718137 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830283a2-4e71-4d70-acb8-271c8a1a406b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:47.729310 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1064/2136] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:47.732705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830283a2-4e71-4d70-acb8-271c8a1a406b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:47.738468 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d6b3b-b88b-4adb-bc9d-faf86f61519f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:47.739428 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d6b3b-b88b-4adb-bc9d-faf86f61519f admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:47.739805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d6b3b-b88b-4adb-bc9d-faf86f61519f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:47.740186 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d6b3b-b88b-4adb-bc9d-faf86f61519f admin admin] PATH_INFO: `/v3/projects/7aa03566adff425a83a825ee12839c58/users/855a435a052640e2a214436653585d88/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:47.770755 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d6b3b-b88b-4adb-bc9d-faf86f61519f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aa03566adff425a83a825ee12839c58, user_id=855a435a052640e2a214436653585d88, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:47.777205 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d6b3b-b88b-4adb-bc9d-faf86f61519f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:47.875841 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1073/2137] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:47 2022] PUT /identity/v3/projects/7aa03566adff425a83a825ee12839c58/users/855a435a052640e2a214436653585d88/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:39:47.877418 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f635e3-aa8e-493a-a7d3-da142ae307d4 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:47.892414 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f635e3-aa8e-493a-a7d3-da142ae307d4 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:47.971869 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb4ec1-b44b-4e85-a361-2e6eb0726fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:47.973055 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb4ec1-b44b-4e85-a361-2e6eb0726fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:47.973481 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb4ec1-b44b-4e85-a361-2e6eb0726fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:47.973954 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb4ec1-b44b-4e85-a361-2e6eb0726fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:47.975780 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb4ec1-b44b-4e85-a361-2e6eb0726fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:47.978071 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb4ec1-b44b-4e85-a361-2e6eb0726fc7 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:48.001874 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d6b3b-b88b-4adb-bc9d-faf86f61519f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:48.002167 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1065/2138] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:48.013676 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d6b3b-b88b-4adb-bc9d-faf86f61519f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:48.027438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f3f0d-c513-4c20-b24e-2d3448772dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:48.028133 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f3f0d-c513-4c20-b24e-2d3448772dcd admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:48.028418 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f3f0d-c513-4c20-b24e-2d3448772dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:48.028695 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f3f0d-c513-4c20-b24e-2d3448772dcd admin admin] PATH_INFO: `/v3/projects/7aa03566adff425a83a825ee12839c58/users/855a435a052640e2a214436653585d88/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:48.036047 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f3f0d-c513-4c20-b24e-2d3448772dcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aa03566adff425a83a825ee12839c58, user_id=855a435a052640e2a214436653585d88, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:48.039275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f3f0d-c513-4c20-b24e-2d3448772dcd admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:48.051230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1074/2139] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:48 2022] PUT /identity/v3/projects/7aa03566adff425a83a825ee12839c58/users/855a435a052640e2a214436653585d88/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:39:48.488826 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:48.574670 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:51.300387 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb4ec1-b44b-4e85-a361-2e6eb0726fc7 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:51.312641 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb4ec1-b44b-4e85-a361-2e6eb0726fc7 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:51.338397 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:51.410696 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fdb655-b772-4795-b05a-52a84c35ea65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:51.413086 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdb655-b772-4795-b05a-52a84c35ea65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:51.416366 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdb655-b772-4795-b05a-52a84c35ea65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:51.416366 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdb655-b772-4795-b05a-52a84c35ea65 admin admin] PATH_INFO: `/v3/users/3c8cd4bee330490e8f08ff24a2d0933e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:51.418311 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fdb655-b772-4795-b05a-52a84c35ea65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c8cd4bee330490e8f08ff24a2d0933e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:51.421261 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fdb655-b772-4795-b05a-52a84c35ea65 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:51.473134 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2480d56-adc6-41cc-be40-f2c9f86ba0d0 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:51.474016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2480d56-adc6-41cc-be40-f2c9f86ba0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:51.475382 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2480d56-adc6-41cc-be40-f2c9f86ba0d0 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:51.477009 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1075/2140] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 14:39:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:39:51.487059 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a718ed-6747-4404-8771-b4874f4c9cf7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:51.487501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a718ed-6747-4404-8771-b4874f4c9cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:51.487910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a718ed-6747-4404-8771-b4874f4c9cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:51.532774 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-51a718ed-6747-4404-8771-b4874f4c9cf7 None None] MFA Rules not processed for user `63253cd786c04d6a9d099773198aee36`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:51.533119 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-51a718ed-6747-4404-8771-b4874f4c9cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:51.643370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1076/2141] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 14:39:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:39:51.650839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a718ed-6747-4404-8771-b4874f4c9cf7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:51.652438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-51a718ed-6747-4404-8771-b4874f4c9cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:51.677943 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a718ed-6747-4404-8771-b4874f4c9cf7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:51.687034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b8fdb655-b772-4795-b05a-52a84c35ea65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c8cd4bee330490e8f08ff24a2d0933e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:51.690306 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b8fdb655-b772-4795-b05a-52a84c35ea65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c8cd4bee330490e8f08ff24a2d0933e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:51.690698 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a53a1-ebf6-4452-863c-822fe4f1fed1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63253cd786c04d6a9d099773198aee36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:51.694419 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a53a1-ebf6-4452-863c-822fe4f1fed1 service placement] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:51.696004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a53a1-ebf6-4452-863c-822fe4f1fed1 service placement] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:51.696617 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a53a1-ebf6-4452-863c-822fe4f1fed1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:51.726644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a53a1-ebf6-4452-863c-822fe4f1fed1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:51.727479 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b8fdb655-b772-4795-b05a-52a84c35ea65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c8cd4bee330490e8f08ff24a2d0933e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:51.729532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a53a1-ebf6-4452-863c-822fe4f1fed1 service placement] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:51.730071 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b8fdb655-b772-4795-b05a-52a84c35ea65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c8cd4bee330490e8f08ff24a2d0933e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:51.752287 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1077/2142] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:39:51.753170 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a53a1-ebf6-4452-863c-822fe4f1fed1 service placement] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:51.754942 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1f7a53a1-ebf6-4452-863c-822fe4f1fed1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:51.764605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:51.771650 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a53a1-ebf6-4452-863c-822fe4f1fed1 service placement] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:51.776932 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a077408-b14b-43b9-bd01-ebcbd53fe5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:51.777925 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a077408-b14b-43b9-bd01-ebcbd53fe5ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:51.778389 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a077408-b14b-43b9-bd01-ebcbd53fe5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:51.778669 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a077408-b14b-43b9-bd01-ebcbd53fe5ea admin admin] PATH_INFO: `/v3/users/7b0a0a0664744f378ca4e17e914f4259` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:51.779853 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a077408-b14b-43b9-bd01-ebcbd53fe5ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b0a0a0664744f378ca4e17e914f4259)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:51.781996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a077408-b14b-43b9-bd01-ebcbd53fe5ea admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:51.819614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b8fdb655-b772-4795-b05a-52a84c35ea65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c8cd4bee330490e8f08ff24a2d0933e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:51.833557 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1066/2143] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:39:51 2022] DELETE /identity/v3/users/3c8cd4bee330490e8f08ff24a2d0933e => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:51.839041 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3814a9e-9bbd-49b2-84e8-0002f30d35ea None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:51.839531 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3814a9e-9bbd-49b2-84e8-0002f30d35ea None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:51.839863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3814a9e-9bbd-49b2-84e8-0002f30d35ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:51.860032 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-f3814a9e-9bbd-49b2-84e8-0002f30d35ea None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:51.861369 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f3814a9e-9bbd-49b2-84e8-0002f30d35ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:51.936749 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1067/2144] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:51.950082 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3814a9e-9bbd-49b2-84e8-0002f30d35ea None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:51.954394 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f3814a9e-9bbd-49b2-84e8-0002f30d35ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:52.022414 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6a077408-b14b-43b9-bd01-ebcbd53fe5ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b0a0a0664744f378ca4e17e914f4259'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:52.023080 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6a077408-b14b-43b9-bd01-ebcbd53fe5ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b0a0a0664744f378ca4e17e914f4259'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:52.024828 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6a077408-b14b-43b9-bd01-ebcbd53fe5ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b0a0a0664744f378ca4e17e914f4259'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:52.034913 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3814a9e-9bbd-49b2-84e8-0002f30d35ea None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:52.038970 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd351a5e-b8d8-48de-a339-4cec1359c68e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:52.039746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd351a5e-b8d8-48de-a339-4cec1359c68e service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:52.040123 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd351a5e-b8d8-48de-a339-4cec1359c68e service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:52.040512 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd351a5e-b8d8-48de-a339-4cec1359c68e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:52.043090 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-dd351a5e-b8d8-48de-a339-4cec1359c68e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:52.046031 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6a077408-b14b-43b9-bd01-ebcbd53fe5ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b0a0a0664744f378ca4e17e914f4259'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:52.058146 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd351a5e-b8d8-48de-a339-4cec1359c68e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:52.059751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd351a5e-b8d8-48de-a339-4cec1359c68e service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:52.076737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1068/2145] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:39:52.134222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6a077408-b14b-43b9-bd01-ebcbd53fe5ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b0a0a0664744f378ca4e17e914f4259'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:52.160482 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1078/2146] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:39:51 2022] DELETE /identity/v3/users/7b0a0a0664744f378ca4e17e914f4259 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:52.585562 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd351a5e-b8d8-48de-a339-4cec1359c68e service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:52.588140 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-dd351a5e-b8d8-48de-a339-4cec1359c68e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:52.603769 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd351a5e-b8d8-48de-a339-4cec1359c68e service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:52.666638 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a077408-b14b-43b9-bd01-ebcbd53fe5ea admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:52.668101 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6a077408-b14b-43b9-bd01-ebcbd53fe5ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:52.708825 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:52.783950 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f598a61-2487-4cae-9ecb-0ada43d0de41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:52.784600 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f598a61-2487-4cae-9ecb-0ada43d0de41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:52.784881 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f598a61-2487-4cae-9ecb-0ada43d0de41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:52.785331 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f598a61-2487-4cae-9ecb-0ada43d0de41 admin admin] PATH_INFO: `/v3/projects/3afce3a011534835893040caf18b19a5` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:52.786698 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f598a61-2487-4cae-9ecb-0ada43d0de41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3afce3a011534835893040caf18b19a5)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:52.788730 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f598a61-2487-4cae-9ecb-0ada43d0de41 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:52.894873 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a077408-b14b-43b9-bd01-ebcbd53fe5ea admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:52.912287 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af93fdc-cd1d-4388-bd93-9eedd300f305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:52.913257 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af93fdc-cd1d-4388-bd93-9eedd300f305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:52.913700 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af93fdc-cd1d-4388-bd93-9eedd300f305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:52.914171 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af93fdc-cd1d-4388-bd93-9eedd300f305 admin admin] PATH_INFO: `/v3/projects/6281af7f1ff0448da89fdf72523fcffd` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:52.915647 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af93fdc-cd1d-4388-bd93-9eedd300f305 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6281af7f1ff0448da89fdf72523fcffd)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:52.919056 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af93fdc-cd1d-4388-bd93-9eedd300f305 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:52.978633 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8f598a61-2487-4cae-9ecb-0ada43d0de41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3afce3a011534835893040caf18b19a5', 'request_id': 'req-8f598a61-2487-4cae-9ecb-0ada43d0de41'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:53.065662 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8f598a61-2487-4cae-9ecb-0ada43d0de41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3afce3a011534835893040caf18b19a5', 'request_id': 'req-8f598a61-2487-4cae-9ecb-0ada43d0de41'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:53.074276 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8f598a61-2487-4cae-9ecb-0ada43d0de41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3afce3a011534835893040caf18b19a5', 'request_id': 'req-8f598a61-2487-4cae-9ecb-0ada43d0de41'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:53.092388 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8f598a61-2487-4cae-9ecb-0ada43d0de41 admin admin] The token cache is being invalidate because project 3afce3a011534835893040caf18b19a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:39:53.094777 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8f598a61-2487-4cae-9ecb-0ada43d0de41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:53.094777 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-8f598a61-2487-4cae-9ecb-0ada43d0de41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:53.103781 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1069/2147] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:39:52 2022] DELETE /identity/v3/projects/3afce3a011534835893040caf18b19a5 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:53.105517 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0eb993-d523-440c-ba2a-a88279199e1c None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:53.105944 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0eb993-d523-440c-ba2a-a88279199e1c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:53.106693 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0eb993-d523-440c-ba2a-a88279199e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:53.152970 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2af93fdc-cd1d-4388-bd93-9eedd300f305 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6281af7f1ff0448da89fdf72523fcffd', 'request_id': 'req-2af93fdc-cd1d-4388-bd93-9eedd300f305'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:53.163397 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-8a0eb993-d523-440c-ba2a-a88279199e1c None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:53.164807 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-8a0eb993-d523-440c-ba2a-a88279199e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:53.229439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2af93fdc-cd1d-4388-bd93-9eedd300f305 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6281af7f1ff0448da89fdf72523fcffd', 'request_id': 'req-2af93fdc-cd1d-4388-bd93-9eedd300f305'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:53.245338 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2af93fdc-cd1d-4388-bd93-9eedd300f305 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6281af7f1ff0448da89fdf72523fcffd', 'request_id': 'req-2af93fdc-cd1d-4388-bd93-9eedd300f305'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:53.285109 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2af93fdc-cd1d-4388-bd93-9eedd300f305 admin admin] The token cache is being invalidate because project 6281af7f1ff0448da89fdf72523fcffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:39:53.285704 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2af93fdc-cd1d-4388-bd93-9eedd300f305 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:53.290353 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2af93fdc-cd1d-4388-bd93-9eedd300f305 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:53.296426 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1079/2148] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:39:52 2022] DELETE /identity/v3/projects/6281af7f1ff0448da89fdf72523fcffd => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:53.299170 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af93fdc-cd1d-4388-bd93-9eedd300f305 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:53.306070 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2af93fdc-cd1d-4388-bd93-9eedd300f305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:53.326539 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:53.372268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1070/2149] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:53.380565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d93ed4-876a-4eda-9cd2-347fa9aee33b None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:53.381290 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d93ed4-876a-4eda-9cd2-347fa9aee33b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:53.381628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d93ed4-876a-4eda-9cd2-347fa9aee33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:53.418211 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-13d93ed4-876a-4eda-9cd2-347fa9aee33b None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:53.420455 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-13d93ed4-876a-4eda-9cd2-347fa9aee33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:53.432925 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1071/2150] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:39:53.436597 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d93ed4-876a-4eda-9cd2-347fa9aee33b None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:53.452057 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d93ed4-876a-4eda-9cd2-347fa9aee33b None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:53.457707 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af93fdc-cd1d-4388-bd93-9eedd300f305 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:53.458603 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49362d7-9eda-401a-87f5-d825454c3004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:53.459286 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49362d7-9eda-401a-87f5-d825454c3004 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:53.459566 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49362d7-9eda-401a-87f5-d825454c3004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:53.459839 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49362d7-9eda-401a-87f5-d825454c3004 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:53.460510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49362d7-9eda-401a-87f5-d825454c3004 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:53.460816 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49362d7-9eda-401a-87f5-d825454c3004 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:53.462590 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49362d7-9eda-401a-87f5-d825454c3004 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:53.472709 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc55ec-ceb6-4581-aa8c-ad920dd4fd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:53.473370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc55ec-ceb6-4581-aa8c-ad920dd4fd29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:53.473646 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc55ec-ceb6-4581-aa8c-ad920dd4fd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:53.473955 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc55ec-ceb6-4581-aa8c-ad920dd4fd29 admin admin] PATH_INFO: `/v3/users/2d8b44fbe6f34990a6dd809de96d8fae` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:53.477215 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc55ec-ceb6-4581-aa8c-ad920dd4fd29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d8b44fbe6f34990a6dd809de96d8fae)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:53.479228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc55ec-ceb6-4581-aa8c-ad920dd4fd29 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:53.497967 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1072/2151] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:39:53.502742 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49362d7-9eda-401a-87f5-d825454c3004 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:53.521943 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49362d7-9eda-401a-87f5-d825454c3004 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:53.535300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61929f-d090-424c-853c-41236923dd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:53.536193 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61929f-d090-424c-853c-41236923dd57 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:53.536622 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61929f-d090-424c-853c-41236923dd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:53.537031 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61929f-d090-424c-853c-41236923dd57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:53.537858 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61929f-d090-424c-853c-41236923dd57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:53.541714 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61929f-d090-424c-853c-41236923dd57 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:53.702172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1073/2152] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:39:53 2022] POST /identity/v3/projects => generated 387 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:53.708106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61929f-d090-424c-853c-41236923dd57 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:53.778317 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4ebc55ec-ceb6-4581-aa8c-ad920dd4fd29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d8b44fbe6f34990a6dd809de96d8fae'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:53.813544 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61929f-d090-424c-853c-41236923dd57 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:53.822450 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4ebc55ec-ceb6-4581-aa8c-ad920dd4fd29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d8b44fbe6f34990a6dd809de96d8fae'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:53.823342 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4ebc55ec-ceb6-4581-aa8c-ad920dd4fd29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d8b44fbe6f34990a6dd809de96d8fae'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:53.823565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235de398-d25f-43f4-b0e8-27010921ca78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:53.826028 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235de398-d25f-43f4-b0e8-27010921ca78 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:53.830047 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235de398-d25f-43f4-b0e8-27010921ca78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:53.831029 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235de398-d25f-43f4-b0e8-27010921ca78 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:53.831881 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235de398-d25f-43f4-b0e8-27010921ca78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:53.838246 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235de398-d25f-43f4-b0e8-27010921ca78 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:53.865127 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4ebc55ec-ceb6-4581-aa8c-ad920dd4fd29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d8b44fbe6f34990a6dd809de96d8fae'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:53.933247 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4ebc55ec-ceb6-4581-aa8c-ad920dd4fd29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d8b44fbe6f34990a6dd809de96d8fae'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:53.954134 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1080/2153] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:39:53 2022] DELETE /identity/v3/users/2d8b44fbe6f34990a6dd809de96d8fae => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:53.980754 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1074/2154] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:39:53 2022] POST /identity/v3/users => generated 294 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:53.985352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc55ec-ceb6-4581-aa8c-ad920dd4fd29 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:53.987244 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4ebc55ec-ceb6-4581-aa8c-ad920dd4fd29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:54.096454 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc55ec-ceb6-4581-aa8c-ad920dd4fd29 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:54.110433 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1c7cb-aa7f-4377-b2e5-8941f295c1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:54.110433 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1c7cb-aa7f-4377-b2e5-8941f295c1a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:54.110433 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1c7cb-aa7f-4377-b2e5-8941f295c1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:54.110433 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1c7cb-aa7f-4377-b2e5-8941f295c1a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:54.110988 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1c7cb-aa7f-4377-b2e5-8941f295c1a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:54.111692 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1c7cb-aa7f-4377-b2e5-8941f295c1a6 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:54.137489 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1081/2155] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:54.142425 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235de398-d25f-43f4-b0e8-27010921ca78 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:54.170991 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235de398-d25f-43f4-b0e8-27010921ca78 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:54.182231 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab1d54-271a-4d73-916a-6acafdcda5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:54.184526 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab1d54-271a-4d73-916a-6acafdcda5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:54.185199 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab1d54-271a-4d73-916a-6acafdcda5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:54.186653 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab1d54-271a-4d73-916a-6acafdcda5a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:54.187428 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab1d54-271a-4d73-916a-6acafdcda5a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:54.216274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab1d54-271a-4d73-916a-6acafdcda5a9 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:54.245535 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1075/2156] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:54.251927 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1c7cb-aa7f-4377-b2e5-8941f295c1a6 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:54.280639 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1c7cb-aa7f-4377-b2e5-8941f295c1a6 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:54.290245 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd3b6b-b01e-4023-bda2-45c27bccab27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:54.291798 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd3b6b-b01e-4023-bda2-45c27bccab27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:54.292562 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd3b6b-b01e-4023-bda2-45c27bccab27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:54.293266 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd3b6b-b01e-4023-bda2-45c27bccab27 admin admin] PATH_INFO: `/v3/projects/bd132c76a971463d9cb7c38ee97c122b/users/edf6dae8382849839114b59f6d816b6c/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:54.357548 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd3b6b-b01e-4023-bda2-45c27bccab27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd132c76a971463d9cb7c38ee97c122b, user_id=edf6dae8382849839114b59f6d816b6c, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:54.372447 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd3b6b-b01e-4023-bda2-45c27bccab27 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:54.482665 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1082/2157] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:54 2022] PUT /identity/v3/projects/bd132c76a971463d9cb7c38ee97c122b/users/edf6dae8382849839114b59f6d816b6c/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:39:54.496236 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd3f14-2ab2-454d-a972-7b5542b4c002 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:54.496697 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd3f14-2ab2-454d-a972-7b5542b4c002 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:54.496820 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd3f14-2ab2-454d-a972-7b5542b4c002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:54.535508 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-eacd3f14-2ab2-454d-a972-7b5542b4c002 None None] MFA Rules not processed for user `edf6dae8382849839114b59f6d816b6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:54.536775 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-eacd3f14-2ab2-454d-a972-7b5542b4c002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:54.654685 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1076/2158] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:54.656013 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd3b6b-b01e-4023-bda2-45c27bccab27 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:54.777965 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd3b6b-b01e-4023-bda2-45c27bccab27 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:54.786294 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668b773-4020-4bc3-ade5-012727b99f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:54.787297 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668b773-4020-4bc3-ade5-012727b99f0e admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:54.787862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668b773-4020-4bc3-ade5-012727b99f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:54.789978 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668b773-4020-4bc3-ade5-012727b99f0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:54.790755 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668b773-4020-4bc3-ade5-012727b99f0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:54.792754 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668b773-4020-4bc3-ade5-012727b99f0e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:54.838744 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd3f14-2ab2-454d-a972-7b5542b4c002 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:54.841021 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-eacd3f14-2ab2-454d-a972-7b5542b4c002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:54.868371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd3f14-2ab2-454d-a972-7b5542b4c002 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:54.884751 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d7aa6-611a-4be7-8e01-365807022ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:54.886988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d7aa6-611a-4be7-8e01-365807022ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:54.886988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d7aa6-611a-4be7-8e01-365807022ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:54.887586 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d7aa6-611a-4be7-8e01-365807022ea6 admin admin] PATH_INFO: `/v3/projects/305f087cdca241738e01e08de0d3cbb1` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:54.889504 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d7aa6-611a-4be7-8e01-365807022ea6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=305f087cdca241738e01e08de0d3cbb1)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:54.893138 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d7aa6-611a-4be7-8e01-365807022ea6 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:54.903528 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1083/2159] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:39:54 2022] POST /identity/v3/projects => generated 385 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:54.908639 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668b773-4020-4bc3-ade5-012727b99f0e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:54.957506 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:55.065913 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-bc2d7aa6-611a-4be7-8e01-365807022ea6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '305f087cdca241738e01e08de0d3cbb1', 'request_id': 'req-bc2d7aa6-611a-4be7-8e01-365807022ea6'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:55.066784 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668b773-4020-4bc3-ade5-012727b99f0e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:55.143448 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf5cc5-69c9-4603-a0fb-86c7ce968e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:55.144466 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf5cc5-69c9-4603-a0fb-86c7ce968e8e admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:55.144864 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf5cc5-69c9-4603-a0fb-86c7ce968e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:55.145244 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf5cc5-69c9-4603-a0fb-86c7ce968e8e admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:55.146003 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf5cc5-69c9-4603-a0fb-86c7ce968e8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:55.149009 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf5cc5-69c9-4603-a0fb-86c7ce968e8e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:55.165787 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-bc2d7aa6-611a-4be7-8e01-365807022ea6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '305f087cdca241738e01e08de0d3cbb1', 'request_id': 'req-bc2d7aa6-611a-4be7-8e01-365807022ea6'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:55.175555 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-bc2d7aa6-611a-4be7-8e01-365807022ea6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '305f087cdca241738e01e08de0d3cbb1', 'request_id': 'req-bc2d7aa6-611a-4be7-8e01-365807022ea6'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:55.197620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-bc2d7aa6-611a-4be7-8e01-365807022ea6 admin admin] The token cache is being invalidate because project 305f087cdca241738e01e08de0d3cbb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:39:55.198203 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-bc2d7aa6-611a-4be7-8e01-365807022ea6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:55.198882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-bc2d7aa6-611a-4be7-8e01-365807022ea6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:39:55.201000 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1077/2160] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:39:54 2022] DELETE /identity/v3/projects/305f087cdca241738e01e08de0d3cbb1 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:55.206550 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39073f56-ef26-4b69-b84f-96113c646999 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:55.208035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39073f56-ef26-4b69-b84f-96113c646999 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:55.208905 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39073f56-ef26-4b69-b84f-96113c646999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:55.233281 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-39073f56-ef26-4b69-b84f-96113c646999 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:55.238758 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-39073f56-ef26-4b69-b84f-96113c646999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:55.245796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1078/2161] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:39:55.256898 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe14e2-4312-4352-9485-6daa06472670 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:55.257880 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe14e2-4312-4352-9485-6daa06472670 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:55.259013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe14e2-4312-4352-9485-6daa06472670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:55.272998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1084/2162] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:39:54 2022] POST /identity/v3/users => generated 293 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:55.277043 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf5cc5-69c9-4603-a0fb-86c7ce968e8e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:55.279451 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1edf5cc5-69c9-4603-a0fb-86c7ce968e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:55.301980 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf5cc5-69c9-4603-a0fb-86c7ce968e8e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:55.305565 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-08fe14e2-4312-4352-9485-6daa06472670 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:55.307482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-08fe14e2-4312-4352-9485-6daa06472670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:55.309199 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1082d5-1201-4dee-9de7-10dbbab9f377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:55.309940 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1082d5-1201-4dee-9de7-10dbbab9f377 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:55.310325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1082d5-1201-4dee-9de7-10dbbab9f377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:55.310682 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1082d5-1201-4dee-9de7-10dbbab9f377 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:55.311697 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1082d5-1201-4dee-9de7-10dbbab9f377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:55.314246 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1082d5-1201-4dee-9de7-10dbbab9f377 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:55.324548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1079/2163] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:55.325942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe14e2-4312-4352-9485-6daa06472670 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:55.330498 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1085/2164] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:39:55.331709 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1082d5-1201-4dee-9de7-10dbbab9f377 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:55.340167 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe14e2-4312-4352-9485-6daa06472670 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:55.342578 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1082d5-1201-4dee-9de7-10dbbab9f377 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:55.346230 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462dd045-a559-4fb0-90e7-50935aa2630e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:55.347233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462dd045-a559-4fb0-90e7-50935aa2630e admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:55.347429 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462dd045-a559-4fb0-90e7-50935aa2630e admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:55.347654 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462dd045-a559-4fb0-90e7-50935aa2630e admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:55.348445 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e8c49-0b22-4c38-af93-e57d85ad9b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:55.348571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462dd045-a559-4fb0-90e7-50935aa2630e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:55.348571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462dd045-a559-4fb0-90e7-50935aa2630e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:55.348846 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e8c49-0b22-4c38-af93-e57d85ad9b22 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:55.349123 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e8c49-0b22-4c38-af93-e57d85ad9b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:55.349432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e8c49-0b22-4c38-af93-e57d85ad9b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:55.350073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e8c49-0b22-4c38-af93-e57d85ad9b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:55.350250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462dd045-a559-4fb0-90e7-50935aa2630e admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:55.351881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e8c49-0b22-4c38-af93-e57d85ad9b22 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:55.365244 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1086/2165] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:55.365812 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1080/2166] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:55.368104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e8c49-0b22-4c38-af93-e57d85ad9b22 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:55.369289 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462dd045-a559-4fb0-90e7-50935aa2630e admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:55.380483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e8c49-0b22-4c38-af93-e57d85ad9b22 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:55.381698 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462dd045-a559-4fb0-90e7-50935aa2630e admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:55.385473 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d495b50-445e-4c49-aa4d-e7f6bdd89e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:55.386196 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d495b50-445e-4c49-aa4d-e7f6bdd89e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:55.386473 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d495b50-445e-4c49-aa4d-e7f6bdd89e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:55.386802 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d495b50-445e-4c49-aa4d-e7f6bdd89e30 admin admin] PATH_INFO: `/v3/projects/ad52d1eacfa247cfa8e809a8be863730/users/a519d283e06f47ee9a8342eca67b5472/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:55.388377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39671b5-111c-4f60-8778-ee6af3686eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:55.389014 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39671b5-111c-4f60-8778-ee6af3686eba admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:55.389123 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39671b5-111c-4f60-8778-ee6af3686eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:55.389416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39671b5-111c-4f60-8778-ee6af3686eba admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:55.390219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39671b5-111c-4f60-8778-ee6af3686eba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:55.393736 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39671b5-111c-4f60-8778-ee6af3686eba admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:55.420828 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d495b50-445e-4c49-aa4d-e7f6bdd89e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad52d1eacfa247cfa8e809a8be863730, user_id=a519d283e06f47ee9a8342eca67b5472, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:55.429017 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:55.430258 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d495b50-445e-4c49-aa4d-e7f6bdd89e30 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:55.530258 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1087/2167] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:55 2022] PUT /identity/v3/projects/ad52d1eacfa247cfa8e809a8be863730/users/a519d283e06f47ee9a8342eca67b5472/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:55.543731 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b7b4a-6b1d-4843-8fc0-50155af03bf6 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:55.544948 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b7b4a-6b1d-4843-8fc0-50155af03bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:55.545579 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b7b4a-6b1d-4843-8fc0-50155af03bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:55.549735 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1081/2168] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:39:55 2022] POST /identity/v3/projects => generated 367 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:39:55.553022 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39671b5-111c-4f60-8778-ee6af3686eba admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:55.603826 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-2b8b7b4a-6b1d-4843-8fc0-50155af03bf6 None None] MFA Rules not processed for user `a519d283e06f47ee9a8342eca67b5472`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:55.605132 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2b8b7b4a-6b1d-4843-8fc0-50155af03bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:55.712544 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39671b5-111c-4f60-8778-ee6af3686eba admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:55.722578 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39ec38-54d3-4e40-aba2-35d3681cf552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:55.723880 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39ec38-54d3-4e40-aba2-35d3681cf552 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:55.724387 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39ec38-54d3-4e40-aba2-35d3681cf552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:55.725451 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39ec38-54d3-4e40-aba2-35d3681cf552 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:55.726581 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39ec38-54d3-4e40-aba2-35d3681cf552 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:55.729692 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39ec38-54d3-4e40-aba2-35d3681cf552 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:55.735018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1088/2169] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:55.736431 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b7b4a-6b1d-4843-8fc0-50155af03bf6 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:55.773434 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b7b4a-6b1d-4843-8fc0-50155af03bf6 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:55.779734 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b38ed-0dbb-438d-9ba7-5dc8d1707630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:55.780589 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b38ed-0dbb-438d-9ba7-5dc8d1707630 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:55.781037 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b38ed-0dbb-438d-9ba7-5dc8d1707630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:55.782650 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b38ed-0dbb-438d-9ba7-5dc8d1707630 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:55.783572 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b38ed-0dbb-438d-9ba7-5dc8d1707630 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:55.786020 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b38ed-0dbb-438d-9ba7-5dc8d1707630 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:55.838866 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1082/2170] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:39:55 2022] POST /identity/v3/users => generated 284 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:55.843675 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39ec38-54d3-4e40-aba2-35d3681cf552 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:55.884437 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39ec38-54d3-4e40-aba2-35d3681cf552 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:55.912701 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb88b62-d3f8-4752-9cdf-f0150a97d839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:55.913398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb88b62-d3f8-4752-9cdf-f0150a97d839 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:55.913533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb88b62-d3f8-4752-9cdf-f0150a97d839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:55.914058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb88b62-d3f8-4752-9cdf-f0150a97d839 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:55.915661 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb88b62-d3f8-4752-9cdf-f0150a97d839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:55.917158 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1089/2171] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:39:55 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:55.918851 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb88b62-d3f8-4752-9cdf-f0150a97d839 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:55.921607 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b38ed-0dbb-438d-9ba7-5dc8d1707630 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:55.945542 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1083/2172] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:55.946804 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb88b62-d3f8-4752-9cdf-f0150a97d839 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:55.971832 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb88b62-d3f8-4752-9cdf-f0150a97d839 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:56.108573 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b38ed-0dbb-438d-9ba7-5dc8d1707630 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:56.113468 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468fcfe-0c52-4bcf-9a74-3c5e0cfce8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:56.114131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468fcfe-0c52-4bcf-9a74-3c5e0cfce8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:56.114408 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468fcfe-0c52-4bcf-9a74-3c5e0cfce8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:56.114679 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468fcfe-0c52-4bcf-9a74-3c5e0cfce8b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:56.115412 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468fcfe-0c52-4bcf-9a74-3c5e0cfce8b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:56.121710 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468fcfe-0c52-4bcf-9a74-3c5e0cfce8b2 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:56.138453 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d6803-d359-418e-9b43-77590964dd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:56.139542 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d6803-d359-418e-9b43-77590964dd3e admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:56.140510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1084/2173] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:56.143294 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468fcfe-0c52-4bcf-9a74-3c5e0cfce8b2 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:56.143438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d6803-d359-418e-9b43-77590964dd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:56.143438 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d6803-d359-418e-9b43-77590964dd3e admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:56.144106 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d6803-d359-418e-9b43-77590964dd3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:56.146260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d6803-d359-418e-9b43-77590964dd3e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:56.165128 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468fcfe-0c52-4bcf-9a74-3c5e0cfce8b2 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:56.177013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4638d-8d64-4692-8078-74c2f56ae512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:56.177618 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4638d-8d64-4692-8078-74c2f56ae512 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:56.178905 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4638d-8d64-4692-8078-74c2f56ae512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:56.178905 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4638d-8d64-4692-8078-74c2f56ae512 admin admin] PATH_INFO: `/v3/projects/bb78c1e69d7148c39adf3bdc5e1a6d3c/users/978be2526bc646789867ff5d087ee533/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:56.199386 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4638d-8d64-4692-8078-74c2f56ae512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb78c1e69d7148c39adf3bdc5e1a6d3c, user_id=978be2526bc646789867ff5d087ee533, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:56.202513 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4638d-8d64-4692-8078-74c2f56ae512 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:56.277902 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1090/2174] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:39:55 2022] POST /identity/v3/users => generated 299 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:56.279185 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65acd3-bec8-4ae2-9c80-652fe07a94c0 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:56.279474 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65acd3-bec8-4ae2-9c80-652fe07a94c0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:56.279751 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65acd3-bec8-4ae2-9c80-652fe07a94c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:56.299404 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1085/2175] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:56 2022] PUT /identity/v3/projects/bb78c1e69d7148c39adf3bdc5e1a6d3c/users/978be2526bc646789867ff5d087ee533/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:56.300607 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4638d-8d64-4692-8078-74c2f56ae512 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:56.327846 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4b65acd3-bec8-4ae2-9c80-652fe07a94c0 None None] MFA Rules not processed for user `855a435a052640e2a214436653585d88`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:56.330384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4b65acd3-bec8-4ae2-9c80-652fe07a94c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:56.400495 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4638d-8d64-4692-8078-74c2f56ae512 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:56.410392 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd48cde-3fdc-4a90-a803-01e01e5fc0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:56.411290 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd48cde-3fdc-4a90-a803-01e01e5fc0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:56.411764 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd48cde-3fdc-4a90-a803-01e01e5fc0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:56.412225 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd48cde-3fdc-4a90-a803-01e01e5fc0a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:56.413387 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd48cde-3fdc-4a90-a803-01e01e5fc0a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:56.416758 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd48cde-3fdc-4a90-a803-01e01e5fc0a6 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:56.438271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1091/2176] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:56.440168 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca5d23-831d-4cd8-a6a8-460b945867b9 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:56.440785 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca5d23-831d-4cd8-a6a8-460b945867b9 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:56.441241 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca5d23-831d-4cd8-a6a8-460b945867b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:56.466035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1086/2177] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:56.470883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd48cde-3fdc-4a90-a803-01e01e5fc0a6 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:56.489925 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd48cde-3fdc-4a90-a803-01e01e5fc0a6 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:56.493191 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-2fca5d23-831d-4cd8-a6a8-460b945867b9 None None] MFA Rules not processed for user `978be2526bc646789867ff5d087ee533`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:56.494751 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2fca5d23-831d-4cd8-a6a8-460b945867b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:56.499659 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3f9ef-c946-408e-a208-b8a5bb45d0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:56.501408 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3f9ef-c946-408e-a208-b8a5bb45d0dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:56.501897 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3f9ef-c946-408e-a208-b8a5bb45d0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:56.502371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3f9ef-c946-408e-a208-b8a5bb45d0dc admin admin] PATH_INFO: `/v3/projects/357070cda6464c49ba341bcb72064d66/users/53d75984c4054f26989513a414f325d1/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:56.540266 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a3f9ef-c946-408e-a208-b8a5bb45d0dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=357070cda6464c49ba341bcb72064d66, user_id=53d75984c4054f26989513a414f325d1, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:56.566790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a3f9ef-c946-408e-a208-b8a5bb45d0dc admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:56.603645 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1092/2178] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:56.604666 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca5d23-831d-4cd8-a6a8-460b945867b9 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:56.606235 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2fca5d23-831d-4cd8-a6a8-460b945867b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:56.675731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1087/2179] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:56 2022] PUT /identity/v3/projects/357070cda6464c49ba341bcb72064d66/users/53d75984c4054f26989513a414f325d1/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:56.675731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3f9ef-c946-408e-a208-b8a5bb45d0dc admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:56.677392 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e1a3f9ef-c946-408e-a208-b8a5bb45d0dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:56.725117 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca5d23-831d-4cd8-a6a8-460b945867b9 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:56.814263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3f9ef-c946-408e-a208-b8a5bb45d0dc admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:56.818238 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e66617-88c6-41c7-bfd8-4cd467fc475c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78745f9dbf544ab291acfa7a063c1493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:56.818849 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e66617-88c6-41c7-bfd8-4cd467fc475c service glance] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:56.819124 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e66617-88c6-41c7-bfd8-4cd467fc475c service glance] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:56.819421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e66617-88c6-41c7-bfd8-4cd467fc475c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:56.903876 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e66617-88c6-41c7-bfd8-4cd467fc475c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:56.905339 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e66617-88c6-41c7-bfd8-4cd467fc475c service glance] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:56.916774 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb7461-c67b-4652-a97c-03547ea34853 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:56.917681 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb7461-c67b-4652-a97c-03547ea34853 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:56.918359 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb7461-c67b-4652-a97c-03547ea34853 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:56.918454 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb7461-c67b-4652-a97c-03547ea34853 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:56.924626 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-28cb7461-c67b-4652-a97c-03547ea34853 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:56.929435 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1088/2180] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:39:56.929435 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e66617-88c6-41c7-bfd8-4cd467fc475c service glance] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:57.010389 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb7461-c67b-4652-a97c-03547ea34853 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:57.012030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb7461-c67b-4652-a97c-03547ea34853 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:57.026856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1093/2181] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:39:57.033792 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:57.058423 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e66617-88c6-41c7-bfd8-4cd467fc475c service glance] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:57.066332 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae03f70-3a29-48a4-848a-f764f31a47bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:57.067008 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae03f70-3a29-48a4-848a-f764f31a47bf admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:57.067295 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae03f70-3a29-48a4-848a-f764f31a47bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:57.070713 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae03f70-3a29-48a4-848a-f764f31a47bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:57.070713 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae03f70-3a29-48a4-848a-f764f31a47bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:57.071434 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae03f70-3a29-48a4-848a-f764f31a47bf admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:57.089376 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1089/2182] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:39:57.097009 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb7461-c67b-4652-a97c-03547ea34853 service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:57.113440 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb7461-c67b-4652-a97c-03547ea34853 service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:57.118639 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc9d53-1181-4f4f-9805-e0f6e4c1ece2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:57.119455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc9d53-1181-4f4f-9805-e0f6e4c1ece2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:57.119734 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc9d53-1181-4f4f-9805-e0f6e4c1ece2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:57.120009 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc9d53-1181-4f4f-9805-e0f6e4c1ece2 admin admin] PATH_INFO: `/v3/projects/357070cda6464c49ba341bcb72064d66/users/53d75984c4054f26989513a414f325d1/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:57.125791 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc9d53-1181-4f4f-9805-e0f6e4c1ece2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=357070cda6464c49ba341bcb72064d66, user_id=53d75984c4054f26989513a414f325d1, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:57.128941 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc9d53-1181-4f4f-9805-e0f6e4c1ece2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:57.141594 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1094/2183] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:39:57 2022] PUT /identity/v3/projects/357070cda6464c49ba341bcb72064d66/users/53d75984c4054f26989513a414f325d1/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:57.159207 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b748d-7d11-4ef3-b8f3-17534480af20 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:57.160163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b748d-7d11-4ef3-b8f3-17534480af20 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:57.160163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b748d-7d11-4ef3-b8f3-17534480af20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:57.197359 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-381b748d-7d11-4ef3-b8f3-17534480af20 None None] MFA Rules not processed for user `53d75984c4054f26989513a414f325d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:57.198738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-381b748d-7d11-4ef3-b8f3-17534480af20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:57.281082 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1090/2184] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:39:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:39:57.294401 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc9d53-1181-4f4f-9805-e0f6e4c1ece2 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:57.296589 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8afc9d53-1181-4f4f-9805-e0f6e4c1ece2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:57.346949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:57.387168 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc9d53-1181-4f4f-9805-e0f6e4c1ece2 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:57.391222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38566b1a-8ad0-46ef-a99f-4f8912abaebc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:57.391830 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38566b1a-8ad0-46ef-a99f-4f8912abaebc service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:57.392108 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38566b1a-8ad0-46ef-a99f-4f8912abaebc service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:57.392376 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38566b1a-8ad0-46ef-a99f-4f8912abaebc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:57.402094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38566b1a-8ad0-46ef-a99f-4f8912abaebc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:57.404072 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38566b1a-8ad0-46ef-a99f-4f8912abaebc service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:57.414711 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1095/2185] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:57 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:39:58.346777 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:58.512574 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:58.934444 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b748d-7d11-4ef3-b8f3-17534480af20 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:58.975729 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b748d-7d11-4ef3-b8f3-17534480af20 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:58.981611 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb31a3-e1fa-4740-a9a6-5060b0a18b48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:58.983099 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb31a3-e1fa-4740-a9a6-5060b0a18b48 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:58.983597 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb31a3-e1fa-4740-a9a6-5060b0a18b48 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:58.984271 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb31a3-e1fa-4740-a9a6-5060b0a18b48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:58.986944 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-08fb31a3-e1fa-4740-a9a6-5060b0a18b48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:59.116135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb31a3-e1fa-4740-a9a6-5060b0a18b48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:59.118851 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb31a3-e1fa-4740-a9a6-5060b0a18b48 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:59.135506 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1091/2186] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:39:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:39:59.863280 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:00.932246 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:02.019746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:10.865226 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=68,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:12.230463 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:12.460883 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38566b1a-8ad0-46ef-a99f-4f8912abaebc service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:12.462413 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-38566b1a-8ad0-46ef-a99f-4f8912abaebc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:12.473578 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38566b1a-8ad0-46ef-a99f-4f8912abaebc service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:12.477537 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c786f-20c7-4927-8844-cc7c9b5b5416 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:12.478191 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c786f-20c7-4927-8844-cc7c9b5b5416 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:12.478490 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c786f-20c7-4927-8844-cc7c9b5b5416 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:12.478759 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c786f-20c7-4927-8844-cc7c9b5b5416 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:12.552168 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c786f-20c7-4927-8844-cc7c9b5b5416 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:12.553651 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c786f-20c7-4927-8844-cc7c9b5b5416 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:12.562567 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1096/2187] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:40:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:40:17.117536 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb31a3-e1fa-4740-a9a6-5060b0a18b48 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:17.216616 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb31a3-e1fa-4740-a9a6-5060b0a18b48 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:17.222110 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ee6a2-d64c-4d10-80a4-45d56b9a162d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:17.230662 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ee6a2-d64c-4d10-80a4-45d56b9a162d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:17.230662 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ee6a2-d64c-4d10-80a4-45d56b9a162d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:17.230662 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ee6a2-d64c-4d10-80a4-45d56b9a162d admin admin] PATH_INFO: `/v3/users/edf6dae8382849839114b59f6d816b6c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:17.230662 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ee6a2-d64c-4d10-80a4-45d56b9a162d admin admin] RBAC: Authorizing `identity:delete_user(user_id=edf6dae8382849839114b59f6d816b6c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:17.230662 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ee6a2-d64c-4d10-80a4-45d56b9a162d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:17.338408 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c786f-20c7-4927-8844-cc7c9b5b5416 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:17.340578 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ba3c786f-20c7-4927-8844-cc7c9b5b5416 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:17.359024 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c786f-20c7-4927-8844-cc7c9b5b5416 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:17.363721 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa2682-4bbc-49cb-87e9-93b245b340e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:17.364793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa2682-4bbc-49cb-87e9-93b245b340e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:17.365139 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa2682-4bbc-49cb-87e9-93b245b340e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:17.365486 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa2682-4bbc-49cb-87e9-93b245b340e1 admin admin] PATH_INFO: `/v3/users/ce93a993a49041d89ff13279d7503168` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:17.367163 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa2682-4bbc-49cb-87e9-93b245b340e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce93a993a49041d89ff13279d7503168)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:17.369517 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa2682-4bbc-49cb-87e9-93b245b340e1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:17.454893 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-478ee6a2-d64c-4d10-80a4-45d56b9a162d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edf6dae8382849839114b59f6d816b6c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:17.455510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-478ee6a2-d64c-4d10-80a4-45d56b9a162d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edf6dae8382849839114b59f6d816b6c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:17.469685 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-478ee6a2-d64c-4d10-80a4-45d56b9a162d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edf6dae8382849839114b59f6d816b6c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:17.470456 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-478ee6a2-d64c-4d10-80a4-45d56b9a162d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edf6dae8382849839114b59f6d816b6c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:17.573342 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-478ee6a2-d64c-4d10-80a4-45d56b9a162d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edf6dae8382849839114b59f6d816b6c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:17.576023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f9fa2682-4bbc-49cb-87e9-93b245b340e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce93a993a49041d89ff13279d7503168'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:17.576724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f9fa2682-4bbc-49cb-87e9-93b245b340e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce93a993a49041d89ff13279d7503168'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:17.577367 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f9fa2682-4bbc-49cb-87e9-93b245b340e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce93a993a49041d89ff13279d7503168'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:17.587798 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1092/2188] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:40:17 2022] DELETE /identity/v3/users/edf6dae8382849839114b59f6d816b6c => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:40:17.590195 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f9fa2682-4bbc-49cb-87e9-93b245b340e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce93a993a49041d89ff13279d7503168'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:17.592257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a3f9e-8f8c-4d60-9589-af36c20080ba None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:17.595992 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a3f9e-8f8c-4d60-9589-af36c20080ba None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:17.595992 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a3f9e-8f8c-4d60-9589-af36c20080ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:17.614435 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-767a3f9e-8f8c-4d60-9589-af36c20080ba None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:40:17.618949 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-767a3f9e-8f8c-4d60-9589-af36c20080ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:17.658955 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f9fa2682-4bbc-49cb-87e9-93b245b340e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce93a993a49041d89ff13279d7503168'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:17.676884 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1097/2189] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:40:17 2022] DELETE /identity/v3/users/ce93a993a49041d89ff13279d7503168 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:40:17.684291 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1093/2190] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:40:17.694943 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa2682-4bbc-49cb-87e9-93b245b340e1 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:17.697128 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f9fa2682-4bbc-49cb-87e9-93b245b340e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:17.762475 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa2682-4bbc-49cb-87e9-93b245b340e1 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:17.766117 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bcfe7f-b5e6-4bd5-9c1c-994191d0281f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:17.766868 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bcfe7f-b5e6-4bd5-9c1c-994191d0281f service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:17.766992 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bcfe7f-b5e6-4bd5-9c1c-994191d0281f service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:17.767272 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bcfe7f-b5e6-4bd5-9c1c-994191d0281f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:17.801820 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:17.841819 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bcfe7f-b5e6-4bd5-9c1c-994191d0281f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:17.843316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bcfe7f-b5e6-4bd5-9c1c-994191d0281f service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:17.856945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1098/2191] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:40:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:40:17.936386 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a3f9e-8f8c-4d60-9589-af36c20080ba None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:17.937957 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-767a3f9e-8f8c-4d60-9589-af36c20080ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:17.953520 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a3f9e-8f8c-4d60-9589-af36c20080ba None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:17.960426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ed882-4845-41fe-a8aa-e3972a440ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:17.961184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ed882-4845-41fe-a8aa-e3972a440ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:17.961474 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ed882-4845-41fe-a8aa-e3972a440ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:17.961773 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ed882-4845-41fe-a8aa-e3972a440ac6 admin admin] PATH_INFO: `/v3/projects/e7c0bba1348f403295047c76ab8e5de0` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:17.962960 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ed882-4845-41fe-a8aa-e3972a440ac6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7c0bba1348f403295047c76ab8e5de0)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:17.964900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ed882-4845-41fe-a8aa-e3972a440ac6 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:17.985554 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:18.084088 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a31ed882-4845-41fe-a8aa-e3972a440ac6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7c0bba1348f403295047c76ab8e5de0', 'request_id': 'req-a31ed882-4845-41fe-a8aa-e3972a440ac6'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:18.182166 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a31ed882-4845-41fe-a8aa-e3972a440ac6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7c0bba1348f403295047c76ab8e5de0', 'request_id': 'req-a31ed882-4845-41fe-a8aa-e3972a440ac6'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:18.189478 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a31ed882-4845-41fe-a8aa-e3972a440ac6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7c0bba1348f403295047c76ab8e5de0', 'request_id': 'req-a31ed882-4845-41fe-a8aa-e3972a440ac6'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:18.200735 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a31ed882-4845-41fe-a8aa-e3972a440ac6 admin admin] The token cache is being invalidate because project e7c0bba1348f403295047c76ab8e5de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:40:18.201002 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a31ed882-4845-41fe-a8aa-e3972a440ac6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:18.201711 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a31ed882-4845-41fe-a8aa-e3972a440ac6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:18.203274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1094/2192] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:40:17 2022] DELETE /identity/v3/projects/e7c0bba1348f403295047c76ab8e5de0 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:40:18.207353 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bcfe7f-b5e6-4bd5-9c1c-994191d0281f service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:18.220602 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bcfe7f-b5e6-4bd5-9c1c-994191d0281f service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:18.291864 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817918e-b597-4c95-94e0-fe55663a77b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:18.292511 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817918e-b597-4c95-94e0-fe55663a77b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:18.292797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817918e-b597-4c95-94e0-fe55663a77b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:18.293052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ed882-4845-41fe-a8aa-e3972a440ac6 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:18.293165 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817918e-b597-4c95-94e0-fe55663a77b2 admin admin] PATH_INFO: `/v3/users/4cd25eba0a1549abbd2e8135ac537ba9` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:18.294378 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817918e-b597-4c95-94e0-fe55663a77b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cd25eba0a1549abbd2e8135ac537ba9)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:18.295201 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a31ed882-4845-41fe-a8aa-e3972a440ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:18.296401 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817918e-b597-4c95-94e0-fe55663a77b2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:18.312029 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ed882-4845-41fe-a8aa-e3972a440ac6 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:18.332969 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30af13-06d9-4cda-91bd-d9df7d624a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:18.333844 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30af13-06d9-4cda-91bd-d9df7d624a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:18.334216 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30af13-06d9-4cda-91bd-d9df7d624a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:18.334620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30af13-06d9-4cda-91bd-d9df7d624a11 admin admin] PATH_INFO: `/v3/projects/bd132c76a971463d9cb7c38ee97c122b` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:18.336194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30af13-06d9-4cda-91bd-d9df7d624a11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd132c76a971463d9cb7c38ee97c122b)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:18.338970 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30af13-06d9-4cda-91bd-d9df7d624a11 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:18.501722 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-6c30af13-06d9-4cda-91bd-d9df7d624a11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd132c76a971463d9cb7c38ee97c122b', 'request_id': 'req-6c30af13-06d9-4cda-91bd-d9df7d624a11'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:18.506320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-1817918e-b597-4c95-94e0-fe55663a77b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cd25eba0a1549abbd2e8135ac537ba9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:18.507212 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-1817918e-b597-4c95-94e0-fe55663a77b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cd25eba0a1549abbd2e8135ac537ba9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:18.507827 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-1817918e-b597-4c95-94e0-fe55663a77b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cd25eba0a1549abbd2e8135ac537ba9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:18.521042 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-1817918e-b597-4c95-94e0-fe55663a77b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cd25eba0a1549abbd2e8135ac537ba9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:18.583388 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-6c30af13-06d9-4cda-91bd-d9df7d624a11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd132c76a971463d9cb7c38ee97c122b', 'request_id': 'req-6c30af13-06d9-4cda-91bd-d9df7d624a11'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:18.590679 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-6c30af13-06d9-4cda-91bd-d9df7d624a11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd132c76a971463d9cb7c38ee97c122b', 'request_id': 'req-6c30af13-06d9-4cda-91bd-d9df7d624a11'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:18.602594 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-6c30af13-06d9-4cda-91bd-d9df7d624a11 admin admin] The token cache is being invalidate because project bd132c76a971463d9cb7c38ee97c122b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:40:18.602904 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-6c30af13-06d9-4cda-91bd-d9df7d624a11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:18.603587 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-6c30af13-06d9-4cda-91bd-d9df7d624a11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:18.605365 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1095/2193] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:40:18 2022] DELETE /identity/v3/projects/bd132c76a971463d9cb7c38ee97c122b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:40:18.609263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30af13-06d9-4cda-91bd-d9df7d624a11 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:18.610674 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6c30af13-06d9-4cda-91bd-d9df7d624a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:18.656806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-1817918e-b597-4c95-94e0-fe55663a77b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cd25eba0a1549abbd2e8135ac537ba9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:18.670099 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1099/2194] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:40:18 2022] DELETE /identity/v3/users/4cd25eba0a1549abbd2e8135ac537ba9 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:40:18.679824 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30af13-06d9-4cda-91bd-d9df7d624a11 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:18.740251 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ba56a-747a-4982-9127-d37067f519ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:18.740893 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ba56a-747a-4982-9127-d37067f519ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:18.741170 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ba56a-747a-4982-9127-d37067f519ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:18.741452 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ba56a-747a-4982-9127-d37067f519ed admin admin] PATH_INFO: `/v3/users/a519d283e06f47ee9a8342eca67b5472` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:18.742652 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ba56a-747a-4982-9127-d37067f519ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=a519d283e06f47ee9a8342eca67b5472)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:18.744957 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ba56a-747a-4982-9127-d37067f519ed admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:18.777191 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:18.937618 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817918e-b597-4c95-94e0-fe55663a77b2 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:18.939560 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-893ba56a-747a-4982-9127-d37067f519ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a519d283e06f47ee9a8342eca67b5472'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:18.940136 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1817918e-b597-4c95-94e0-fe55663a77b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:18.940557 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-893ba56a-747a-4982-9127-d37067f519ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a519d283e06f47ee9a8342eca67b5472'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:18.964884 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-893ba56a-747a-4982-9127-d37067f519ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a519d283e06f47ee9a8342eca67b5472'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:18.965785 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-893ba56a-747a-4982-9127-d37067f519ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a519d283e06f47ee9a8342eca67b5472'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:18.983000 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817918e-b597-4c95-94e0-fe55663a77b2 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:18.988201 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e9e17-cb45-4520-9efb-87192b7184e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:18.989504 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e9e17-cb45-4520-9efb-87192b7184e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:18.989811 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e9e17-cb45-4520-9efb-87192b7184e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:18.990087 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e9e17-cb45-4520-9efb-87192b7184e4 admin admin] PATH_INFO: `/v3/projects/008fe20b770d4afcbc2bf8cce1e56343` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:18.991309 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e9e17-cb45-4520-9efb-87192b7184e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=008fe20b770d4afcbc2bf8cce1e56343)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:18.993337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e9e17-cb45-4520-9efb-87192b7184e4 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:19.027838 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-893ba56a-747a-4982-9127-d37067f519ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a519d283e06f47ee9a8342eca67b5472'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:19.041561 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1096/2195] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:40:18 2022] DELETE /identity/v3/users/a519d283e06f47ee9a8342eca67b5472 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:40:19.069294 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:19.079430 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e42e9e17-cb45-4520-9efb-87192b7184e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '008fe20b770d4afcbc2bf8cce1e56343', 'request_id': 'req-e42e9e17-cb45-4520-9efb-87192b7184e4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:19.144804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e42e9e17-cb45-4520-9efb-87192b7184e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '008fe20b770d4afcbc2bf8cce1e56343', 'request_id': 'req-e42e9e17-cb45-4520-9efb-87192b7184e4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:19.151806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e42e9e17-cb45-4520-9efb-87192b7184e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '008fe20b770d4afcbc2bf8cce1e56343', 'request_id': 'req-e42e9e17-cb45-4520-9efb-87192b7184e4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:19.163276 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e42e9e17-cb45-4520-9efb-87192b7184e4 admin admin] The token cache is being invalidate because project 008fe20b770d4afcbc2bf8cce1e56343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:40:19.163571 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e42e9e17-cb45-4520-9efb-87192b7184e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:19.164234 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e42e9e17-cb45-4520-9efb-87192b7184e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:19.165729 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1100/2196] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:40:18 2022] DELETE /identity/v3/projects/008fe20b770d4afcbc2bf8cce1e56343 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:40:19.170900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d19e7d-e3e4-4808-904b-807eba8baa80 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:19.171186 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d19e7d-e3e4-4808-904b-807eba8baa80 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:19.171547 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d19e7d-e3e4-4808-904b-807eba8baa80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:19.191934 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-92d19e7d-e3e4-4808-904b-807eba8baa80 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:40:19.193098 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-92d19e7d-e3e4-4808-904b-807eba8baa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:19.266244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1097/2197] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:40:19.275121 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef5098-5f60-4b41-9a2b-5565bdf4fc07 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:19.282568 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef5098-5f60-4b41-9a2b-5565bdf4fc07 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:19.282568 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef5098-5f60-4b41-9a2b-5565bdf4fc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:19.305429 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f3ef5098-5f60-4b41-9a2b-5565bdf4fc07 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:40:19.307481 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f3ef5098-5f60-4b41-9a2b-5565bdf4fc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:19.325179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1101/2198] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:40:19.329997 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d19e7d-e3e4-4808-904b-807eba8baa80 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:19.351825 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d19e7d-e3e4-4808-904b-807eba8baa80 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:19.357634 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd0d72-1cfb-4859-948c-bf79123bfedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:19.358443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd0d72-1cfb-4859-948c-bf79123bfedc admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:19.358721 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd0d72-1cfb-4859-948c-bf79123bfedc admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:19.359192 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd0d72-1cfb-4859-948c-bf79123bfedc admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:19.359857 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd0d72-1cfb-4859-948c-bf79123bfedc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:40:19.360259 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd0d72-1cfb-4859-948c-bf79123bfedc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:19.361787 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd0d72-1cfb-4859-948c-bf79123bfedc admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:19.378163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1098/2199] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:40:19.382719 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef5098-5f60-4b41-9a2b-5565bdf4fc07 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:19.397150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef5098-5f60-4b41-9a2b-5565bdf4fc07 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:19.402303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187762b0-5970-490c-a437-38a892c86c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:19.402990 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187762b0-5970-490c-a437-38a892c86c9f admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:19.403276 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187762b0-5970-490c-a437-38a892c86c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:19.403542 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187762b0-5970-490c-a437-38a892c86c9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:19.404225 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187762b0-5970-490c-a437-38a892c86c9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:19.406175 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187762b0-5970-490c-a437-38a892c86c9f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:19.503870 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd0d72-1cfb-4859-948c-bf79123bfedc admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:19.505071 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3fbd0d72-1cfb-4859-948c-bf79123bfedc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:19.518972 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd0d72-1cfb-4859-948c-bf79123bfedc admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:19.525590 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345d544-e19a-4677-8303-20a3ad2c717a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:19.526531 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345d544-e19a-4677-8303-20a3ad2c717a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:19.526923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345d544-e19a-4677-8303-20a3ad2c717a admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:19.527298 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345d544-e19a-4677-8303-20a3ad2c717a admin admin] PATH_INFO: `/v3/projects/ad52d1eacfa247cfa8e809a8be863730` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:19.529034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b345d544-e19a-4677-8303-20a3ad2c717a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad52d1eacfa247cfa8e809a8be863730)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:19.531684 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b345d544-e19a-4677-8303-20a3ad2c717a admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:19.531962 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1102/2200] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:40:19 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:40:19.536791 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187762b0-5970-490c-a437-38a892c86c9f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:19.609268 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187762b0-5970-490c-a437-38a892c86c9f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:19.614430 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e65234-d9a3-459c-bfae-48521029e259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:19.615059 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e65234-d9a3-459c-bfae-48521029e259 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:19.615346 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e65234-d9a3-459c-bfae-48521029e259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:19.615628 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e65234-d9a3-459c-bfae-48521029e259 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:19.616286 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e65234-d9a3-459c-bfae-48521029e259 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:19.618328 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e65234-d9a3-459c-bfae-48521029e259 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:19.643728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:19.654051 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b345d544-e19a-4677-8303-20a3ad2c717a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad52d1eacfa247cfa8e809a8be863730', 'request_id': 'req-b345d544-e19a-4677-8303-20a3ad2c717a'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:19.727603 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1103/2201] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:40:19 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:40:19.729000 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e65234-d9a3-459c-bfae-48521029e259 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:19.740767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e65234-d9a3-459c-bfae-48521029e259 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:19.754767 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b345d544-e19a-4677-8303-20a3ad2c717a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad52d1eacfa247cfa8e809a8be863730', 'request_id': 'req-b345d544-e19a-4677-8303-20a3ad2c717a'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:19.762399 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b345d544-e19a-4677-8303-20a3ad2c717a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad52d1eacfa247cfa8e809a8be863730', 'request_id': 'req-b345d544-e19a-4677-8303-20a3ad2c717a'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:19.774932 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b345d544-e19a-4677-8303-20a3ad2c717a admin admin] The token cache is being invalidate because project ad52d1eacfa247cfa8e809a8be863730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:40:19.775458 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b345d544-e19a-4677-8303-20a3ad2c717a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:19.776175 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b345d544-e19a-4677-8303-20a3ad2c717a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:19.777706 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1099/2202] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:40:19 2022] DELETE /identity/v3/projects/ad52d1eacfa247cfa8e809a8be863730 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:40:19.782374 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345d544-e19a-4677-8303-20a3ad2c717a admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:19.783813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b345d544-e19a-4677-8303-20a3ad2c717a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:19.819177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa276a-e521-4f5a-923c-b3f8e37c0039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:19.819937 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa276a-e521-4f5a-923c-b3f8e37c0039 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:19.820228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa276a-e521-4f5a-923c-b3f8e37c0039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:19.820517 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa276a-e521-4f5a-923c-b3f8e37c0039 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:19.821509 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa276a-e521-4f5a-923c-b3f8e37c0039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:19.823104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa276a-e521-4f5a-923c-b3f8e37c0039 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:19.834963 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1104/2203] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:40:19.838914 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa276a-e521-4f5a-923c-b3f8e37c0039 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:19.840731 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c4aa276a-e521-4f5a-923c-b3f8e37c0039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:19.854477 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa276a-e521-4f5a-923c-b3f8e37c0039 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:19.857333 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345d544-e19a-4677-8303-20a3ad2c717a admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:19.859575 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab026663-5a82-4487-a218-64d7617e9d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:19.860172 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab026663-5a82-4487-a218-64d7617e9d21 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:19.860486 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab026663-5a82-4487-a218-64d7617e9d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:19.860810 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab026663-5a82-4487-a218-64d7617e9d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:19.861455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab026663-5a82-4487-a218-64d7617e9d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:19.862066 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c5634-f826-4b1f-88b2-f5b6dea38795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:19.862680 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c5634-f826-4b1f-88b2-f5b6dea38795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:19.862960 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c5634-f826-4b1f-88b2-f5b6dea38795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:19.863113 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab026663-5a82-4487-a218-64d7617e9d21 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:19.863250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c5634-f826-4b1f-88b2-f5b6dea38795 admin admin] PATH_INFO: `/v3/users/53d75984c4054f26989513a414f325d1` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:19.864455 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c5634-f826-4b1f-88b2-f5b6dea38795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53d75984c4054f26989513a414f325d1)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:19.866421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c5634-f826-4b1f-88b2-f5b6dea38795 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:19.874717 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1105/2204] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:40:19.878999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab026663-5a82-4487-a218-64d7617e9d21 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:19.889855 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab026663-5a82-4487-a218-64d7617e9d21 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:19.894759 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5710321-6bf9-4b6e-a50c-67fbea975b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:19.895931 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5710321-6bf9-4b6e-a50c-67fbea975b02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:19.896224 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5710321-6bf9-4b6e-a50c-67fbea975b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:19.896514 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5710321-6bf9-4b6e-a50c-67fbea975b02 admin admin] PATH_INFO: `/v3/projects/f12aa76e7e854debb15603d7d306c042/users/c217d37c81934813a7f7ebfc861f3540/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:19.899652 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:19.911222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5710321-6bf9-4b6e-a50c-67fbea975b02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f12aa76e7e854debb15603d7d306c042, user_id=c217d37c81934813a7f7ebfc861f3540, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:19.914128 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5710321-6bf9-4b6e-a50c-67fbea975b02 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:20.013289 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1106/2205] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:40:19 2022] PUT /identity/v3/projects/f12aa76e7e854debb15603d7d306c042/users/c217d37c81934813a7f7ebfc861f3540/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:40:20.024457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bd65c-1aeb-4d8f-995c-bad3f11a7efb None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:20.024742 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bd65c-1aeb-4d8f-995c-bad3f11a7efb None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:20.025018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bd65c-1aeb-4d8f-995c-bad3f11a7efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:20.053437 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-3a0bd65c-1aeb-4d8f-995c-bad3f11a7efb None None] MFA Rules not processed for user `c217d37c81934813a7f7ebfc861f3540`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:40:20.054772 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3a0bd65c-1aeb-4d8f-995c-bad3f11a7efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:20.079699 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a48c5634-f826-4b1f-88b2-f5b6dea38795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53d75984c4054f26989513a414f325d1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:20.080348 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a48c5634-f826-4b1f-88b2-f5b6dea38795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53d75984c4054f26989513a414f325d1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:20.093926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a48c5634-f826-4b1f-88b2-f5b6dea38795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53d75984c4054f26989513a414f325d1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:20.094612 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a48c5634-f826-4b1f-88b2-f5b6dea38795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53d75984c4054f26989513a414f325d1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:20.125622 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1107/2206] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:40:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:40:20.153287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a48c5634-f826-4b1f-88b2-f5b6dea38795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53d75984c4054f26989513a414f325d1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:20.172001 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1100/2207] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:40:19 2022] DELETE /identity/v3/users/53d75984c4054f26989513a414f325d1 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:40:20.652655 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0bd65c-1aeb-4d8f-995c-bad3f11a7efb None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:20.654247 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3a0bd65c-1aeb-4d8f-995c-bad3f11a7efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:20.731406 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0bd65c-1aeb-4d8f-995c-bad3f11a7efb None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:20.790920 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e5170-aeb2-4b6e-8085-1450ef3c7f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:20.791623 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e5170-aeb2-4b6e-8085-1450ef3c7f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:20.791897 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e5170-aeb2-4b6e-8085-1450ef3c7f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:20.792171 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e5170-aeb2-4b6e-8085-1450ef3c7f86 admin admin] PATH_INFO: `/v3/projects/357070cda6464c49ba341bcb72064d66` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:20.793316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e5170-aeb2-4b6e-8085-1450ef3c7f86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=357070cda6464c49ba341bcb72064d66)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:20.795276 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e5170-aeb2-4b6e-8085-1450ef3c7f86 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:20.822802 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:20.947077 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d82e5170-aeb2-4b6e-8085-1450ef3c7f86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '357070cda6464c49ba341bcb72064d66', 'request_id': 'req-d82e5170-aeb2-4b6e-8085-1450ef3c7f86'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:21.037486 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d82e5170-aeb2-4b6e-8085-1450ef3c7f86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '357070cda6464c49ba341bcb72064d66', 'request_id': 'req-d82e5170-aeb2-4b6e-8085-1450ef3c7f86'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:21.045372 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d82e5170-aeb2-4b6e-8085-1450ef3c7f86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '357070cda6464c49ba341bcb72064d66', 'request_id': 'req-d82e5170-aeb2-4b6e-8085-1450ef3c7f86'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:21.056460 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d82e5170-aeb2-4b6e-8085-1450ef3c7f86 admin admin] The token cache is being invalidate because project 357070cda6464c49ba341bcb72064d66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:40:21.056745 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d82e5170-aeb2-4b6e-8085-1450ef3c7f86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:21.057406 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d82e5170-aeb2-4b6e-8085-1450ef3c7f86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:21.058960 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1108/2208] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:40:20 2022] DELETE /identity/v3/projects/357070cda6464c49ba341bcb72064d66 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:40:21.064945 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879943e-5254-48a9-9635-df94e89d6b1d None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:21.065441 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879943e-5254-48a9-9635-df94e89d6b1d None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:21.065521 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879943e-5254-48a9-9635-df94e89d6b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:21.085873 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-d879943e-5254-48a9-9635-df94e89d6b1d None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:40:21.087094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d879943e-5254-48a9-9635-df94e89d6b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:21.126825 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:21.149441 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1101/2209] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:40:21.159321 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6146e-0ee4-4863-b19a-003c3f84e7b2 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:21.159605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6146e-0ee4-4863-b19a-003c3f84e7b2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:21.159882 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6146e-0ee4-4863-b19a-003c3f84e7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:21.181023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-99b6146e-0ee4-4863-b19a-003c3f84e7b2 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:40:21.182270 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-99b6146e-0ee4-4863-b19a-003c3f84e7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:21.191647 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1109/2210] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:40:21.196468 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879943e-5254-48a9-9635-df94e89d6b1d None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:21.206500 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879943e-5254-48a9-9635-df94e89d6b1d None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:21.212152 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8d8d6-cc92-4ad6-8c76-95f3b311e233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:21.212778 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8d8d6-cc92-4ad6-8c76-95f3b311e233 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:21.213458 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8d8d6-cc92-4ad6-8c76-95f3b311e233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:21.214090 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8d8d6-cc92-4ad6-8c76-95f3b311e233 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:21.214977 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae8d8d6-cc92-4ad6-8c76-95f3b311e233 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:40:21.215829 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae8d8d6-cc92-4ad6-8c76-95f3b311e233 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:21.217678 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae8d8d6-cc92-4ad6-8c76-95f3b311e233 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:21.230566 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1102/2211] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:40:21.235706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6146e-0ee4-4863-b19a-003c3f84e7b2 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:21.246254 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6146e-0ee4-4863-b19a-003c3f84e7b2 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:21.250935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611596e2-c756-4ff6-8759-20d652c1e1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:21.251539 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611596e2-c756-4ff6-8759-20d652c1e1b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:21.251817 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611596e2-c756-4ff6-8759-20d652c1e1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:21.252087 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611596e2-c756-4ff6-8759-20d652c1e1b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:21.252711 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611596e2-c756-4ff6-8759-20d652c1e1b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:21.254868 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611596e2-c756-4ff6-8759-20d652c1e1b9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:21.350156 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1110/2212] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:40:21 2022] POST /identity/v3/projects => generated 391 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:40:21.354728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8d8d6-cc92-4ad6-8c76-95f3b311e233 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:21.365586 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8d8d6-cc92-4ad6-8c76-95f3b311e233 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:21.386571 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611596e2-c756-4ff6-8759-20d652c1e1b9 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:21.389439 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-611596e2-c756-4ff6-8759-20d652c1e1b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:21.439490 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaad1a-3f7e-4e3f-bf79-7c9a752eac2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:21.440245 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaad1a-3f7e-4e3f-bf79-7c9a752eac2c admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:21.440525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaad1a-3f7e-4e3f-bf79-7c9a752eac2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:21.440795 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaad1a-3f7e-4e3f-bf79-7c9a752eac2c admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:21.441455 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaaad1a-3f7e-4e3f-bf79-7c9a752eac2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:21.444429 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaaad1a-3f7e-4e3f-bf79-7c9a752eac2c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:21.470729 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611596e2-c756-4ff6-8759-20d652c1e1b9 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:21.476423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b866d8-1799-4845-b3f9-96e2b9ca74cd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78745f9dbf544ab291acfa7a063c1493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:21.477094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b866d8-1799-4845-b3f9-96e2b9ca74cd service glance] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:21.483353 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b866d8-1799-4845-b3f9-96e2b9ca74cd service glance] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:21.483353 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b866d8-1799-4845-b3f9-96e2b9ca74cd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:21.483353 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-21b866d8-1799-4845-b3f9-96e2b9ca74cd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:21.540637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1103/2213] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:40:21 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:40:21.541957 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaad1a-3f7e-4e3f-bf79-7c9a752eac2c admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:21.545091 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b866d8-1799-4845-b3f9-96e2b9ca74cd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:21.546659 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b866d8-1799-4845-b3f9-96e2b9ca74cd service glance] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:21.552185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaad1a-3f7e-4e3f-bf79-7c9a752eac2c admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:21.556937 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1111/2214] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:40:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:40:21.560459 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c455b70-0f96-46b5-9af6-bdeede53f4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:21.561067 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c455b70-0f96-46b5-9af6-bdeede53f4be admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:21.561342 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c455b70-0f96-46b5-9af6-bdeede53f4be admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:21.561611 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c455b70-0f96-46b5-9af6-bdeede53f4be admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:21.562293 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c455b70-0f96-46b5-9af6-bdeede53f4be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:21.563886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c455b70-0f96-46b5-9af6-bdeede53f4be admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:21.576789 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1104/2215] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:40:21.583552 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b866d8-1799-4845-b3f9-96e2b9ca74cd service glance] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:21.596522 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b866d8-1799-4845-b3f9-96e2b9ca74cd service glance] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:21.605223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a74e2f-99cb-4a27-b3bd-e5de02421d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:21.605979 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a74e2f-99cb-4a27-b3bd-e5de02421d77 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:21.606256 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a74e2f-99cb-4a27-b3bd-e5de02421d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:21.606551 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a74e2f-99cb-4a27-b3bd-e5de02421d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:21.607393 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a74e2f-99cb-4a27-b3bd-e5de02421d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:21.608985 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a74e2f-99cb-4a27-b3bd-e5de02421d77 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:21.621824 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1112/2216] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:40:21.625099 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c455b70-0f96-46b5-9af6-bdeede53f4be admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:21.637696 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c455b70-0f96-46b5-9af6-bdeede53f4be admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:21.642742 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db47542-a5f0-44dd-b0ac-b086854f50f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:21.643395 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db47542-a5f0-44dd-b0ac-b086854f50f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:21.643674 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db47542-a5f0-44dd-b0ac-b086854f50f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:21.643948 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db47542-a5f0-44dd-b0ac-b086854f50f7 admin admin] PATH_INFO: `/v3/projects/84257274f40345ac814045bbd17c9a91/users/8f1f40abddac405488fac1efd8c8da99/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:21.664479 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db47542-a5f0-44dd-b0ac-b086854f50f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84257274f40345ac814045bbd17c9a91, user_id=8f1f40abddac405488fac1efd8c8da99, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:21.667226 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db47542-a5f0-44dd-b0ac-b086854f50f7 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:21.761194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1105/2217] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:40:21 2022] PUT /identity/v3/projects/84257274f40345ac814045bbd17c9a91/users/8f1f40abddac405488fac1efd8c8da99/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:40:21.772921 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b9943-1638-42c6-8898-b093ab1dd2a3 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:21.773413 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b9943-1638-42c6-8898-b093ab1dd2a3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:21.773534 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b9943-1638-42c6-8898-b093ab1dd2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:21.803745 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-df3b9943-1638-42c6-8898-b093ab1dd2a3 None None] MFA Rules not processed for user `8f1f40abddac405488fac1efd8c8da99`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:40:21.804979 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-df3b9943-1638-42c6-8898-b093ab1dd2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:21.826144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:21.890843 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1113/2218] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:40:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:40:21.893184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db47542-a5f0-44dd-b0ac-b086854f50f7 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:21.961782 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db47542-a5f0-44dd-b0ac-b086854f50f7 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:21.967135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5771c0b-4f31-4067-a752-63e3b3e2f848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:21.967749 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5771c0b-4f31-4067-a752-63e3b3e2f848 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:21.968194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5771c0b-4f31-4067-a752-63e3b3e2f848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:21.968482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5771c0b-4f31-4067-a752-63e3b3e2f848 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:21.969111 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5771c0b-4f31-4067-a752-63e3b3e2f848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:21.972548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5771c0b-4f31-4067-a752-63e3b3e2f848 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:22.057799 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1106/2219] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:40:21 2022] POST /identity/v3/projects => generated 393 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:40:22.059511 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b9943-1638-42c6-8898-b093ab1dd2a3 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:22.072830 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b9943-1638-42c6-8898-b093ab1dd2a3 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:22.138083 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d2119-d827-4e53-8ade-7674a95bbb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:22.138695 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d2119-d827-4e53-8ade-7674a95bbb62 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:22.138974 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d2119-d827-4e53-8ade-7674a95bbb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:22.139423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d2119-d827-4e53-8ade-7674a95bbb62 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:22.139932 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d2119-d827-4e53-8ade-7674a95bbb62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:22.141950 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d2119-d827-4e53-8ade-7674a95bbb62 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:22.254891 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1114/2220] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:40:22 2022] POST /identity/v3/users => generated 303 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:40:22.259254 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5771c0b-4f31-4067-a752-63e3b3e2f848 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:22.270919 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5771c0b-4f31-4067-a752-63e3b3e2f848 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:22.275910 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ade12-f719-429c-9936-e6deb47a1eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:22.276548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ade12-f719-429c-9936-e6deb47a1eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:22.276829 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ade12-f719-429c-9936-e6deb47a1eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:22.277129 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ade12-f719-429c-9936-e6deb47a1eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:22.277846 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ade12-f719-429c-9936-e6deb47a1eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:22.279452 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ade12-f719-429c-9936-e6deb47a1eb0 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:22.281711 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:22.290964 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1107/2221] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:40:22.295266 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d2119-d827-4e53-8ade-7674a95bbb62 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:22.306964 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d2119-d827-4e53-8ade-7674a95bbb62 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:22.311684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5695b5b-d146-4dd2-b17e-01f57ab2619d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:22.312446 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5695b5b-d146-4dd2-b17e-01f57ab2619d admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:22.312678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5695b5b-d146-4dd2-b17e-01f57ab2619d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:22.312955 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5695b5b-d146-4dd2-b17e-01f57ab2619d admin admin] PATH_INFO: `/v3/projects/edc7d62f174f4652af29c0d84925cfb7/users/67eeb05348c34252b47788f427156076/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:22.329346 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5695b5b-d146-4dd2-b17e-01f57ab2619d admin admin] RBAC: Authorizing `identity:create_grant(project_id=edc7d62f174f4652af29c0d84925cfb7, user_id=67eeb05348c34252b47788f427156076, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:22.333330 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5695b5b-d146-4dd2-b17e-01f57ab2619d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:22.429019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1115/2222] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:40:22 2022] PUT /identity/v3/projects/edc7d62f174f4652af29c0d84925cfb7/users/67eeb05348c34252b47788f427156076/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:40:22.433023 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ade12-f719-429c-9936-e6deb47a1eb0 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:22.443393 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ade12-f719-429c-9936-e6deb47a1eb0 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:22.539351 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ea29a-77e9-4ecd-8f83-cc38d4b41029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:22.539982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ea29a-77e9-4ecd-8f83-cc38d4b41029 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:22.540255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ea29a-77e9-4ecd-8f83-cc38d4b41029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:22.540591 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ea29a-77e9-4ecd-8f83-cc38d4b41029 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:22.541249 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ea29a-77e9-4ecd-8f83-cc38d4b41029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:22.542882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ea29a-77e9-4ecd-8f83-cc38d4b41029 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:22.554255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1108/2223] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:40:22.559225 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5695b5b-d146-4dd2-b17e-01f57ab2619d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:22.575647 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5695b5b-d146-4dd2-b17e-01f57ab2619d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:22.580340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1173f9-b36c-4ced-b27e-cfb0242336f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:22.581144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1173f9-b36c-4ced-b27e-cfb0242336f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:22.581423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1173f9-b36c-4ced-b27e-cfb0242336f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:22.582692 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1173f9-b36c-4ced-b27e-cfb0242336f2 admin admin] PATH_INFO: `/v3/projects/edc7d62f174f4652af29c0d84925cfb7/users/67eeb05348c34252b47788f427156076/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:22.584982 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1173f9-b36c-4ced-b27e-cfb0242336f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edc7d62f174f4652af29c0d84925cfb7, user_id=67eeb05348c34252b47788f427156076, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:22.588029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1173f9-b36c-4ced-b27e-cfb0242336f2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:22.600641 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1116/2224] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:40:22 2022] PUT /identity/v3/projects/edc7d62f174f4652af29c0d84925cfb7/users/67eeb05348c34252b47788f427156076/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:40:22.611350 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1404d9-7ba4-4737-98dd-7181b8372fab None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:22.611666 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1404d9-7ba4-4737-98dd-7181b8372fab None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:22.611942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1404d9-7ba4-4737-98dd-7181b8372fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:22.641283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-bb1404d9-7ba4-4737-98dd-7181b8372fab None None] MFA Rules not processed for user `67eeb05348c34252b47788f427156076`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:40:22.642529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-bb1404d9-7ba4-4737-98dd-7181b8372fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:22.722702 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1109/2225] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:40:22 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:40:22.735903 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1173f9-b36c-4ced-b27e-cfb0242336f2 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:22.737616 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-bd1173f9-b36c-4ced-b27e-cfb0242336f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:22.795985 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1173f9-b36c-4ced-b27e-cfb0242336f2 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:22.799683 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217fec6-f1d6-4f52-aae8-2191ec7ef826 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:22.800285 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217fec6-f1d6-4f52-aae8-2191ec7ef826 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:22.800566 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217fec6-f1d6-4f52-aae8-2191ec7ef826 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:22.800840 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217fec6-f1d6-4f52-aae8-2191ec7ef826 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:22.810567 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217fec6-f1d6-4f52-aae8-2191ec7ef826 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:22.812055 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217fec6-f1d6-4f52-aae8-2191ec7ef826 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:22.822697 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1117/2226] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:40:22 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:40:22.869993 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1404d9-7ba4-4737-98dd-7181b8372fab None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:22.871382 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-bb1404d9-7ba4-4737-98dd-7181b8372fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:22.885273 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1404d9-7ba4-4737-98dd-7181b8372fab None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:22.888996 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc944c7-be20-4bbd-b5c6-4415dc2bfbd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:22.889588 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc944c7-be20-4bbd-b5c6-4415dc2bfbd1 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:22.889900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc944c7-be20-4bbd-b5c6-4415dc2bfbd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:22.890177 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc944c7-be20-4bbd-b5c6-4415dc2bfbd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:22.951898 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc944c7-be20-4bbd-b5c6-4415dc2bfbd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:22.953327 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc944c7-be20-4bbd-b5c6-4415dc2bfbd1 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:22.962912 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1110/2227] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:40:22 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:40:28.749281 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217fec6-f1d6-4f52-aae8-2191ec7ef826 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:28.762672 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:28.818443 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217fec6-f1d6-4f52-aae8-2191ec7ef826 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:28.826280 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a75a18-59c7-4b71-bed2-90c080514e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:28.827162 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a75a18-59c7-4b71-bed2-90c080514e2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:28.827482 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a75a18-59c7-4b71-bed2-90c080514e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:28.827815 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a75a18-59c7-4b71-bed2-90c080514e2a admin admin] PATH_INFO: `/v3/users/8f1f40abddac405488fac1efd8c8da99` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:28.829460 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a75a18-59c7-4b71-bed2-90c080514e2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f1f40abddac405488fac1efd8c8da99)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:28.832921 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a75a18-59c7-4b71-bed2-90c080514e2a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:29.041029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e4a75a18-59c7-4b71-bed2-90c080514e2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f1f40abddac405488fac1efd8c8da99'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:29.042213 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e4a75a18-59c7-4b71-bed2-90c080514e2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f1f40abddac405488fac1efd8c8da99'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:29.042871 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e4a75a18-59c7-4b71-bed2-90c080514e2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f1f40abddac405488fac1efd8c8da99'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:29.065030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e4a75a18-59c7-4b71-bed2-90c080514e2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f1f40abddac405488fac1efd8c8da99'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:29.130822 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e4a75a18-59c7-4b71-bed2-90c080514e2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f1f40abddac405488fac1efd8c8da99'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:29.151396 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1118/2228] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:40:28 2022] DELETE /identity/v3/users/8f1f40abddac405488fac1efd8c8da99 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:40:29.156067 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce4d74-aacd-4631-8a53-ab80013eb5e8 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:29.156588 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce4d74-aacd-4631-8a53-ab80013eb5e8 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:29.156687 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce4d74-aacd-4631-8a53-ab80013eb5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:29.176531 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-97ce4d74-aacd-4631-8a53-ab80013eb5e8 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:40:29.177781 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-97ce4d74-aacd-4631-8a53-ab80013eb5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:29.190827 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:29.245678 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1111/2229] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:40:29.259327 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a75a18-59c7-4b71-bed2-90c080514e2a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:29.260799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e4a75a18-59c7-4b71-bed2-90c080514e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:29.319022 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a75a18-59c7-4b71-bed2-90c080514e2a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:29.322773 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac98bcfb-9925-4319-8508-51b7b658df69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:29.323368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98bcfb-9925-4319-8508-51b7b658df69 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:29.323642 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98bcfb-9925-4319-8508-51b7b658df69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:29.323910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98bcfb-9925-4319-8508-51b7b658df69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:29.332673 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac98bcfb-9925-4319-8508-51b7b658df69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:29.334631 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac98bcfb-9925-4319-8508-51b7b658df69 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:29.344435 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1119/2230] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:40:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:40:29.771082 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce4d74-aacd-4631-8a53-ab80013eb5e8 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:29.771082 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-97ce4d74-aacd-4631-8a53-ab80013eb5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:29.790571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce4d74-aacd-4631-8a53-ab80013eb5e8 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:29.795363 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf98cf-d7b5-49fc-a378-9136479d2115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:29.796003 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf98cf-d7b5-49fc-a378-9136479d2115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:29.796283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf98cf-d7b5-49fc-a378-9136479d2115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:29.796556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf98cf-d7b5-49fc-a378-9136479d2115 admin admin] PATH_INFO: `/v3/projects/84257274f40345ac814045bbd17c9a91` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:29.797692 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf98cf-d7b5-49fc-a378-9136479d2115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84257274f40345ac814045bbd17c9a91)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:29.800317 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf98cf-d7b5-49fc-a378-9136479d2115 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:29.935235 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f9bf98cf-d7b5-49fc-a378-9136479d2115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84257274f40345ac814045bbd17c9a91', 'request_id': 'req-f9bf98cf-d7b5-49fc-a378-9136479d2115'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:30.005279 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f9bf98cf-d7b5-49fc-a378-9136479d2115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84257274f40345ac814045bbd17c9a91', 'request_id': 'req-f9bf98cf-d7b5-49fc-a378-9136479d2115'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:30.013338 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f9bf98cf-d7b5-49fc-a378-9136479d2115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84257274f40345ac814045bbd17c9a91', 'request_id': 'req-f9bf98cf-d7b5-49fc-a378-9136479d2115'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:30.024533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f9bf98cf-d7b5-49fc-a378-9136479d2115 admin admin] The token cache is being invalidate because project 84257274f40345ac814045bbd17c9a91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:40:30.024826 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f9bf98cf-d7b5-49fc-a378-9136479d2115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:30.025486 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f9bf98cf-d7b5-49fc-a378-9136479d2115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:30.027013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1112/2231] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:40:29 2022] DELETE /identity/v3/projects/84257274f40345ac814045bbd17c9a91 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:40:30.031122 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac98bcfb-9925-4319-8508-51b7b658df69 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:30.041201 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac98bcfb-9925-4319-8508-51b7b658df69 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:30.071807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:30.098226 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a844e-fb4f-47c6-a438-9a2bf6f328e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:30.098857 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a844e-fb4f-47c6-a438-9a2bf6f328e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:30.099135 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a844e-fb4f-47c6-a438-9a2bf6f328e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:30.099404 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a844e-fb4f-47c6-a438-9a2bf6f328e3 admin admin] PATH_INFO: `/v3/users/67eeb05348c34252b47788f427156076` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:30.101286 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a844e-fb4f-47c6-a438-9a2bf6f328e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67eeb05348c34252b47788f427156076)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:30.103443 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a844e-fb4f-47c6-a438-9a2bf6f328e3 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:30.304747 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-073a844e-fb4f-47c6-a438-9a2bf6f328e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67eeb05348c34252b47788f427156076'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:30.305422 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-073a844e-fb4f-47c6-a438-9a2bf6f328e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67eeb05348c34252b47788f427156076'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:30.306116 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-073a844e-fb4f-47c6-a438-9a2bf6f328e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67eeb05348c34252b47788f427156076'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:30.338884 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-073a844e-fb4f-47c6-a438-9a2bf6f328e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67eeb05348c34252b47788f427156076'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:30.405217 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-073a844e-fb4f-47c6-a438-9a2bf6f328e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67eeb05348c34252b47788f427156076'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:30.418389 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1120/2232] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:40:30 2022] DELETE /identity/v3/users/67eeb05348c34252b47788f427156076 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:40:30.859235 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf98cf-d7b5-49fc-a378-9136479d2115 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:30.861545 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f9bf98cf-d7b5-49fc-a378-9136479d2115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:30.885067 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf98cf-d7b5-49fc-a378-9136479d2115 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:30.955113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338fe44-b97c-47b3-8700-47b9121c0403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:30.955746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338fe44-b97c-47b3-8700-47b9121c0403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:30.956025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338fe44-b97c-47b3-8700-47b9121c0403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:30.956701 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338fe44-b97c-47b3-8700-47b9121c0403 admin admin] PATH_INFO: `/v3/projects/edc7d62f174f4652af29c0d84925cfb7` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:30.957427 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338fe44-b97c-47b3-8700-47b9121c0403 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edc7d62f174f4652af29c0d84925cfb7)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:30.959377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338fe44-b97c-47b3-8700-47b9121c0403 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:31.074978 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:31.078669 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2338fe44-b97c-47b3-8700-47b9121c0403 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edc7d62f174f4652af29c0d84925cfb7', 'request_id': 'req-2338fe44-b97c-47b3-8700-47b9121c0403'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:31.150376 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2338fe44-b97c-47b3-8700-47b9121c0403 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edc7d62f174f4652af29c0d84925cfb7', 'request_id': 'req-2338fe44-b97c-47b3-8700-47b9121c0403'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:31.157099 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2338fe44-b97c-47b3-8700-47b9121c0403 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edc7d62f174f4652af29c0d84925cfb7', 'request_id': 'req-2338fe44-b97c-47b3-8700-47b9121c0403'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:31.169048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2338fe44-b97c-47b3-8700-47b9121c0403 admin admin] The token cache is being invalidate because project edc7d62f174f4652af29c0d84925cfb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:40:31.169334 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2338fe44-b97c-47b3-8700-47b9121c0403 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:31.170017 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-2338fe44-b97c-47b3-8700-47b9121c0403 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:40:31.171513 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1113/2233] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:40:30 2022] DELETE /identity/v3/projects/edc7d62f174f4652af29c0d84925cfb7 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:40:31.177594 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12beeed-7264-40e3-86a2-b762002b1ff3 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:31.178783 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12beeed-7264-40e3-86a2-b762002b1ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:31.178783 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12beeed-7264-40e3-86a2-b762002b1ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:31.200336 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c12beeed-7264-40e3-86a2-b762002b1ff3 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:40:31.201726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c12beeed-7264-40e3-86a2-b762002b1ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:31.272742 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1121/2234] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:40:31.281729 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777a96e-7041-40aa-91f1-eb6f445ddf06 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:31.282131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777a96e-7041-40aa-91f1-eb6f445ddf06 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:31.282482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777a96e-7041-40aa-91f1-eb6f445ddf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:31.302756 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a777a96e-7041-40aa-91f1-eb6f445ddf06 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:40:31.304514 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a777a96e-7041-40aa-91f1-eb6f445ddf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:31.312477 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1114/2235] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:40:31.316720 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12beeed-7264-40e3-86a2-b762002b1ff3 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:31.326920 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12beeed-7264-40e3-86a2-b762002b1ff3 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:31.331534 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedb407-4a8a-47f2-97df-d37cf1274061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:31.332129 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedb407-4a8a-47f2-97df-d37cf1274061 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:31.332443 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedb407-4a8a-47f2-97df-d37cf1274061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:31.332720 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedb407-4a8a-47f2-97df-d37cf1274061 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:31.333373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dedb407-4a8a-47f2-97df-d37cf1274061 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:40:31.333674 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dedb407-4a8a-47f2-97df-d37cf1274061 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:31.335958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dedb407-4a8a-47f2-97df-d37cf1274061 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:31.347302 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1122/2236] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:40:31.352357 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777a96e-7041-40aa-91f1-eb6f445ddf06 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:31.362391 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777a96e-7041-40aa-91f1-eb6f445ddf06 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:31.367535 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3a829-8de6-461f-bf41-5ef58bc95540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:31.368132 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3a829-8de6-461f-bf41-5ef58bc95540 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:31.368410 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3a829-8de6-461f-bf41-5ef58bc95540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:31.368683 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3a829-8de6-461f-bf41-5ef58bc95540 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:31.369303 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3a829-8de6-461f-bf41-5ef58bc95540 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:31.371267 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3a829-8de6-461f-bf41-5ef58bc95540 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:31.451722 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1115/2237] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:40:31 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:40:31.456092 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedb407-4a8a-47f2-97df-d37cf1274061 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:31.469495 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedb407-4a8a-47f2-97df-d37cf1274061 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:31.510517 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:31.529761 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752828d-f8c9-4a42-8e70-346dfd246304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:31.530400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752828d-f8c9-4a42-8e70-346dfd246304 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:31.530685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752828d-f8c9-4a42-8e70-346dfd246304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:31.530961 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752828d-f8c9-4a42-8e70-346dfd246304 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:31.531602 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752828d-f8c9-4a42-8e70-346dfd246304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:31.533547 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752828d-f8c9-4a42-8e70-346dfd246304 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:31.617836 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1123/2238] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:40:31 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:40:31.621984 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3a829-8de6-461f-bf41-5ef58bc95540 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:31.633328 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3a829-8de6-461f-bf41-5ef58bc95540 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:31.637974 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79727824-7091-4029-a738-863b759798c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:31.638567 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79727824-7091-4029-a738-863b759798c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:31.638841 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79727824-7091-4029-a738-863b759798c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:31.639107 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79727824-7091-4029-a738-863b759798c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:31.639815 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79727824-7091-4029-a738-863b759798c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:31.641505 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79727824-7091-4029-a738-863b759798c3 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:31.657018 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1116/2239] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:40:31.661478 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752828d-f8c9-4a42-8e70-346dfd246304 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:31.672198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752828d-f8c9-4a42-8e70-346dfd246304 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:31.676865 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9878cde-5731-4c7c-a12b-bde7ad080a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:31.680699 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9878cde-5731-4c7c-a12b-bde7ad080a0c admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:31.680699 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9878cde-5731-4c7c-a12b-bde7ad080a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:31.680699 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9878cde-5731-4c7c-a12b-bde7ad080a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:31.680699 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9878cde-5731-4c7c-a12b-bde7ad080a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:31.681055 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9878cde-5731-4c7c-a12b-bde7ad080a0c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:31.690961 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1124/2240] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:40:31.696376 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79727824-7091-4029-a738-863b759798c3 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:31.711114 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79727824-7091-4029-a738-863b759798c3 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:31.716325 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72e232-346e-44f9-83df-b2db4a627127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:31.716981 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72e232-346e-44f9-83df-b2db4a627127 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:31.717256 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72e232-346e-44f9-83df-b2db4a627127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:31.717526 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72e232-346e-44f9-83df-b2db4a627127 admin admin] PATH_INFO: `/v3/projects/633a972ca85d4d9ab05f129885401f09/users/5362e125a47546b1838cf7385b0fc66a/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:31.733343 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72e232-346e-44f9-83df-b2db4a627127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=633a972ca85d4d9ab05f129885401f09, user_id=5362e125a47546b1838cf7385b0fc66a, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:31.736044 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72e232-346e-44f9-83df-b2db4a627127 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:31.809223 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1117/2241] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:40:31 2022] PUT /identity/v3/projects/633a972ca85d4d9ab05f129885401f09/users/5362e125a47546b1838cf7385b0fc66a/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:40:31.821888 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cbb82-d7af-457c-a435-fbbced0ff2af None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:31.822337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cbb82-d7af-457c-a435-fbbced0ff2af None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:31.822755 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cbb82-d7af-457c-a435-fbbced0ff2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:31.851422 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f39cbb82-d7af-457c-a435-fbbced0ff2af None None] MFA Rules not processed for user `5362e125a47546b1838cf7385b0fc66a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:40:31.852687 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f39cbb82-d7af-457c-a435-fbbced0ff2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:31.927957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1125/2242] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:40:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:40:31.932635 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72e232-346e-44f9-83df-b2db4a627127 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:32.004944 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72e232-346e-44f9-83df-b2db4a627127 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:32.010748 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0509f5-d9c7-4e0c-a6f6-2c64681d206c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:32.011254 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0509f5-d9c7-4e0c-a6f6-2c64681d206c admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:32.011533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0509f5-d9c7-4e0c-a6f6-2c64681d206c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:32.011832 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0509f5-d9c7-4e0c-a6f6-2c64681d206c admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:32.012469 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0509f5-d9c7-4e0c-a6f6-2c64681d206c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:32.014451 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0509f5-d9c7-4e0c-a6f6-2c64681d206c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:32.101027 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1118/2243] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:40:31 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:40:32.104849 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39cbb82-d7af-457c-a435-fbbced0ff2af None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:32.117539 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39cbb82-d7af-457c-a435-fbbced0ff2af None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:32.177084 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05c17b-15b8-4206-bed7-7e55b2a5a20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:32.177601 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05c17b-15b8-4206-bed7-7e55b2a5a20d admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:32.178035 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05c17b-15b8-4206-bed7-7e55b2a5a20d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:32.178621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05c17b-15b8-4206-bed7-7e55b2a5a20d admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:32.179122 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb05c17b-15b8-4206-bed7-7e55b2a5a20d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:32.181071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb05c17b-15b8-4206-bed7-7e55b2a5a20d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:32.298118 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1126/2244] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:40:32 2022] POST /identity/v3/users => generated 299 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:40:32.302415 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0509f5-d9c7-4e0c-a6f6-2c64681d206c admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:32.313923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0509f5-d9c7-4e0c-a6f6-2c64681d206c admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:32.320798 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce61da-e457-4782-a175-2c9949dc0758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:32.321676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce61da-e457-4782-a175-2c9949dc0758 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:32.322155 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce61da-e457-4782-a175-2c9949dc0758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:32.322437 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce61da-e457-4782-a175-2c9949dc0758 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:32.323183 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce61da-e457-4782-a175-2c9949dc0758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:32.324844 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce61da-e457-4782-a175-2c9949dc0758 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:32.336842 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1119/2245] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:40:32.341153 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05c17b-15b8-4206-bed7-7e55b2a5a20d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:32.352025 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05c17b-15b8-4206-bed7-7e55b2a5a20d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:32.356640 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941740f9-ddf3-4ad3-9387-fb877af0da8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:32.357555 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941740f9-ddf3-4ad3-9387-fb877af0da8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:32.357885 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941740f9-ddf3-4ad3-9387-fb877af0da8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:32.358162 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941740f9-ddf3-4ad3-9387-fb877af0da8e admin admin] PATH_INFO: `/v3/projects/d430c5f6660e4e50af0ab0d0dcc7c112/users/36f32869d8e146dda138c8dd3471315d/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:32.373107 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941740f9-ddf3-4ad3-9387-fb877af0da8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d430c5f6660e4e50af0ab0d0dcc7c112, user_id=36f32869d8e146dda138c8dd3471315d, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:32.376005 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941740f9-ddf3-4ad3-9387-fb877af0da8e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:32.437008 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1127/2246] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:40:32 2022] PUT /identity/v3/projects/d430c5f6660e4e50af0ab0d0dcc7c112/users/36f32869d8e146dda138c8dd3471315d/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:40:32.441181 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce61da-e457-4782-a175-2c9949dc0758 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:32.451629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce61da-e457-4782-a175-2c9949dc0758 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:32.505609 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:32.522960 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d7d5a-e574-41db-85f8-0c06dc9dc8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:32.523569 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d7d5a-e574-41db-85f8-0c06dc9dc8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:32.523848 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d7d5a-e574-41db-85f8-0c06dc9dc8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:32.524121 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d7d5a-e574-41db-85f8-0c06dc9dc8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:32.524765 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d7d5a-e574-41db-85f8-0c06dc9dc8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:32.526410 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d7d5a-e574-41db-85f8-0c06dc9dc8e7 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:32.536870 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1120/2247] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:40:32.540517 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941740f9-ddf3-4ad3-9387-fb877af0da8e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:32.550861 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941740f9-ddf3-4ad3-9387-fb877af0da8e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:32.556339 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db3ccb-2ede-42f6-a7b4-7b4f51fb3938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:32.556984 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db3ccb-2ede-42f6-a7b4-7b4f51fb3938 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:32.557263 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db3ccb-2ede-42f6-a7b4-7b4f51fb3938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:32.557534 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db3ccb-2ede-42f6-a7b4-7b4f51fb3938 admin admin] PATH_INFO: `/v3/projects/d430c5f6660e4e50af0ab0d0dcc7c112/users/36f32869d8e146dda138c8dd3471315d/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:32.559478 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db3ccb-2ede-42f6-a7b4-7b4f51fb3938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d430c5f6660e4e50af0ab0d0dcc7c112, user_id=36f32869d8e146dda138c8dd3471315d, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:32.562251 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db3ccb-2ede-42f6-a7b4-7b4f51fb3938 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:32.569545 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:32.573686 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1128/2248] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:40:32 2022] PUT /identity/v3/projects/d430c5f6660e4e50af0ab0d0dcc7c112/users/36f32869d8e146dda138c8dd3471315d/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:40:32.586229 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758af29-a88f-43bb-bf37-ecac1ede4ade None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:32.586512 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758af29-a88f-43bb-bf37-ecac1ede4ade None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:32.586781 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758af29-a88f-43bb-bf37-ecac1ede4ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:32.620316 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-6758af29-a88f-43bb-bf37-ecac1ede4ade None None] MFA Rules not processed for user `36f32869d8e146dda138c8dd3471315d`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:40:32.621869 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6758af29-a88f-43bb-bf37-ecac1ede4ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:32.700776 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1121/2249] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:40:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:40:32.711497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db3ccb-2ede-42f6-a7b4-7b4f51fb3938 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:32.713475 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-56db3ccb-2ede-42f6-a7b4-7b4f51fb3938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:32.777108 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db3ccb-2ede-42f6-a7b4-7b4f51fb3938 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:32.780741 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f43d7-d556-4c32-9a62-1e38854fc7f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:32.781341 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f43d7-d556-4c32-9a62-1e38854fc7f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:32.781615 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f43d7-d556-4c32-9a62-1e38854fc7f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:32.782069 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f43d7-d556-4c32-9a62-1e38854fc7f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:32.842942 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f43d7-d556-4c32-9a62-1e38854fc7f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:32.844851 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f43d7-d556-4c32-9a62-1e38854fc7f3 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:32.855822 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1129/2250] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:40:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:40:41.224927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758af29-a88f-43bb-bf37-ecac1ede4ade None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:41.227472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6758af29-a88f-43bb-bf37-ecac1ede4ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:41.239907 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758af29-a88f-43bb-bf37-ecac1ede4ade None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:41.243686 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a9e01-fea5-453f-a7ca-b2b5b2baeba8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:41.244283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a9e01-fea5-453f-a7ca-b2b5b2baeba8 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:41.244562 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a9e01-fea5-453f-a7ca-b2b5b2baeba8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:41.244832 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a9e01-fea5-453f-a7ca-b2b5b2baeba8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:41.253926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a9e01-fea5-453f-a7ca-b2b5b2baeba8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:41.255363 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a9e01-fea5-453f-a7ca-b2b5b2baeba8 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:41.266430 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1122/2251] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:40:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:40:42.851223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=48 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:51.261808 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=50 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:06.447657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f43d7-d556-4c32-9a62-1e38854fc7f3 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:06.449901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7c4f43d7-d556-4c32-9a62-1e38854fc7f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:06.520252 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f43d7-d556-4c32-9a62-1e38854fc7f3 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:06.525143 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688030cb-9642-49dc-a475-1cf37343d1d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63253cd786c04d6a9d099773198aee36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:06.525771 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688030cb-9642-49dc-a475-1cf37343d1d2 service placement] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:06.526056 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688030cb-9642-49dc-a475-1cf37343d1d2 service placement] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:06.526323 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688030cb-9642-49dc-a475-1cf37343d1d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:06.528478 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-688030cb-9642-49dc-a475-1cf37343d1d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:06.540168 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688030cb-9642-49dc-a475-1cf37343d1d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:06.541769 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688030cb-9642-49dc-a475-1cf37343d1d2 service placement] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:06.552409 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1130/2252] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:41:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:41:12.227089 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f09bf-0dca-43f1-9368-8c0a339bd0c1 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:12.227645 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f09bf-0dca-43f1-9368-8c0a339bd0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:12.227762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f09bf-0dca-43f1-9368-8c0a339bd0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:12.249673 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a95f09bf-0dca-43f1-9368-8c0a339bd0c1 None None] MFA Rules not processed for user `3b7c54ebd95f4b3eb396982d75615f23`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:41:12.263513 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a95f09bf-0dca-43f1-9368-8c0a339bd0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:12.317765 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1123/2253] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:41:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:41:13.042893 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadcb2f-2341-4d3b-a175-2a4dc23d5f1c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:13.043925 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadcb2f-2341-4d3b-a175-2a4dc23d5f1c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:13.044512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadcb2f-2341-4d3b-a175-2a4dc23d5f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:13.067763 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-2cadcb2f-2341-4d3b-a175-2a4dc23d5f1c None None] MFA Rules not processed for user `3acc0010e3f54283934b75f58bb6ec93`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:41:13.069586 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2cadcb2f-2341-4d3b-a175-2a4dc23d5f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:13.141428 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1131/2254] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:41:13 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:41:13.611068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f09bf-0dca-43f1-9368-8c0a339bd0c1 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:13.693654 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f09bf-0dca-43f1-9368-8c0a339bd0c1 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:13.700170 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f7db9-a039-4325-9d81-949e14d1d82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:13.702348 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f7db9-a039-4325-9d81-949e14d1d82b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:13.702911 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f7db9-a039-4325-9d81-949e14d1d82b admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:13.706983 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f7db9-a039-4325-9d81-949e14d1d82b admin admin] PATH_INFO: `/v3/users/5362e125a47546b1838cf7385b0fc66a` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:13.706983 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f7db9-a039-4325-9d81-949e14d1d82b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5362e125a47546b1838cf7385b0fc66a)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:13.707231 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f7db9-a039-4325-9d81-949e14d1d82b admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:13.892339 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-856f7db9-a039-4325-9d81-949e14d1d82b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5362e125a47546b1838cf7385b0fc66a'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:13.893068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-856f7db9-a039-4325-9d81-949e14d1d82b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5362e125a47546b1838cf7385b0fc66a'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:13.906414 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-856f7db9-a039-4325-9d81-949e14d1d82b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5362e125a47546b1838cf7385b0fc66a'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:13.907180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-856f7db9-a039-4325-9d81-949e14d1d82b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5362e125a47546b1838cf7385b0fc66a'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:13.977787 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-856f7db9-a039-4325-9d81-949e14d1d82b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5362e125a47546b1838cf7385b0fc66a'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:14.003681 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1124/2255] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:41:13 2022] DELETE /identity/v3/users/5362e125a47546b1838cf7385b0fc66a => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:41:14.008327 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b8e14-99a9-4a24-8563-504e04add60c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:14.008617 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b8e14-99a9-4a24-8563-504e04add60c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:14.009059 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b8e14-99a9-4a24-8563-504e04add60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:14.033879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ff6b8e14-99a9-4a24-8563-504e04add60c None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:41:14.035507 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ff6b8e14-99a9-4a24-8563-504e04add60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:14.118611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1132/2256] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:41:14.130409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f7db9-a039-4325-9d81-949e14d1d82b admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:14.131833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-856f7db9-a039-4325-9d81-949e14d1d82b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:14.160690 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:14.193642 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f7db9-a039-4325-9d81-949e14d1d82b admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:14.195954 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdebed-286f-46a8-b71a-7cb47a826821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:14.196561 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdebed-286f-46a8-b71a-7cb47a826821 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:14.196839 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdebed-286f-46a8-b71a-7cb47a826821 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:14.197109 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdebed-286f-46a8-b71a-7cb47a826821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:14.206913 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fdebed-286f-46a8-b71a-7cb47a826821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:14.208454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fdebed-286f-46a8-b71a-7cb47a826821 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:14.218696 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1125/2257] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:41:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:41:14.671926 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b8e14-99a9-4a24-8563-504e04add60c None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:14.673819 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ff6b8e14-99a9-4a24-8563-504e04add60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:14.707219 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b8e14-99a9-4a24-8563-504e04add60c None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:14.728282 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b6ae6-0efa-44c0-b5da-82d2ec439ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:14.728941 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b6ae6-0efa-44c0-b5da-82d2ec439ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:14.729223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b6ae6-0efa-44c0-b5da-82d2ec439ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:14.729497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b6ae6-0efa-44c0-b5da-82d2ec439ce1 admin admin] PATH_INFO: `/v3/projects/633a972ca85d4d9ab05f129885401f09` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:14.730697 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b6ae6-0efa-44c0-b5da-82d2ec439ce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=633a972ca85d4d9ab05f129885401f09)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:14.732939 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b6ae6-0efa-44c0-b5da-82d2ec439ce1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:14.824551 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:14.838107 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8a0b6ae6-0efa-44c0-b5da-82d2ec439ce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '633a972ca85d4d9ab05f129885401f09', 'request_id': 'req-8a0b6ae6-0efa-44c0-b5da-82d2ec439ce1'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:14.884934 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8a0b6ae6-0efa-44c0-b5da-82d2ec439ce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '633a972ca85d4d9ab05f129885401f09', 'request_id': 'req-8a0b6ae6-0efa-44c0-b5da-82d2ec439ce1'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:14.892358 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8a0b6ae6-0efa-44c0-b5da-82d2ec439ce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '633a972ca85d4d9ab05f129885401f09', 'request_id': 'req-8a0b6ae6-0efa-44c0-b5da-82d2ec439ce1'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:14.903864 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8a0b6ae6-0efa-44c0-b5da-82d2ec439ce1 admin admin] The token cache is being invalidate because project 633a972ca85d4d9ab05f129885401f09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:41:14.904148 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8a0b6ae6-0efa-44c0-b5da-82d2ec439ce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:14.904818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8a0b6ae6-0efa-44c0-b5da-82d2ec439ce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:14.906360 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1133/2258] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:41:14 2022] DELETE /identity/v3/projects/633a972ca85d4d9ab05f129885401f09 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:41:14.910645 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdebed-286f-46a8-b71a-7cb47a826821 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:14.921386 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdebed-286f-46a8-b71a-7cb47a826821 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:14.987171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db95c5-ba8e-45ca-9080-ef22ff8219bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:14.987859 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db95c5-ba8e-45ca-9080-ef22ff8219bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:14.988144 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db95c5-ba8e-45ca-9080-ef22ff8219bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:14.988416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db95c5-ba8e-45ca-9080-ef22ff8219bf admin admin] PATH_INFO: `/v3/users/36f32869d8e146dda138c8dd3471315d` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:14.989979 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db95c5-ba8e-45ca-9080-ef22ff8219bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=36f32869d8e146dda138c8dd3471315d)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:14.991654 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db95c5-ba8e-45ca-9080-ef22ff8219bf admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:15.178520 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-11db95c5-ba8e-45ca-9080-ef22ff8219bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36f32869d8e146dda138c8dd3471315d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:15.179204 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-11db95c5-ba8e-45ca-9080-ef22ff8219bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36f32869d8e146dda138c8dd3471315d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:15.193394 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-11db95c5-ba8e-45ca-9080-ef22ff8219bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36f32869d8e146dda138c8dd3471315d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:15.194249 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-11db95c5-ba8e-45ca-9080-ef22ff8219bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36f32869d8e146dda138c8dd3471315d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:15.265471 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-11db95c5-ba8e-45ca-9080-ef22ff8219bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36f32869d8e146dda138c8dd3471315d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:15.280083 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1126/2259] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:41:14 2022] DELETE /identity/v3/users/36f32869d8e146dda138c8dd3471315d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:41:15.751392 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b6ae6-0efa-44c0-b5da-82d2ec439ce1 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:15.753072 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8a0b6ae6-0efa-44c0-b5da-82d2ec439ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:15.799822 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b6ae6-0efa-44c0-b5da-82d2ec439ce1 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:15.875258 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5224db-0914-4c47-8fc6-7697b81fc6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:15.875906 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5224db-0914-4c47-8fc6-7697b81fc6b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:15.876191 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5224db-0914-4c47-8fc6-7697b81fc6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:15.876471 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5224db-0914-4c47-8fc6-7697b81fc6b9 admin admin] PATH_INFO: `/v3/projects/d430c5f6660e4e50af0ab0d0dcc7c112` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:15.877631 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5224db-0914-4c47-8fc6-7697b81fc6b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d430c5f6660e4e50af0ab0d0dcc7c112)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:15.879608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5224db-0914-4c47-8fc6-7697b81fc6b9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:16.017916 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ce5224db-0914-4c47-8fc6-7697b81fc6b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd430c5f6660e4e50af0ab0d0dcc7c112', 'request_id': 'req-ce5224db-0914-4c47-8fc6-7697b81fc6b9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:16.077532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ce5224db-0914-4c47-8fc6-7697b81fc6b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd430c5f6660e4e50af0ab0d0dcc7c112', 'request_id': 'req-ce5224db-0914-4c47-8fc6-7697b81fc6b9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:16.085223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ce5224db-0914-4c47-8fc6-7697b81fc6b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd430c5f6660e4e50af0ab0d0dcc7c112', 'request_id': 'req-ce5224db-0914-4c47-8fc6-7697b81fc6b9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:16.097087 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ce5224db-0914-4c47-8fc6-7697b81fc6b9 admin admin] The token cache is being invalidate because project d430c5f6660e4e50af0ab0d0dcc7c112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:41:16.097391 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ce5224db-0914-4c47-8fc6-7697b81fc6b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:16.102100 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ce5224db-0914-4c47-8fc6-7697b81fc6b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:16.103866 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1134/2260] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:41:15 2022] DELETE /identity/v3/projects/d430c5f6660e4e50af0ab0d0dcc7c112 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:41:16.110820 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed91f2-4eb2-4774-9c65-aff33a29a847 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:16.111389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed91f2-4eb2-4774-9c65-aff33a29a847 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:16.111389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed91f2-4eb2-4774-9c65-aff33a29a847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:16.134477 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-c5ed91f2-4eb2-4774-9c65-aff33a29a847 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:41:16.137981 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c5ed91f2-4eb2-4774-9c65-aff33a29a847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:16.187970 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:16.212886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1127/2261] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:41:16.222563 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bb0bd-6ff5-4854-8312-93eabdcdcc8c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:16.222867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bb0bd-6ff5-4854-8312-93eabdcdcc8c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:16.223130 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bb0bd-6ff5-4854-8312-93eabdcdcc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:16.252494 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-225bb0bd-6ff5-4854-8312-93eabdcdcc8c None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:41:16.254863 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-225bb0bd-6ff5-4854-8312-93eabdcdcc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:16.270236 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1135/2262] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:41:16.272069 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed91f2-4eb2-4774-9c65-aff33a29a847 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:16.283851 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed91f2-4eb2-4774-9c65-aff33a29a847 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:16.291990 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001ce85-df47-4442-9961-b3d7695b54f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:16.292788 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001ce85-df47-4442-9961-b3d7695b54f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:16.293174 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001ce85-df47-4442-9961-b3d7695b54f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:16.293551 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001ce85-df47-4442-9961-b3d7695b54f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:16.295027 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001ce85-df47-4442-9961-b3d7695b54f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:41:16.295585 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001ce85-df47-4442-9961-b3d7695b54f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:16.297833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001ce85-df47-4442-9961-b3d7695b54f6 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:16.317300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1128/2263] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:41:16.318575 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bb0bd-6ff5-4854-8312-93eabdcdcc8c None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:16.329703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bb0bd-6ff5-4854-8312-93eabdcdcc8c None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:16.335661 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c3b00-8567-4018-9a9b-dd94e7777584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:16.336370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c3b00-8567-4018-9a9b-dd94e7777584 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:16.336589 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c3b00-8567-4018-9a9b-dd94e7777584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:16.336864 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c3b00-8567-4018-9a9b-dd94e7777584 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:16.337527 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c3b00-8567-4018-9a9b-dd94e7777584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:16.339542 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c3b00-8567-4018-9a9b-dd94e7777584 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:16.452919 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1136/2264] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:41:16 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:41:16.457558 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001ce85-df47-4442-9961-b3d7695b54f6 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:16.471518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001ce85-df47-4442-9961-b3d7695b54f6 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:16.533158 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73032286-5fe5-435a-b9f3-a58002cc7803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:16.533715 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73032286-5fe5-435a-b9f3-a58002cc7803 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:16.534041 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73032286-5fe5-435a-b9f3-a58002cc7803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:16.534313 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73032286-5fe5-435a-b9f3-a58002cc7803 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:16.534946 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73032286-5fe5-435a-b9f3-a58002cc7803 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:16.536877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73032286-5fe5-435a-b9f3-a58002cc7803 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:16.612154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1129/2265] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:41:16 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:41:16.616536 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c3b00-8567-4018-9a9b-dd94e7777584 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:16.627966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c3b00-8567-4018-9a9b-dd94e7777584 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:16.633032 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a6a05-87c9-4d5b-b9a8-f2ee3f30503b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:16.633639 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a6a05-87c9-4d5b-b9a8-f2ee3f30503b admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:16.633941 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a6a05-87c9-4d5b-b9a8-f2ee3f30503b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:16.634515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a6a05-87c9-4d5b-b9a8-f2ee3f30503b admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:16.639069 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a6a05-87c9-4d5b-b9a8-f2ee3f30503b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:16.639069 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a6a05-87c9-4d5b-b9a8-f2ee3f30503b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:16.647958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1137/2266] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:41:16.653358 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73032286-5fe5-435a-b9f3-a58002cc7803 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:16.666765 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73032286-5fe5-435a-b9f3-a58002cc7803 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:16.673105 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7f978-aaae-4e2d-aee2-b842ddc8add2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:16.673521 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7f978-aaae-4e2d-aee2-b842ddc8add2 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:16.673892 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7f978-aaae-4e2d-aee2-b842ddc8add2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:16.674094 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7f978-aaae-4e2d-aee2-b842ddc8add2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:16.674808 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7f978-aaae-4e2d-aee2-b842ddc8add2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:16.676456 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7f978-aaae-4e2d-aee2-b842ddc8add2 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:16.689786 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1130/2267] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:41:16.693804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a6a05-87c9-4d5b-b9a8-f2ee3f30503b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:16.715328 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a6a05-87c9-4d5b-b9a8-f2ee3f30503b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:16.720929 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1cd904-0cd1-4675-b3de-0029ac11d216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:16.721587 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cd904-0cd1-4675-b3de-0029ac11d216 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:16.721901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cd904-0cd1-4675-b3de-0029ac11d216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:16.722177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cd904-0cd1-4675-b3de-0029ac11d216 admin admin] PATH_INFO: `/v3/projects/f69f30ea5d3642c28a38c6f75c8bb57b/users/a902794de84d477e890e0e6a861c102d/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:16.725589 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:16.738118 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1cd904-0cd1-4675-b3de-0029ac11d216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f69f30ea5d3642c28a38c6f75c8bb57b, user_id=a902794de84d477e890e0e6a861c102d, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:16.740797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1cd904-0cd1-4675-b3de-0029ac11d216 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:16.846919 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1138/2268] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:41:16 2022] PUT /identity/v3/projects/f69f30ea5d3642c28a38c6f75c8bb57b/users/a902794de84d477e890e0e6a861c102d/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:41:16.852283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f49230-7fab-4b57-809a-db0abd46fc4c None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:16.852573 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f49230-7fab-4b57-809a-db0abd46fc4c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:16.852852 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f49230-7fab-4b57-809a-db0abd46fc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:16.883896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-61f49230-7fab-4b57-809a-db0abd46fc4c None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:41:16.885358 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-61f49230-7fab-4b57-809a-db0abd46fc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:16.969798 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1131/2269] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:41:16.980057 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1cd904-0cd1-4675-b3de-0029ac11d216 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:16.980457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ae1cd904-0cd1-4675-b3de-0029ac11d216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:17.051315 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1cd904-0cd1-4675-b3de-0029ac11d216 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:17.055776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c1b0f-24bb-49f8-a34f-5db7f06fb631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:17.056306 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c1b0f-24bb-49f8-a34f-5db7f06fb631 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:17.060217 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c1b0f-24bb-49f8-a34f-5db7f06fb631 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:17.060217 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c1b0f-24bb-49f8-a34f-5db7f06fb631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:17.073421 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c1b0f-24bb-49f8-a34f-5db7f06fb631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:17.074925 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c1b0f-24bb-49f8-a34f-5db7f06fb631 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:17.090672 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1139/2270] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:41:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:41:18.620007 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc82a85-2fdc-42c1-b3ba-e1e92d18d79a None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:18.620477 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc82a85-2fdc-42c1-b3ba-e1e92d18d79a None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:18.620692 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc82a85-2fdc-42c1-b3ba-e1e92d18d79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:18.656665 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-4cc82a85-2fdc-42c1-b3ba-e1e92d18d79a None None] MFA Rules not processed for user `a902794de84d477e890e0e6a861c102d`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:41:18.658530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4cc82a85-2fdc-42c1-b3ba-e1e92d18d79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:18.722536 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:18.748990 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1132/2271] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:41:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:41:18.760605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c1b0f-24bb-49f8-a34f-5db7f06fb631 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:18.762149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-dc2c1b0f-24bb-49f8-a34f-5db7f06fb631 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:18.829267 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c1b0f-24bb-49f8-a34f-5db7f06fb631 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:18.832957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18136089-72d7-451e-96c9-967e772fafe4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:18.833570 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18136089-72d7-451e-96c9-967e772fafe4 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:18.833883 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18136089-72d7-451e-96c9-967e772fafe4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:18.834161 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18136089-72d7-451e-96c9-967e772fafe4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:18.843487 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18136089-72d7-451e-96c9-967e772fafe4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:18.845245 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18136089-72d7-451e-96c9-967e772fafe4 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:18.855241 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1140/2272] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:41:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:41:25.858070 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aaeb51-fc68-4014-ade0-4be64d128ae1 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:25.858534 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aaeb51-fc68-4014-ade0-4be64d128ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:25.858881 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aaeb51-fc68-4014-ade0-4be64d128ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:25.882063 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-51aaeb51-fc68-4014-ade0-4be64d128ae1 None None] MFA Rules not processed for user `a902794de84d477e890e0e6a861c102d`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:41:25.883915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-51aaeb51-fc68-4014-ade0-4be64d128ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:25.895521 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1133/2273] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:41:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:41:28.851247 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=58,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:31.525093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18136089-72d7-451e-96c9-967e772fafe4 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:31.526815 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-18136089-72d7-451e-96c9-967e772fafe4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:31.545799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18136089-72d7-451e-96c9-967e772fafe4 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:31.554771 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33a7ab-dde6-4de2-88b3-afe6e546b68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:31.555353 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33a7ab-dde6-4de2-88b3-afe6e546b68f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:31.556491 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33a7ab-dde6-4de2-88b3-afe6e546b68f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:31.556994 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33a7ab-dde6-4de2-88b3-afe6e546b68f admin admin] PATH_INFO: `/v3/users/978be2526bc646789867ff5d087ee533` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:31.558351 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33a7ab-dde6-4de2-88b3-afe6e546b68f admin admin] RBAC: Authorizing `identity:delete_user(user_id=978be2526bc646789867ff5d087ee533)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:31.563205 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33a7ab-dde6-4de2-88b3-afe6e546b68f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:31.840848 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fa33a7ab-dde6-4de2-88b3-afe6e546b68f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '978be2526bc646789867ff5d087ee533'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:31.842359 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fa33a7ab-dde6-4de2-88b3-afe6e546b68f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '978be2526bc646789867ff5d087ee533'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:31.844684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fa33a7ab-dde6-4de2-88b3-afe6e546b68f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '978be2526bc646789867ff5d087ee533'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:31.859182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fa33a7ab-dde6-4de2-88b3-afe6e546b68f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '978be2526bc646789867ff5d087ee533'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:31.925302 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-fa33a7ab-dde6-4de2-88b3-afe6e546b68f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '978be2526bc646789867ff5d087ee533'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:31.947952 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1141/2274] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:41:31 2022] DELETE /identity/v3/users/978be2526bc646789867ff5d087ee533 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:41:31.949621 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974e724-fed0-4b6b-9a80-62aa5b9d6f5b None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:31.950562 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974e724-fed0-4b6b-9a80-62aa5b9d6f5b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:31.951026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974e724-fed0-4b6b-9a80-62aa5b9d6f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:31.974412 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-3974e724-fed0-4b6b-9a80-62aa5b9d6f5b None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:41:31.976250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3974e724-fed0-4b6b-9a80-62aa5b9d6f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:32.048970 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1134/2275] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:41:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:41:32.064136 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33a7ab-dde6-4de2-88b3-afe6e546b68f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:32.065997 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fa33a7ab-dde6-4de2-88b3-afe6e546b68f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:32.156299 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33a7ab-dde6-4de2-88b3-afe6e546b68f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:32.162214 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715bd21-3043-4ea5-a4b5-1690f1f6cdea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:32.162797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715bd21-3043-4ea5-a4b5-1690f1f6cdea service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:32.163067 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715bd21-3043-4ea5-a4b5-1690f1f6cdea service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:32.163428 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715bd21-3043-4ea5-a4b5-1690f1f6cdea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:32.175207 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f715bd21-3043-4ea5-a4b5-1690f1f6cdea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:32.176832 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f715bd21-3043-4ea5-a4b5-1690f1f6cdea service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:32.191460 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1142/2276] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:41:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:41:32.425058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974e724-fed0-4b6b-9a80-62aa5b9d6f5b None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:32.427561 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3974e724-fed0-4b6b-9a80-62aa5b9d6f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:32.445257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974e724-fed0-4b6b-9a80-62aa5b9d6f5b None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:32.452375 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791bd2f-69fa-4a60-accc-dcc569c72447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:32.453678 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791bd2f-69fa-4a60-accc-dcc569c72447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:32.453678 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791bd2f-69fa-4a60-accc-dcc569c72447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:32.453678 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791bd2f-69fa-4a60-accc-dcc569c72447 admin admin] PATH_INFO: `/v3/users/c217d37c81934813a7f7ebfc861f3540` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:32.455594 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791bd2f-69fa-4a60-accc-dcc569c72447 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c217d37c81934813a7f7ebfc861f3540)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:32.458739 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791bd2f-69fa-4a60-accc-dcc569c72447 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:32.844962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9791bd2f-69fa-4a60-accc-dcc569c72447 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c217d37c81934813a7f7ebfc861f3540'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:32.845796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9791bd2f-69fa-4a60-accc-dcc569c72447 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c217d37c81934813a7f7ebfc861f3540'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:32.863728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9791bd2f-69fa-4a60-accc-dcc569c72447 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c217d37c81934813a7f7ebfc861f3540'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:32.864352 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9791bd2f-69fa-4a60-accc-dcc569c72447 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c217d37c81934813a7f7ebfc861f3540'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:32.991947 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9791bd2f-69fa-4a60-accc-dcc569c72447 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c217d37c81934813a7f7ebfc861f3540'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:33.024537 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1135/2277] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:41:32 2022] DELETE /identity/v3/users/c217d37c81934813a7f7ebfc861f3540 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:41:33.035234 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980f3da-df9c-4d61-afa1-cbbe3a633ac4 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:33.036189 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980f3da-df9c-4d61-afa1-cbbe3a633ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:33.036601 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980f3da-df9c-4d61-afa1-cbbe3a633ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:33.085306 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-7980f3da-df9c-4d61-afa1-cbbe3a633ac4 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:41:33.089611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7980f3da-df9c-4d61-afa1-cbbe3a633ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:33.183150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1143/2278] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:41:33.197716 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791bd2f-69fa-4a60-accc-dcc569c72447 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:33.200978 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9791bd2f-69fa-4a60-accc-dcc569c72447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:33.307026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:33.317202 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791bd2f-69fa-4a60-accc-dcc569c72447 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:33.324798 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978617b-9a25-4920-8484-24caaf88914c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:33.325995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978617b-9a25-4920-8484-24caaf88914c service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:33.326920 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978617b-9a25-4920-8484-24caaf88914c service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:33.333179 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978617b-9a25-4920-8484-24caaf88914c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:33.367821 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978617b-9a25-4920-8484-24caaf88914c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:33.367821 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978617b-9a25-4920-8484-24caaf88914c service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:33.377316 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1136/2279] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:41:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:41:33.498245 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980f3da-df9c-4d61-afa1-cbbe3a633ac4 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:33.498920 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7980f3da-df9c-4d61-afa1-cbbe3a633ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:33.514651 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980f3da-df9c-4d61-afa1-cbbe3a633ac4 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:33.541408 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7d40c-ccf6-4c12-b584-08374892d7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:33.542330 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7d40c-ccf6-4c12-b584-08374892d7cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:33.542714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7d40c-ccf6-4c12-b584-08374892d7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:33.543064 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7d40c-ccf6-4c12-b584-08374892d7cc admin admin] PATH_INFO: `/v3/projects/bb78c1e69d7148c39adf3bdc5e1a6d3c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:33.544473 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7d40c-ccf6-4c12-b584-08374892d7cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb78c1e69d7148c39adf3bdc5e1a6d3c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:33.547458 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7d40c-ccf6-4c12-b584-08374892d7cc admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:33.564431 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:33.692762 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c3d7d40c-ccf6-4c12-b584-08374892d7cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb78c1e69d7148c39adf3bdc5e1a6d3c', 'request_id': 'req-c3d7d40c-ccf6-4c12-b584-08374892d7cc'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:33.805605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c3d7d40c-ccf6-4c12-b584-08374892d7cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb78c1e69d7148c39adf3bdc5e1a6d3c', 'request_id': 'req-c3d7d40c-ccf6-4c12-b584-08374892d7cc'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:33.814776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c3d7d40c-ccf6-4c12-b584-08374892d7cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb78c1e69d7148c39adf3bdc5e1a6d3c', 'request_id': 'req-c3d7d40c-ccf6-4c12-b584-08374892d7cc'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:33.828864 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c3d7d40c-ccf6-4c12-b584-08374892d7cc admin admin] The token cache is being invalidate because project bb78c1e69d7148c39adf3bdc5e1a6d3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:41:33.829196 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c3d7d40c-ccf6-4c12-b584-08374892d7cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:33.829856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c3d7d40c-ccf6-4c12-b584-08374892d7cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:33.831714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1144/2280] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:41:33 2022] DELETE /identity/v3/projects/bb78c1e69d7148c39adf3bdc5e1a6d3c => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:41:33.837122 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db733d-840d-4bea-8f3d-82c2773c17c1 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:33.837954 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db733d-840d-4bea-8f3d-82c2773c17c1 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:33.838306 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db733d-840d-4bea-8f3d-82c2773c17c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:33.859010 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-f8db733d-840d-4bea-8f3d-82c2773c17c1 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:41:33.860252 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f8db733d-840d-4bea-8f3d-82c2773c17c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:33.932060 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1137/2281] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:41:33.941483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed07cb1-f849-4056-a08b-b840d856f438 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:33.941792 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed07cb1-f849-4056-a08b-b840d856f438 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:33.942068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed07cb1-f849-4056-a08b-b840d856f438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:33.964198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4ed07cb1-f849-4056-a08b-b840d856f438 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:41:33.966022 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4ed07cb1-f849-4056-a08b-b840d856f438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:33.979249 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1145/2282] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:41:33.984113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db733d-840d-4bea-8f3d-82c2773c17c1 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:33.994245 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db733d-840d-4bea-8f3d-82c2773c17c1 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:34.002200 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca7d6f-804d-430e-b2c8-de401b7b1f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:34.002819 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca7d6f-804d-430e-b2c8-de401b7b1f06 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:34.003103 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca7d6f-804d-430e-b2c8-de401b7b1f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:34.003436 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca7d6f-804d-430e-b2c8-de401b7b1f06 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:34.004185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca7d6f-804d-430e-b2c8-de401b7b1f06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:41:34.004497 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca7d6f-804d-430e-b2c8-de401b7b1f06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:34.006177 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca7d6f-804d-430e-b2c8-de401b7b1f06 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:34.021058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1138/2283] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:41:34.025515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed07cb1-f849-4056-a08b-b840d856f438 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:34.035139 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed07cb1-f849-4056-a08b-b840d856f438 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:34.040878 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6cd86-f97c-4be5-b860-1f979f73f1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:34.041646 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6cd86-f97c-4be5-b860-1f979f73f1f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:34.041966 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6cd86-f97c-4be5-b860-1f979f73f1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:34.042247 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6cd86-f97c-4be5-b860-1f979f73f1f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:34.042898 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6cd86-f97c-4be5-b860-1f979f73f1f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:34.045012 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6cd86-f97c-4be5-b860-1f979f73f1f9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:34.168945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1146/2284] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:41:34 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:41:34.169130 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca7d6f-804d-430e-b2c8-de401b7b1f06 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:34.180284 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca7d6f-804d-430e-b2c8-de401b7b1f06 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:34.248841 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee23e1-7d24-4009-b37f-391601af5084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:34.249725 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee23e1-7d24-4009-b37f-391601af5084 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:34.250245 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee23e1-7d24-4009-b37f-391601af5084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:34.250720 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee23e1-7d24-4009-b37f-391601af5084 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:34.251837 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee23e1-7d24-4009-b37f-391601af5084 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:34.254205 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee23e1-7d24-4009-b37f-391601af5084 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:34.327880 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6cd86-f97c-4be5-b860-1f979f73f1f9 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:34.329770 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5da6cd86-f97c-4be5-b860-1f979f73f1f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:34.343930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6cd86-f97c-4be5-b860-1f979f73f1f9 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:34.349220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e48a3-7411-4e67-b997-fe70568baaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:34.349814 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e48a3-7411-4e67-b997-fe70568baaa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:34.350105 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e48a3-7411-4e67-b997-fe70568baaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:34.350383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e48a3-7411-4e67-b997-fe70568baaa0 admin admin] PATH_INFO: `/v3/projects/f12aa76e7e854debb15603d7d306c042` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:34.351696 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e48a3-7411-4e67-b997-fe70568baaa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f12aa76e7e854debb15603d7d306c042)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:34.353807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e48a3-7411-4e67-b997-fe70568baaa0 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:34.385944 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1139/2285] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:41:34 2022] POST /identity/v3/users => generated 287 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:41:34.393065 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee23e1-7d24-4009-b37f-391601af5084 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:34.409034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee23e1-7d24-4009-b37f-391601af5084 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:34.416447 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7955e-ac41-4673-b724-143ce6bd00a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:34.417812 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7955e-ac41-4673-b724-143ce6bd00a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:34.420039 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7955e-ac41-4673-b724-143ce6bd00a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:34.420570 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7955e-ac41-4673-b724-143ce6bd00a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:34.421459 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7955e-ac41-4673-b724-143ce6bd00a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:34.423647 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7955e-ac41-4673-b724-143ce6bd00a7 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:34.441640 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1140/2286] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:41:34.447514 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7955e-ac41-4673-b724-143ce6bd00a7 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:34.460884 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7955e-ac41-4673-b724-143ce6bd00a7 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:34.466244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e4b64-098a-420c-b789-ccdeaef919f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:34.467013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e4b64-098a-420c-b789-ccdeaef919f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:34.467397 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e4b64-098a-420c-b789-ccdeaef919f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:34.467778 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e4b64-098a-420c-b789-ccdeaef919f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:34.468540 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e4b64-098a-420c-b789-ccdeaef919f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:34.470377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e4b64-098a-420c-b789-ccdeaef919f5 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:34.482422 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1141/2287] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:41:34.488579 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e4b64-098a-420c-b789-ccdeaef919f5 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:34.504065 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e4b64-098a-420c-b789-ccdeaef919f5 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:34.525069 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8a0e48a3-7411-4e67-b997-fe70568baaa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f12aa76e7e854debb15603d7d306c042', 'request_id': 'req-8a0e48a3-7411-4e67-b997-fe70568baaa0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:34.585284 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd99678-4981-4c07-868b-f273f1404d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:34.586035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd99678-4981-4c07-868b-f273f1404d2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:34.586345 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd99678-4981-4c07-868b-f273f1404d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:34.586729 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd99678-4981-4c07-868b-f273f1404d2a admin admin] PATH_INFO: `/v3/projects/96b55635cff7462ba4702b7b1600406d/users/b9beccc8676245ec8082032efcb19ef6/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:34.607827 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd99678-4981-4c07-868b-f273f1404d2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=96b55635cff7462ba4702b7b1600406d, user_id=b9beccc8676245ec8082032efcb19ef6, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:34.611044 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd99678-4981-4c07-868b-f273f1404d2a admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:34.624304 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8a0e48a3-7411-4e67-b997-fe70568baaa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f12aa76e7e854debb15603d7d306c042', 'request_id': 'req-8a0e48a3-7411-4e67-b997-fe70568baaa0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:34.647678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8a0e48a3-7411-4e67-b997-fe70568baaa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f12aa76e7e854debb15603d7d306c042', 'request_id': 'req-8a0e48a3-7411-4e67-b997-fe70568baaa0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:34.667264 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8a0e48a3-7411-4e67-b997-fe70568baaa0 admin admin] The token cache is being invalidate because project f12aa76e7e854debb15603d7d306c042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:41:34.672363 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8a0e48a3-7411-4e67-b997-fe70568baaa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:34.672363 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8a0e48a3-7411-4e67-b997-fe70568baaa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:34.672363 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1147/2288] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:41:34 2022] DELETE /identity/v3/projects/f12aa76e7e854debb15603d7d306c042 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:41:34.738034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1142/2289] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:41:34 2022] PUT /identity/v3/projects/96b55635cff7462ba4702b7b1600406d/users/b9beccc8676245ec8082032efcb19ef6/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:41:34.749141 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec360d7b-11f6-4db6-9ce4-2d9044d63b85 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:34.749432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec360d7b-11f6-4db6-9ce4-2d9044d63b85 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:34.749715 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec360d7b-11f6-4db6-9ce4-2d9044d63b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:34.813189 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ec360d7b-11f6-4db6-9ce4-2d9044d63b85 None None] MFA Rules not processed for user `b9beccc8676245ec8082032efcb19ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:41:34.814903 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ec360d7b-11f6-4db6-9ce4-2d9044d63b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:34.908876 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1148/2290] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:41:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:41:34.921484 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd99678-4981-4c07-868b-f273f1404d2a admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:34.923425 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1bd99678-4981-4c07-868b-f273f1404d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:34.929047 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:35.003009 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd99678-4981-4c07-868b-f273f1404d2a admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:35.007450 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d95cc-1d9a-45a7-9170-fdfc2a431025 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:35.008118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d95cc-1d9a-45a7-9170-fdfc2a431025 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:35.008395 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d95cc-1d9a-45a7-9170-fdfc2a431025 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:35.008728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d95cc-1d9a-45a7-9170-fdfc2a431025 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:35.024249 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d95cc-1d9a-45a7-9170-fdfc2a431025 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:35.026010 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d95cc-1d9a-45a7-9170-fdfc2a431025 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:35.037083 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1143/2291] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:41:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:41:35.116916 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:38.090180 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d4afc-5f08-44ec-b74d-5d5d55f47ede None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:38.090825 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d4afc-5f08-44ec-b74d-5d5d55f47ede None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:38.090825 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d4afc-5f08-44ec-b74d-5d5d55f47ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:38.112981 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-552d4afc-5f08-44ec-b74d-5d5d55f47ede None None] MFA Rules not processed for user `b9beccc8676245ec8082032efcb19ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:41:38.114534 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-552d4afc-5f08-44ec-b74d-5d5d55f47ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:38.123133 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1149/2292] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:41:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:41:38.993896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d95cc-1d9a-45a7-9170-fdfc2a431025 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:39.005032 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-535d95cc-1d9a-45a7-9170-fdfc2a431025 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:39.081442 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d95cc-1d9a-45a7-9170-fdfc2a431025 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:39.086741 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f1cd7-1443-4503-9316-e1a611dcb130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:39.087545 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f1cd7-1443-4503-9316-e1a611dcb130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:39.087897 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f1cd7-1443-4503-9316-e1a611dcb130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:39.088208 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f1cd7-1443-4503-9316-e1a611dcb130 admin admin] PATH_INFO: `/v3/users/7c507fff096b4796bf63803f3b961e1c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:39.094905 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f1cd7-1443-4503-9316-e1a611dcb130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c507fff096b4796bf63803f3b961e1c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:39.096960 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f1cd7-1443-4503-9316-e1a611dcb130 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:39.488991 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-fe9f1cd7-1443-4503-9316-e1a611dcb130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c507fff096b4796bf63803f3b961e1c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:39.488991 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-fe9f1cd7-1443-4503-9316-e1a611dcb130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c507fff096b4796bf63803f3b961e1c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:39.515413 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-fe9f1cd7-1443-4503-9316-e1a611dcb130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c507fff096b4796bf63803f3b961e1c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:39.516234 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-fe9f1cd7-1443-4503-9316-e1a611dcb130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c507fff096b4796bf63803f3b961e1c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:39.700998 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-fe9f1cd7-1443-4503-9316-e1a611dcb130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c507fff096b4796bf63803f3b961e1c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:39.700998 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:39.714105 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1144/2293] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:41:38 2022] DELETE /identity/v3/users/7c507fff096b4796bf63803f3b961e1c => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:41:39.719918 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e7b82-28e6-4396-abac-b8b66f20206f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:39.721325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e7b82-28e6-4396-abac-b8b66f20206f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:39.721726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e7b82-28e6-4396-abac-b8b66f20206f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:39.742878 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c29e7b82-28e6-4396-abac-b8b66f20206f None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:41:39.744264 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c29e7b82-28e6-4396-abac-b8b66f20206f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:39.816145 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1150/2294] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:41:39.827270 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f1cd7-1443-4503-9316-e1a611dcb130 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:39.829047 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-fe9f1cd7-1443-4503-9316-e1a611dcb130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:39.907701 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f1cd7-1443-4503-9316-e1a611dcb130 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:39.911494 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184725d8-e9a1-4346-b249-f40bd99f2582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:39.912113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184725d8-e9a1-4346-b249-f40bd99f2582 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:39.912394 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184725d8-e9a1-4346-b249-f40bd99f2582 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:39.912666 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184725d8-e9a1-4346-b249-f40bd99f2582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:39.926025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184725d8-e9a1-4346-b249-f40bd99f2582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:39.928197 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184725d8-e9a1-4346-b249-f40bd99f2582 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:39.941183 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1145/2295] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:41:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:41:40.623513 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e7b82-28e6-4396-abac-b8b66f20206f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:40.625853 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c29e7b82-28e6-4396-abac-b8b66f20206f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:40.668136 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e7b82-28e6-4396-abac-b8b66f20206f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:40.706603 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0311d-3d65-4683-a306-1c70a90a7df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:40.707614 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0311d-3d65-4683-a306-1c70a90a7df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:40.708061 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0311d-3d65-4683-a306-1c70a90a7df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:40.708473 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0311d-3d65-4683-a306-1c70a90a7df2 admin admin] PATH_INFO: `/v3/projects/7bc9f58d0c7b4e91bfb2930b59f17c70` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:40.711611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0311d-3d65-4683-a306-1c70a90a7df2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bc9f58d0c7b4e91bfb2930b59f17c70)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:40.714566 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0311d-3d65-4683-a306-1c70a90a7df2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:40.863154 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-81b0311d-3d65-4683-a306-1c70a90a7df2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bc9f58d0c7b4e91bfb2930b59f17c70', 'request_id': 'req-81b0311d-3d65-4683-a306-1c70a90a7df2'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:40.951861 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-81b0311d-3d65-4683-a306-1c70a90a7df2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bc9f58d0c7b4e91bfb2930b59f17c70', 'request_id': 'req-81b0311d-3d65-4683-a306-1c70a90a7df2'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:40.959788 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-81b0311d-3d65-4683-a306-1c70a90a7df2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bc9f58d0c7b4e91bfb2930b59f17c70', 'request_id': 'req-81b0311d-3d65-4683-a306-1c70a90a7df2'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:40.970827 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-81b0311d-3d65-4683-a306-1c70a90a7df2 admin admin] The token cache is being invalidate because project 7bc9f58d0c7b4e91bfb2930b59f17c70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:41:40.971115 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-81b0311d-3d65-4683-a306-1c70a90a7df2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:40.971774 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-81b0311d-3d65-4683-a306-1c70a90a7df2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:41:40.973471 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1151/2296] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:41:40 2022] DELETE /identity/v3/projects/7bc9f58d0c7b4e91bfb2930b59f17c70 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:41:50.242506 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=30 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:50.967481 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=65,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:57.226671 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184725d8-e9a1-4346-b249-f40bd99f2582 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:41:57.237888 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184725d8-e9a1-4346-b249-f40bd99f2582 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:41:57.302752 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9bf20-6da1-4bbc-88fd-e0db8c438086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:41:57.303473 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9bf20-6da1-4bbc-88fd-e0db8c438086 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:57.303758 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9bf20-6da1-4bbc-88fd-e0db8c438086 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:57.312560 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9bf20-6da1-4bbc-88fd-e0db8c438086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:57.312560 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6ad9bf20-6da1-4bbc-88fd-e0db8c438086 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:57.431033 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9bf20-6da1-4bbc-88fd-e0db8c438086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:41:57.432612 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9bf20-6da1-4bbc-88fd-e0db8c438086 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:41:57.450762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1146/2297] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:41:57 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:41:59.720932 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8a47d-fd59-4501-b332-7e43cc348eff None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:41:59.721539 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8a47d-fd59-4501-b332-7e43cc348eff None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:41:59.721981 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8a47d-fd59-4501-b332-7e43cc348eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:41:59.760328 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c3c8a47d-fd59-4501-b332-7e43cc348eff None None] MFA Rules not processed for user `a902794de84d477e890e0e6a861c102d`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:41:59.765475 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c3c8a47d-fd59-4501-b332-7e43cc348eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:41:59.861587 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1152/2298] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:41:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:42:07.439471 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=50 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:08.647718 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161a72a-b6e4-4a86-bb58-3b7aa575e1b5 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:08.648716 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161a72a-b6e4-4a86-bb58-3b7aa575e1b5 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:08.648716 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161a72a-b6e4-4a86-bb58-3b7aa575e1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:08.672110 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-5161a72a-b6e4-4a86-bb58-3b7aa575e1b5 None None] MFA Rules not processed for user `477ab357d285415e8c0c82d414d242ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:42:08.674163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-5161a72a-b6e4-4a86-bb58-3b7aa575e1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:42:08.788144 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1147/2299] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 14:42:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:42:08.860189 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8a47d-fd59-4501-b332-7e43cc348eff None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:42:08.861723 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c3c8a47d-fd59-4501-b332-7e43cc348eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:42:08.971613 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8a47d-fd59-4501-b332-7e43cc348eff None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:42:08.977354 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01018688-accc-4f45-942f-45218e14e074 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b3c32ecfdcf40629f09a7f52b2b5fa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:42:08.978116 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01018688-accc-4f45-942f-45218e14e074 service swift] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:08.978456 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01018688-accc-4f45-942f-45218e14e074 service swift] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:08.978836 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01018688-accc-4f45-942f-45218e14e074 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:08.989817 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01018688-accc-4f45-942f-45218e14e074 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:42:08.991771 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01018688-accc-4f45-942f-45218e14e074 service swift] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:42:09.002155 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1153/2300] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 14:42:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 14:42:10.091499 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e18f88-6e4e-4a3f-a487-6d6f459b4ceb None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:10.092315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e18f88-6e4e-4a3f-a487-6d6f459b4ceb None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:10.092315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e18f88-6e4e-4a3f-a487-6d6f459b4ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:10.126041 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-e0e18f88-6e4e-4a3f-a487-6d6f459b4ceb None None] MFA Rules not processed for user `477ab357d285415e8c0c82d414d242ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:42:10.128170 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e0e18f88-6e4e-4a3f-a487-6d6f459b4ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:42:10.139304 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1148/2301] 10.222.0.65 () {58 vars in 967 bytes} [Wed Aug 24 14:42:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:42:10.156744 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01018688-accc-4f45-942f-45218e14e074 service swift] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:42:10.179458 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01018688-accc-4f45-942f-45218e14e074 service swift] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:42:10.188938 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9d109-7a44-4fb9-a931-43c74fa5dac4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b3c32ecfdcf40629f09a7f52b2b5fa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:42:10.190060 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9d109-7a44-4fb9-a931-43c74fa5dac4 service swift] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:10.190520 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9d109-7a44-4fb9-a931-43c74fa5dac4 service swift] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:10.190976 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9d109-7a44-4fb9-a931-43c74fa5dac4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:10.204886 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9d109-7a44-4fb9-a931-43c74fa5dac4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:42:10.207166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9d109-7a44-4fb9-a931-43c74fa5dac4 service swift] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:42:10.220320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1154/2302] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 14:42:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 14:42:10.989517 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b92d14-c6ac-4455-8e6f-25ce572e2074 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:10.989983 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b92d14-c6ac-4455-8e6f-25ce572e2074 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:10.990473 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b92d14-c6ac-4455-8e6f-25ce572e2074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:11.013788 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a9b92d14-c6ac-4455-8e6f-25ce572e2074 None None] MFA Rules not processed for user `477ab357d285415e8c0c82d414d242ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:42:11.015236 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a9b92d14-c6ac-4455-8e6f-25ce572e2074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:42:11.024060 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1149/2303] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 14:42:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:42:11.038121 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9d109-7a44-4fb9-a931-43c74fa5dac4 service swift] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:42:11.053137 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9d109-7a44-4fb9-a931-43c74fa5dac4 service swift] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:42:11.058570 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ab947-310b-48c5-a73e-fbfe65eca33c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b3c32ecfdcf40629f09a7f52b2b5fa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:42:11.059790 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ab947-310b-48c5-a73e-fbfe65eca33c service swift] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:11.060073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ab947-310b-48c5-a73e-fbfe65eca33c service swift] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:11.060434 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ab947-310b-48c5-a73e-fbfe65eca33c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:11.069384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ab947-310b-48c5-a73e-fbfe65eca33c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:42:11.071004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ab947-310b-48c5-a73e-fbfe65eca33c service swift] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:42:11.079893 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1155/2304] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 14:42:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 14:42:11.744865 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ce4ab-3465-40a9-899e-d11c483d7f4f None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:11.747009 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ce4ab-3465-40a9-899e-d11c483d7f4f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:11.748020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ce4ab-3465-40a9-899e-d11c483d7f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:11.784526 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-d23ce4ab-3465-40a9-899e-d11c483d7f4f None None] MFA Rules not processed for user `477ab357d285415e8c0c82d414d242ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:42:11.786210 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d23ce4ab-3465-40a9-899e-d11c483d7f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:42:11.795073 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1150/2305] 10.222.0.65 () {58 vars in 967 bytes} [Wed Aug 24 14:42:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:42:11.810479 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ab947-310b-48c5-a73e-fbfe65eca33c service swift] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:42:11.821531 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ab947-310b-48c5-a73e-fbfe65eca33c service swift] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:42:11.830811 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb33b4-217b-42c8-9aeb-61f4b1e1b850 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b3c32ecfdcf40629f09a7f52b2b5fa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:42:11.831793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb33b4-217b-42c8-9aeb-61f4b1e1b850 service swift] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:11.832253 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb33b4-217b-42c8-9aeb-61f4b1e1b850 service swift] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:11.832724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb33b4-217b-42c8-9aeb-61f4b1e1b850 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:11.845102 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb33b4-217b-42c8-9aeb-61f4b1e1b850 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:42:11.847075 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb33b4-217b-42c8-9aeb-61f4b1e1b850 service swift] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:42:11.857122 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1156/2306] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 14:42:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 14:42:15.089544 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ce4ab-3465-40a9-899e-d11c483d7f4f None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:42:15.092264 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d23ce4ab-3465-40a9-899e-d11c483d7f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:42:15.185159 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ce4ab-3465-40a9-899e-d11c483d7f4f None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:42:15.189839 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5a8ce-a95d-45a7-9a27-2a61c2d67d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:42:15.190471 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5a8ce-a95d-45a7-9a27-2a61c2d67d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:15.190750 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5a8ce-a95d-45a7-9a27-2a61c2d67d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:15.191015 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5a8ce-a95d-45a7-9a27-2a61c2d67d7e admin admin] PATH_INFO: `/v3/users/b9beccc8676245ec8082032efcb19ef6` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:15.192169 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5a8ce-a95d-45a7-9a27-2a61c2d67d7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9beccc8676245ec8082032efcb19ef6)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:42:15.194173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5a8ce-a95d-45a7-9a27-2a61c2d67d7e admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:42:15.435787 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e7a5a8ce-a95d-45a7-9a27-2a61c2d67d7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9beccc8676245ec8082032efcb19ef6'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:42:15.436755 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e7a5a8ce-a95d-45a7-9a27-2a61c2d67d7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9beccc8676245ec8082032efcb19ef6'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:42:15.463027 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e7a5a8ce-a95d-45a7-9a27-2a61c2d67d7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9beccc8676245ec8082032efcb19ef6'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:42:15.464266 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e7a5a8ce-a95d-45a7-9a27-2a61c2d67d7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9beccc8676245ec8082032efcb19ef6'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:42:15.610964 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e7a5a8ce-a95d-45a7-9a27-2a61c2d67d7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9beccc8676245ec8082032efcb19ef6'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:42:15.632532 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1151/2307] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:42:15 2022] DELETE /identity/v3/users/b9beccc8676245ec8082032efcb19ef6 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:42:15.639032 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d7fe2-f30d-49e6-9238-9fe84c360d80 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:15.639663 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d7fe2-f30d-49e6-9238-9fe84c360d80 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:15.640013 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d7fe2-f30d-49e6-9238-9fe84c360d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:15.674949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-576d7fe2-f30d-49e6-9238-9fe84c360d80 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:42:15.677039 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-576d7fe2-f30d-49e6-9238-9fe84c360d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:42:15.748050 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:15.760254 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1157/2308] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:42:15.775517 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5a8ce-a95d-45a7-9a27-2a61c2d67d7e admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:42:15.780382 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e7a5a8ce-a95d-45a7-9a27-2a61c2d67d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:42:15.790296 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:15.880613 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5a8ce-a95d-45a7-9a27-2a61c2d67d7e admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:42:15.885072 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dcce29-8540-4c24-ba1a-893fc06ec877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:42:15.885830 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcce29-8540-4c24-ba1a-893fc06ec877 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:15.886159 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcce29-8540-4c24-ba1a-893fc06ec877 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:15.886857 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcce29-8540-4c24-ba1a-893fc06ec877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:15.904620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dcce29-8540-4c24-ba1a-893fc06ec877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:42:15.906834 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dcce29-8540-4c24-ba1a-893fc06ec877 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:42:15.920833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1152/2309] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:42:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:42:16.241317 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d7fe2-f30d-49e6-9238-9fe84c360d80 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:42:16.242949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-576d7fe2-f30d-49e6-9238-9fe84c360d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:42:16.276401 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d7fe2-f30d-49e6-9238-9fe84c360d80 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:42:16.284910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4938e33-6fd6-470f-9996-c20343137182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:42:16.285663 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4938e33-6fd6-470f-9996-c20343137182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:16.286052 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4938e33-6fd6-470f-9996-c20343137182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:16.286452 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4938e33-6fd6-470f-9996-c20343137182 admin admin] PATH_INFO: `/v3/projects/96b55635cff7462ba4702b7b1600406d` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:16.288181 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4938e33-6fd6-470f-9996-c20343137182 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96b55635cff7462ba4702b7b1600406d)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:42:16.291102 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4938e33-6fd6-470f-9996-c20343137182 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:42:16.425903 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b4938e33-6fd6-470f-9996-c20343137182 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96b55635cff7462ba4702b7b1600406d', 'request_id': 'req-b4938e33-6fd6-470f-9996-c20343137182'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:42:16.499807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b4938e33-6fd6-470f-9996-c20343137182 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96b55635cff7462ba4702b7b1600406d', 'request_id': 'req-b4938e33-6fd6-470f-9996-c20343137182'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:42:16.512958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b4938e33-6fd6-470f-9996-c20343137182 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96b55635cff7462ba4702b7b1600406d', 'request_id': 'req-b4938e33-6fd6-470f-9996-c20343137182'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:42:16.525498 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b4938e33-6fd6-470f-9996-c20343137182 admin admin] The token cache is being invalidate because project 96b55635cff7462ba4702b7b1600406d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:42:16.525925 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b4938e33-6fd6-470f-9996-c20343137182 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:42:16.526657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b4938e33-6fd6-470f-9996-c20343137182 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:42:16.529329 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1158/2310] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:42:16 2022] DELETE /identity/v3/projects/96b55635cff7462ba4702b7b1600406d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:42:25.042295 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb64b1e-f0df-4542-ac0b-23c18744fe3e None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:25.044763 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb64b1e-f0df-4542-ac0b-23c18744fe3e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:25.044763 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb64b1e-f0df-4542-ac0b-23c18744fe3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:25.065824 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ceb64b1e-f0df-4542-ac0b-23c18744fe3e None None] MFA Rules not processed for user `477ab357d285415e8c0c82d414d242ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:42:25.067056 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ceb64b1e-f0df-4542-ac0b-23c18744fe3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:42:25.138912 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1153/2311] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 14:42:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:42:25.153608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4938e33-6fd6-470f-9996-c20343137182 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:42:25.155484 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b4938e33-6fd6-470f-9996-c20343137182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:42:25.273621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4938e33-6fd6-470f-9996-c20343137182 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:42:25.282561 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181841e2-a58f-4518-acae-6cf82fcb57d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b3c32ecfdcf40629f09a7f52b2b5fa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:42:25.285519 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181841e2-a58f-4518-acae-6cf82fcb57d1 service swift] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:25.285519 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181841e2-a58f-4518-acae-6cf82fcb57d1 service swift] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:25.285519 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181841e2-a58f-4518-acae-6cf82fcb57d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:25.298547 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181841e2-a58f-4518-acae-6cf82fcb57d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:42:25.301249 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181841e2-a58f-4518-acae-6cf82fcb57d1 service swift] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:42:25.326468 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1159/2312] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 14:42:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 14:42:35.126603 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=49 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:35.311084 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=61,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:35.687746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd23fe-793b-4b1a-972e-42313b4f6520 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:35.688100 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd23fe-793b-4b1a-972e-42313b4f6520 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:35.688329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd23fe-793b-4b1a-972e-42313b4f6520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:35.710184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-e4dd23fe-793b-4b1a-972e-42313b4f6520 None None] MFA Rules not processed for user `477ab357d285415e8c0c82d414d242ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:42:35.711847 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e4dd23fe-793b-4b1a-972e-42313b4f6520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:42:35.721450 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1154/2313] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 14:42:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:42:35.740116 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181841e2-a58f-4518-acae-6cf82fcb57d1 service swift] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:42:35.753151 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181841e2-a58f-4518-acae-6cf82fcb57d1 service swift] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:42:35.762585 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44ea08-d7d8-4b41-a742-f26846bdd5eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b3c32ecfdcf40629f09a7f52b2b5fa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:42:35.763527 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44ea08-d7d8-4b41-a742-f26846bdd5eb service swift] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:35.763956 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44ea08-d7d8-4b41-a742-f26846bdd5eb service swift] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:35.764394 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44ea08-d7d8-4b41-a742-f26846bdd5eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:35.775045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44ea08-d7d8-4b41-a742-f26846bdd5eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:42:35.777563 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44ea08-d7d8-4b41-a742-f26846bdd5eb service swift] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:42:35.787080 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1160/2314] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 14:42:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 14:42:45.704004 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:45.901190 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=6 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:48.738352 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebd0b8-d7d3-4f4b-909b-d43e5246f39b None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:48.739454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebd0b8-d7d3-4f4b-909b-d43e5246f39b None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:48.739729 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebd0b8-d7d3-4f4b-909b-d43e5246f39b None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:48.741114 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1155/2315] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 14:42:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:42:48.752036 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378103e3-b119-4636-b40b-f27b8a08d8d7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:48.753140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378103e3-b119-4636-b40b-f27b8a08d8d7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:48.753599 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378103e3-b119-4636-b40b-f27b8a08d8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:48.781081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-378103e3-b119-4636-b40b-f27b8a08d8d7 None None] MFA Rules not processed for user `8d099678d6454f7eb494892a69feaf62`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:42:48.785523 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-378103e3-b119-4636-b40b-f27b8a08d8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:42:48.861721 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1161/2316] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 14:42:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:42:48.877929 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebd0b8-d7d3-4f4b-909b-d43e5246f39b None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:42:48.877929 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-11ebd0b8-d7d3-4f4b-909b-d43e5246f39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:42:48.940092 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebd0b8-d7d3-4f4b-909b-d43e5246f39b None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:42:48.943638 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a43ad6-42b2-4774-9e16-c41d4a602a59 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78745f9dbf544ab291acfa7a063c1493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:42:48.944239 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a43ad6-42b2-4774-9e16-c41d4a602a59 service glance] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:48.944521 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a43ad6-42b2-4774-9e16-c41d4a602a59 service glance] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:48.944797 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a43ad6-42b2-4774-9e16-c41d4a602a59 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:48.956093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a43ad6-42b2-4774-9e16-c41d4a602a59 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:42:48.957583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a43ad6-42b2-4774-9e16-c41d4a602a59 service glance] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:42:48.970416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1156/2317] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:42:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:42:49.232043 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd18b3e-8651-4c90-8543-371a610f5805 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:49.232362 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd18b3e-8651-4c90-8543-371a610f5805 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:49.232630 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd18b3e-8651-4c90-8543-371a610f5805 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:49.234084 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1162/2318] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 14:42:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:42:49.239966 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00393f7b-faa0-4a0f-a777-3457e071298c None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:49.240280 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00393f7b-faa0-4a0f-a777-3457e071298c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:49.240691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00393f7b-faa0-4a0f-a777-3457e071298c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:49.282134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-00393f7b-faa0-4a0f-a777-3457e071298c None None] MFA Rules not processed for user `cb5021b569db41a08218cbec928442af`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:42:49.284301 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-00393f7b-faa0-4a0f-a777-3457e071298c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:42:49.379934 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1157/2319] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 14:42:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:42:49.397019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd18b3e-8651-4c90-8543-371a610f5805 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:42:49.399423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-edd18b3e-8651-4c90-8543-371a610f5805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:42:49.420325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd18b3e-8651-4c90-8543-371a610f5805 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:42:49.424130 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d18044-7c62-44b3-aa9e-11a0cbda936a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:42:49.425129 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d18044-7c62-44b3-aa9e-11a0cbda936a service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:49.425129 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d18044-7c62-44b3-aa9e-11a0cbda936a service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:49.428503 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d18044-7c62-44b3-aa9e-11a0cbda936a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:49.449538 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d18044-7c62-44b3-aa9e-11a0cbda936a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:42:49.451152 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d18044-7c62-44b3-aa9e-11a0cbda936a service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:42:49.466046 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1163/2320] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:42:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:42:49.608507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd075b3-0d2b-4b6f-894c-5108011c2df5 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:49.608950 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd075b3-0d2b-4b6f-894c-5108011c2df5 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:49.609543 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd075b3-0d2b-4b6f-894c-5108011c2df5 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:49.611650 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1158/2321] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 14:42:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:42:49.621594 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e56b7-1cdf-4539-b2a7-455cf54fc254 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:49.630031 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e56b7-1cdf-4539-b2a7-455cf54fc254 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:49.630031 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e56b7-1cdf-4539-b2a7-455cf54fc254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:49.659009 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-007e56b7-1cdf-4539-b2a7-455cf54fc254 None None] MFA Rules not processed for user `8d099678d6454f7eb494892a69feaf62`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:42:49.660300 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-007e56b7-1cdf-4539-b2a7-455cf54fc254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:42:49.673045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1164/2322] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 14:42:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:42:49.688238 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd075b3-0d2b-4b6f-894c-5108011c2df5 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:42:49.709344 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd075b3-0d2b-4b6f-894c-5108011c2df5 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:42:49.720521 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d1f41-cfbf-428b-9c43-0211d2a7a792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:42:49.721230 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d1f41-cfbf-428b-9c43-0211d2a7a792 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:49.721696 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d1f41-cfbf-428b-9c43-0211d2a7a792 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:49.722199 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d1f41-cfbf-428b-9c43-0211d2a7a792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:49.742793 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d1f41-cfbf-428b-9c43-0211d2a7a792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:42:49.744783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d1f41-cfbf-428b-9c43-0211d2a7a792 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:42:49.767557 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1159/2323] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:42:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:42:52.499267 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e56b7-1cdf-4539-b2a7-455cf54fc254 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:42:52.500758 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-007e56b7-1cdf-4539-b2a7-455cf54fc254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:42:52.515590 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e56b7-1cdf-4539-b2a7-455cf54fc254 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:42:52.520997 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75cd5b7-ff2f-41c4-a30d-ab6c75b70415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:42:52.522110 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cd5b7-ff2f-41c4-a30d-ab6c75b70415 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:52.522485 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cd5b7-ff2f-41c4-a30d-ab6c75b70415 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:52.522855 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cd5b7-ff2f-41c4-a30d-ab6c75b70415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:52.525509 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e75cd5b7-ff2f-41c4-a30d-ab6c75b70415 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:42:52.549681 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75cd5b7-ff2f-41c4-a30d-ab6c75b70415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:42:52.553303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75cd5b7-ff2f-41c4-a30d-ab6c75b70415 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:42:52.576115 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1165/2324] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:42:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:42:53.848278 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d1f41-cfbf-428b-9c43-0211d2a7a792 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:42:53.863921 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d1f41-cfbf-428b-9c43-0211d2a7a792 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:42:53.869432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff6ee5-c77a-4ddb-83b4-ce34f8ddb4f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:42:53.871004 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff6ee5-c77a-4ddb-83b4-ce34f8ddb4f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:53.871474 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff6ee5-c77a-4ddb-83b4-ce34f8ddb4f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:53.871773 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff6ee5-c77a-4ddb-83b4-ce34f8ddb4f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:53.874791 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-12ff6ee5-c77a-4ddb-83b4-ce34f8ddb4f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:42:53.899054 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff6ee5-c77a-4ddb-83b4-ce34f8ddb4f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:42:53.900995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff6ee5-c77a-4ddb-83b4-ce34f8ddb4f7 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:42:53.915349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1160/2325] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:42:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:42:54.399569 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f11425-7c0e-4457-bd99-3ca426b35e04 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:54.400405 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f11425-7c0e-4457-bd99-3ca426b35e04 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:54.400405 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f11425-7c0e-4457-bd99-3ca426b35e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:54.424404 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f8f11425-7c0e-4457-bd99-3ca426b35e04 None None] MFA Rules not processed for user `477ab357d285415e8c0c82d414d242ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:42:54.425669 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f8f11425-7c0e-4457-bd99-3ca426b35e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:42:54.443010 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1166/2326] 10.222.0.65 () {58 vars in 967 bytes} [Wed Aug 24 14:42:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:42:54.461502 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff6ee5-c77a-4ddb-83b4-ce34f8ddb4f7 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:42:54.483823 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff6ee5-c77a-4ddb-83b4-ce34f8ddb4f7 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:42:54.491748 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae52848-148e-49a3-9220-8f7b4fad5b09 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b3c32ecfdcf40629f09a7f52b2b5fa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:42:54.492781 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae52848-148e-49a3-9220-8f7b4fad5b09 service swift] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:54.492886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae52848-148e-49a3-9220-8f7b4fad5b09 service swift] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:54.493162 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae52848-148e-49a3-9220-8f7b4fad5b09 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:54.503244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae52848-148e-49a3-9220-8f7b4fad5b09 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:42:54.504853 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae52848-148e-49a3-9220-8f7b4fad5b09 service swift] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:42:54.518101 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1161/2327] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 14:42:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 14:42:55.078507 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603a8e8-a083-4c70-9b11-9d9d880148b7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:55.078964 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603a8e8-a083-4c70-9b11-9d9d880148b7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:55.079336 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603a8e8-a083-4c70-9b11-9d9d880148b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:55.099965 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-1603a8e8-a083-4c70-9b11-9d9d880148b7 None None] MFA Rules not processed for user `477ab357d285415e8c0c82d414d242ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:42:55.101242 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1603a8e8-a083-4c70-9b11-9d9d880148b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:42:55.109986 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1167/2328] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 14:42:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:42:55.122857 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae52848-148e-49a3-9220-8f7b4fad5b09 service swift] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:42:55.134021 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae52848-148e-49a3-9220-8f7b4fad5b09 service swift] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:42:55.140068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501a705-8c72-475f-bcf3-8136d7bf41dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b3c32ecfdcf40629f09a7f52b2b5fa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:42:55.140687 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501a705-8c72-475f-bcf3-8136d7bf41dd service swift] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:55.140966 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501a705-8c72-475f-bcf3-8136d7bf41dd service swift] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:55.141241 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501a705-8c72-475f-bcf3-8136d7bf41dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:55.150855 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501a705-8c72-475f-bcf3-8136d7bf41dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:42:55.153171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501a705-8c72-475f-bcf3-8136d7bf41dd service swift] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:42:55.163224 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1162/2329] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 14:42:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 14:42:59.593475 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603a8e8-a083-4c70-9b11-9d9d880148b7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:42:59.596608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1603a8e8-a083-4c70-9b11-9d9d880148b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:42:59.697443 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603a8e8-a083-4c70-9b11-9d9d880148b7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:42:59.702829 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8583aed-bc37-4c72-bdc1-c9423c7723d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:42:59.706257 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8583aed-bc37-4c72-bdc1-c9423c7723d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:42:59.706257 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8583aed-bc37-4c72-bdc1-c9423c7723d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:42:59.706257 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8583aed-bc37-4c72-bdc1-c9423c7723d2 admin admin] PATH_INFO: `/v3/users/a902794de84d477e890e0e6a861c102d` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:42:59.706257 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8583aed-bc37-4c72-bdc1-c9423c7723d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a902794de84d477e890e0e6a861c102d)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:42:59.707724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8583aed-bc37-4c72-bdc1-c9423c7723d2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:43:00.522567 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e8583aed-bc37-4c72-bdc1-c9423c7723d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a902794de84d477e890e0e6a861c102d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:43:00.523611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e8583aed-bc37-4c72-bdc1-c9423c7723d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a902794de84d477e890e0e6a861c102d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:43:00.524435 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e8583aed-bc37-4c72-bdc1-c9423c7723d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a902794de84d477e890e0e6a861c102d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:43:00.527347 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:00.556768 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e8583aed-bc37-4c72-bdc1-c9423c7723d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a902794de84d477e890e0e6a861c102d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:43:00.712234 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e8583aed-bc37-4c72-bdc1-c9423c7723d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a902794de84d477e890e0e6a861c102d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:43:00.727930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1168/2330] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:42:59 2022] DELETE /identity/v3/users/a902794de84d477e890e0e6a861c102d => generated 0 bytes in 1136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:43:01.210720 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501a705-8c72-475f-bcf3-8136d7bf41dd service swift] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:43:01.228422 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501a705-8c72-475f-bcf3-8136d7bf41dd service swift] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:43:01.340609 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9bf9b-872d-4787-bffb-b7fda3809cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:43:01.343345 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9bf9b-872d-4787-bffb-b7fda3809cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:43:01.343742 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9bf9b-872d-4787-bffb-b7fda3809cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:43:01.344018 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9bf9b-872d-4787-bffb-b7fda3809cd1 admin admin] PATH_INFO: `/v3/projects/f69f30ea5d3642c28a38c6f75c8bb57b` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:43:01.345269 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9bf9b-872d-4787-bffb-b7fda3809cd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f69f30ea5d3642c28a38c6f75c8bb57b)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:43:01.347339 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9bf9b-872d-4787-bffb-b7fda3809cd1 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:43:01.349308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:01.501876 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-27d9bf9b-872d-4787-bffb-b7fda3809cd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'request_id': 'req-27d9bf9b-872d-4787-bffb-b7fda3809cd1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:43:01.596646 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-27d9bf9b-872d-4787-bffb-b7fda3809cd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'request_id': 'req-27d9bf9b-872d-4787-bffb-b7fda3809cd1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:43:01.607173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-27d9bf9b-872d-4787-bffb-b7fda3809cd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'request_id': 'req-27d9bf9b-872d-4787-bffb-b7fda3809cd1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:43:01.621553 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-27d9bf9b-872d-4787-bffb-b7fda3809cd1 admin admin] The token cache is being invalidate because project f69f30ea5d3642c28a38c6f75c8bb57b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:43:01.621905 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-27d9bf9b-872d-4787-bffb-b7fda3809cd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:43:01.622581 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-27d9bf9b-872d-4787-bffb-b7fda3809cd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:43:01.624416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1163/2331] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:43:01 2022] DELETE /identity/v3/projects/f69f30ea5d3642c28a38c6f75c8bb57b => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:43:01.632011 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8778bc-edb1-4848-9418-79c72aa0264d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:43:01.632815 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8778bc-edb1-4848-9418-79c72aa0264d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:43:01.633631 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8778bc-edb1-4848-9418-79c72aa0264d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:43:01.664142 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-3a8778bc-edb1-4848-9418-79c72aa0264d None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:43:01.664883 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3a8778bc-edb1-4848-9418-79c72aa0264d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:43:01.780846 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1169/2332] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:43:01.789185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdc8bf-2eb4-4a4d-89ee-48251a9ea534 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:43:01.797187 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdc8bf-2eb4-4a4d-89ee-48251a9ea534 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:43:01.797187 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdc8bf-2eb4-4a4d-89ee-48251a9ea534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:43:01.825251 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-54cdc8bf-2eb4-4a4d-89ee-48251a9ea534 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:43:01.836992 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-54cdc8bf-2eb4-4a4d-89ee-48251a9ea534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:43:01.859068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1164/2333] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:43:01.866096 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8778bc-edb1-4848-9418-79c72aa0264d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:43:01.893324 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8778bc-edb1-4848-9418-79c72aa0264d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:43:01.906373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6328582-50a9-4796-9e95-886c99a71b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:43:01.907370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6328582-50a9-4796-9e95-886c99a71b25 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:43:01.907661 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6328582-50a9-4796-9e95-886c99a71b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:43:01.907943 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6328582-50a9-4796-9e95-886c99a71b25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:43:01.908738 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6328582-50a9-4796-9e95-886c99a71b25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:43:01.909047 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6328582-50a9-4796-9e95-886c99a71b25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:43:01.910955 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6328582-50a9-4796-9e95-886c99a71b25 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:43:01.933490 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1170/2334] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:43:01.938490 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdc8bf-2eb4-4a4d-89ee-48251a9ea534 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:43:01.968043 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdc8bf-2eb4-4a4d-89ee-48251a9ea534 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:43:01.978475 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e600e9-2432-4707-a039-2ac562b8dc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:43:01.980278 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e600e9-2432-4707-a039-2ac562b8dc33 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:43:01.981072 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e600e9-2432-4707-a039-2ac562b8dc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:43:01.981405 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e600e9-2432-4707-a039-2ac562b8dc33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:43:01.982422 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e600e9-2432-4707-a039-2ac562b8dc33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:43:01.986270 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e600e9-2432-4707-a039-2ac562b8dc33 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:43:02.109678 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1165/2335] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:43:01 2022] POST /identity/v3/projects => generated 381 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:43:02.114731 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6328582-50a9-4796-9e95-886c99a71b25 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:43:02.126928 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6328582-50a9-4796-9e95-886c99a71b25 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:43:02.249332 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57e7ea-17be-4a3c-a4f2-384f15fdf2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:43:02.250907 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57e7ea-17be-4a3c-a4f2-384f15fdf2e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:43:02.251397 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57e7ea-17be-4a3c-a4f2-384f15fdf2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:43:02.251899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57e7ea-17be-4a3c-a4f2-384f15fdf2e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:43:02.253172 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57e7ea-17be-4a3c-a4f2-384f15fdf2e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:43:02.264370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57e7ea-17be-4a3c-a4f2-384f15fdf2e8 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:43:02.717828 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1171/2336] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:43:02 2022] POST /identity/v3/users => generated 291 bytes in 604 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:43:02.723486 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e600e9-2432-4707-a039-2ac562b8dc33 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:43:02.734232 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e600e9-2432-4707-a039-2ac562b8dc33 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:43:02.752229 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37358bc2-d388-4ea9-9b16-196536307c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:43:02.752579 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37358bc2-d388-4ea9-9b16-196536307c8c admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:43:02.753014 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37358bc2-d388-4ea9-9b16-196536307c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:43:02.753014 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37358bc2-d388-4ea9-9b16-196536307c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:43:02.753873 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37358bc2-d388-4ea9-9b16-196536307c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:43:02.755444 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37358bc2-d388-4ea9-9b16-196536307c8c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:43:02.772241 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57e7ea-17be-4a3c-a4f2-384f15fdf2e8 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:43:02.782280 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1166/2337] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:43:02.787169 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57e7ea-17be-4a3c-a4f2-384f15fdf2e8 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:43:02.793394 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09eb828-95be-4b3b-8272-a7e194364bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:43:02.794200 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09eb828-95be-4b3b-8272-a7e194364bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:43:02.794481 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09eb828-95be-4b3b-8272-a7e194364bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:43:02.794834 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09eb828-95be-4b3b-8272-a7e194364bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:43:02.795576 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09eb828-95be-4b3b-8272-a7e194364bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:43:02.797228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09eb828-95be-4b3b-8272-a7e194364bd5 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:43:02.818809 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37358bc2-d388-4ea9-9b16-196536307c8c admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:43:02.819930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1172/2338] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:43:02.833259 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37358bc2-d388-4ea9-9b16-196536307c8c admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:43:02.839139 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe4f13-b444-4e61-a36c-c2093a097ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:43:02.839833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe4f13-b444-4e61-a36c-c2093a097ffa admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:43:02.840113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe4f13-b444-4e61-a36c-c2093a097ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:43:02.840414 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe4f13-b444-4e61-a36c-c2093a097ffa admin admin] PATH_INFO: `/v3/projects/5ef660ba9b3f42a7aa15458d0a70eb25/users/565cb12d581c4cc5939ca955b07ae842/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:43:02.860906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe4f13-b444-4e61-a36c-c2093a097ffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ef660ba9b3f42a7aa15458d0a70eb25, user_id=565cb12d581c4cc5939ca955b07ae842, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:43:02.863724 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe4f13-b444-4e61-a36c-c2093a097ffa admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:43:02.969011 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1167/2339] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:43:02 2022] PUT /identity/v3/projects/5ef660ba9b3f42a7aa15458d0a70eb25/users/565cb12d581c4cc5939ca955b07ae842/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:43:02.969946 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fae0e-1165-4e2e-9e7d-8aa2cfbe2148 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:43:02.969946 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fae0e-1165-4e2e-9e7d-8aa2cfbe2148 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:43:02.969946 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fae0e-1165-4e2e-9e7d-8aa2cfbe2148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:43:03.010058 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-dc2fae0e-1165-4e2e-9e7d-8aa2cfbe2148 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:43:03.013515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-dc2fae0e-1165-4e2e-9e7d-8aa2cfbe2148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:43:03.071358 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:03.137787 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1173/2340] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:43:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:43:03.149696 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe4f13-b444-4e61-a36c-c2093a097ffa admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:43:03.153514 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4cfe4f13-b444-4e61-a36c-c2093a097ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:43:03.270182 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe4f13-b444-4e61-a36c-c2093a097ffa admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:43:03.275730 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f45d8e-27e5-47fb-918d-a9597894f8d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:43:03.276424 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f45d8e-27e5-47fb-918d-a9597894f8d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:43:03.276952 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f45d8e-27e5-47fb-918d-a9597894f8d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:43:03.277233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f45d8e-27e5-47fb-918d-a9597894f8d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:43:03.288051 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f45d8e-27e5-47fb-918d-a9597894f8d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:43:03.289616 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f45d8e-27e5-47fb-918d-a9597894f8d7 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:43:03.300347 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1168/2341] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:43:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:43:04.332888 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fae0e-1165-4e2e-9e7d-8aa2cfbe2148 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:43:04.334600 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-dc2fae0e-1165-4e2e-9e7d-8aa2cfbe2148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:43:04.355007 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fae0e-1165-4e2e-9e7d-8aa2cfbe2148 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:43:04.362171 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8608881-f1a3-4ea3-b036-00a1751593e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:43:04.363223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8608881-f1a3-4ea3-b036-00a1751593e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:43:04.363795 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8608881-f1a3-4ea3-b036-00a1751593e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:43:04.364165 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8608881-f1a3-4ea3-b036-00a1751593e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:43:04.366297 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c8608881-f1a3-4ea3-b036-00a1751593e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:43:04.485836 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8608881-f1a3-4ea3-b036-00a1751593e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:43:04.487250 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8608881-f1a3-4ea3-b036-00a1751593e0 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:43:04.501358 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1174/2342] 10.222.0.65 () {60 vars in 1396 bytes} [Wed Aug 24 14:43:04 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3264 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:43:05.096418 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f998d9c-f5a1-4958-911a-20941ef171e0 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:43:05.097053 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f998d9c-f5a1-4958-911a-20941ef171e0 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:43:05.097681 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f998d9c-f5a1-4958-911a-20941ef171e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:43:05.152216 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-4f998d9c-f5a1-4958-911a-20941ef171e0 None None] MFA Rules not processed for user `565cb12d581c4cc5939ca955b07ae842`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:43:05.153595 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4f998d9c-f5a1-4958-911a-20941ef171e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:43:05.175457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:05.315118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1169/2343] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:43:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:43:05.315292 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8608881-f1a3-4ea3-b036-00a1751593e0 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:43:05.316479 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c8608881-f1a3-4ea3-b036-00a1751593e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:43:05.413661 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8608881-f1a3-4ea3-b036-00a1751593e0 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:43:05.418208 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa84112-3340-45e3-8441-e81e3ab91980 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:43:05.418825 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa84112-3340-45e3-8441-e81e3ab91980 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:43:05.419137 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa84112-3340-45e3-8441-e81e3ab91980 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:43:05.419409 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa84112-3340-45e3-8441-e81e3ab91980 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:43:05.429694 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa84112-3340-45e3-8441-e81e3ab91980 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:43:05.433132 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa84112-3340-45e3-8441-e81e3ab91980 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:43:05.451193 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1175/2344] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:43:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:43:08.802667 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e915b6d-95e4-44b4-adc2-cd1e42065286 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:43:08.803290 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e915b6d-95e4-44b4-adc2-cd1e42065286 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:43:08.803290 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e915b6d-95e4-44b4-adc2-cd1e42065286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:43:08.823645 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-1e915b6d-95e4-44b4-adc2-cd1e42065286 None None] MFA Rules not processed for user `565cb12d581c4cc5939ca955b07ae842`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:43:08.825494 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1e915b6d-95e4-44b4-adc2-cd1e42065286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:43:08.832943 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1170/2345] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:43:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:43:09.084728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa84112-3340-45e3-8441-e81e3ab91980 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:43:09.097213 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa84112-3340-45e3-8441-e81e3ab91980 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:43:09.101512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84c369-571d-40c5-b429-33b3594dedce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:43:09.102161 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84c369-571d-40c5-b429-33b3594dedce service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:43:09.102506 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84c369-571d-40c5-b429-33b3594dedce service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:43:09.102704 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84c369-571d-40c5-b429-33b3594dedce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:43:09.104778 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3a84c369-571d-40c5-b429-33b3594dedce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:43:09.116120 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84c369-571d-40c5-b429-33b3594dedce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:43:09.122652 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84c369-571d-40c5-b429-33b3594dedce service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:43:09.125926 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1176/2346] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:43:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:43:09.684197 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e915b6d-95e4-44b4-adc2-cd1e42065286 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:43:09.685686 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1e915b6d-95e4-44b4-adc2-cd1e42065286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:43:09.770736 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e915b6d-95e4-44b4-adc2-cd1e42065286 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:43:09.776391 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a1b40-1887-4a0f-a35e-fe9c4c3e93fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63253cd786c04d6a9d099773198aee36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:43:09.777082 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a1b40-1887-4a0f-a35e-fe9c4c3e93fc service placement] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:43:09.777418 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a1b40-1887-4a0f-a35e-fe9c4c3e93fc service placement] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:43:09.777703 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a1b40-1887-4a0f-a35e-fe9c4c3e93fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:43:09.779683 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a38a1b40-1887-4a0f-a35e-fe9c4c3e93fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:43:09.793501 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a1b40-1887-4a0f-a35e-fe9c4c3e93fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:43:09.795350 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a1b40-1887-4a0f-a35e-fe9c4c3e93fc service placement] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:43:09.806371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1171/2347] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:43:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:43:19.122000 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=73 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:19.801630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=54 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:23.598498 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84c369-571d-40c5-b429-33b3594dedce service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:43:23.611287 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84c369-571d-40c5-b429-33b3594dedce service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:43:23.617399 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb8199-6996-4b84-a937-46c0ac71653d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:43:23.618250 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb8199-6996-4b84-a937-46c0ac71653d service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:43:23.618693 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb8199-6996-4b84-a937-46c0ac71653d service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:43:23.619169 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb8199-6996-4b84-a937-46c0ac71653d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:43:23.622691 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b0bb8199-6996-4b84-a937-46c0ac71653d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:43:23.639431 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb8199-6996-4b84-a937-46c0ac71653d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:43:23.642029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb8199-6996-4b84-a937-46c0ac71653d service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:43:23.656469 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1177/2348] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:43:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:43:29.169771 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4ed46-e35c-4842-bee5-1fe57fde7d2d None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:43:29.170323 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4ed46-e35c-4842-bee5-1fe57fde7d2d None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:43:29.170323 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4ed46-e35c-4842-bee5-1fe57fde7d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:43:29.193300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a5c4ed46-e35c-4842-bee5-1fe57fde7d2d None None] MFA Rules not processed for user `477ab357d285415e8c0c82d414d242ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:43:29.194556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a5c4ed46-e35c-4842-bee5-1fe57fde7d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:43:29.286162 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1172/2349] 10.222.0.65 () {58 vars in 967 bytes} [Wed Aug 24 14:43:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:43:29.314899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb8199-6996-4b84-a937-46c0ac71653d service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:43:29.316663 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b0bb8199-6996-4b84-a937-46c0ac71653d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:43:29.409448 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb8199-6996-4b84-a937-46c0ac71653d service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:43:29.419065 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312057ec-8b47-41a3-8345-acfb7706c51c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b3c32ecfdcf40629f09a7f52b2b5fa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:43:29.419388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312057ec-8b47-41a3-8345-acfb7706c51c service swift] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:43:29.419893 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312057ec-8b47-41a3-8345-acfb7706c51c service swift] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:43:29.420393 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312057ec-8b47-41a3-8345-acfb7706c51c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:43:29.431769 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312057ec-8b47-41a3-8345-acfb7706c51c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:43:29.433733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312057ec-8b47-41a3-8345-acfb7706c51c service swift] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:43:29.442996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1178/2350] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 14:43:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 14:43:35.242653 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4ed46-e35c-4842-bee5-1fe57fde7d2d None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:43:35.244849 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a5c4ed46-e35c-4842-bee5-1fe57fde7d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:43:35.347276 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4ed46-e35c-4842-bee5-1fe57fde7d2d None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:43:35.359787 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa39a0-7713-4ca5-b26c-8f5d139745d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:43:35.360624 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa39a0-7713-4ca5-b26c-8f5d139745d3 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:43:35.360993 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa39a0-7713-4ca5-b26c-8f5d139745d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:43:35.361278 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa39a0-7713-4ca5-b26c-8f5d139745d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:43:35.363228 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-85fa39a0-7713-4ca5-b26c-8f5d139745d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:43:35.436635 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa39a0-7713-4ca5-b26c-8f5d139745d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:43:35.438316 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa39a0-7713-4ca5-b26c-8f5d139745d3 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:43:35.449539 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1173/2351] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:43:35 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:43:39.439208 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=38 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:45.443856 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=81 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:03.077884 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210cb55-2832-48b7-91df-1f7f827b0f24 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:44:03.078806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210cb55-2832-48b7-91df-1f7f827b0f24 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:44:03.078806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210cb55-2832-48b7-91df-1f7f827b0f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:44:03.098467 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d210cb55-2832-48b7-91df-1f7f827b0f24 None None] MFA Rules not processed for user `3acc0010e3f54283934b75f58bb6ec93`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:44:03.099837 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d210cb55-2832-48b7-91df-1f7f827b0f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:44:03.109288 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1179/2352] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:44:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:44:13.092561 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:13.726414 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa39a0-7713-4ca5-b26c-8f5d139745d3 service nova] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:44:13.729281 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-85fa39a0-7713-4ca5-b26c-8f5d139745d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:44:13.746066 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa39a0-7713-4ca5-b26c-8f5d139745d3 service nova] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:44:13.756172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd6544-d332-4f4b-9ad7-4f37410c9fd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:44:13.756809 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd6544-d332-4f4b-9ad7-4f37410c9fd3 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:44:13.757095 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd6544-d332-4f4b-9ad7-4f37410c9fd3 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:44:13.757366 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd6544-d332-4f4b-9ad7-4f37410c9fd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:44:13.759422 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-98cd6544-d332-4f4b-9ad7-4f37410c9fd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:44:13.772329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd6544-d332-4f4b-9ad7-4f37410c9fd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:44:13.775131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd6544-d332-4f4b-9ad7-4f37410c9fd3 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:44:13.793530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1174/2353] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:44:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:44:16.663042 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210cb55-2832-48b7-91df-1f7f827b0f24 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:44:16.677444 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210cb55-2832-48b7-91df-1f7f827b0f24 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:44:16.684288 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335a7df-0f8a-4765-915b-cf918feed64c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:44:16.684897 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335a7df-0f8a-4765-915b-cf918feed64c service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:44:16.685174 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335a7df-0f8a-4765-915b-cf918feed64c service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:44:16.685443 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335a7df-0f8a-4765-915b-cf918feed64c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:44:16.687275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c335a7df-0f8a-4765-915b-cf918feed64c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:44:16.757415 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335a7df-0f8a-4765-915b-cf918feed64c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:44:16.760211 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335a7df-0f8a-4765-915b-cf918feed64c service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:44:16.772349 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1180/2354] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:44:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:44:23.786848 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=6 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:26.765836 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=28 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:50.219496 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8c7bf-6083-4bbe-9dd3-5d69be3b1b19 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:44:50.220261 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8c7bf-6083-4bbe-9dd3-5d69be3b1b19 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:44:50.220261 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8c7bf-6083-4bbe-9dd3-5d69be3b1b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:44:50.244739 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-82c8c7bf-6083-4bbe-9dd3-5d69be3b1b19 None None] MFA Rules not processed for user `565cb12d581c4cc5939ca955b07ae842`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:44:50.246265 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-82c8c7bf-6083-4bbe-9dd3-5d69be3b1b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:44:50.254562 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1175/2355] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:44:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:44:56.972647 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335a7df-0f8a-4765-915b-cf918feed64c service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:44:56.985175 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335a7df-0f8a-4765-915b-cf918feed64c service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:44:56.991025 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49fc21-0aec-4fdb-a23e-ade7488cf50f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:44:56.991629 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49fc21-0aec-4fdb-a23e-ade7488cf50f service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:44:56.991902 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49fc21-0aec-4fdb-a23e-ade7488cf50f service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:44:56.992169 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49fc21-0aec-4fdb-a23e-ade7488cf50f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:44:56.994213 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2b49fc21-0aec-4fdb-a23e-ade7488cf50f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:44:57.055612 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49fc21-0aec-4fdb-a23e-ade7488cf50f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:44:57.057494 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49fc21-0aec-4fdb-a23e-ade7488cf50f service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:44:57.070692 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1181/2356] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:44:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:45:00.237911 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:04.182992 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8c7bf-6083-4bbe-9dd3-5d69be3b1b19 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:45:04.198437 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8c7bf-6083-4bbe-9dd3-5d69be3b1b19 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:45:04.204564 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bf3c0-2b41-433c-bf43-8c471cc48724 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:45:04.205229 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bf3c0-2b41-433c-bf43-8c471cc48724 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:45:04.205522 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bf3c0-2b41-433c-bf43-8c471cc48724 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:45:04.205889 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bf3c0-2b41-433c-bf43-8c471cc48724 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:45:04.207687 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-7d0bf3c0-2b41-433c-bf43-8c471cc48724 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:45:04.227243 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0bf3c0-2b41-433c-bf43-8c471cc48724 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:45:04.232385 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0bf3c0-2b41-433c-bf43-8c471cc48724 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:45:04.249553 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1176/2357] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:45:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:45:05.944343 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7727b-4b8b-4a2b-9b28-7172474bde8e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:45:05.945355 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7727b-4b8b-4a2b-9b28-7172474bde8e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:45:05.945355 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7727b-4b8b-4a2b-9b28-7172474bde8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:45:05.971920 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-71c7727b-4b8b-4a2b-9b28-7172474bde8e None None] MFA Rules not processed for user `3b7c54ebd95f4b3eb396982d75615f23`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:45:05.973833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-71c7727b-4b8b-4a2b-9b28-7172474bde8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:45:05.982186 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1182/2358] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:45:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:45:06.387204 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bf3c0-2b41-433c-bf43-8c471cc48724 service nova] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:45:06.409649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bf3c0-2b41-433c-bf43-8c471cc48724 service nova] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:45:06.413678 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1f7df-86e1-4c5e-9409-633c45e4b3d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:45:06.414583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1f7df-86e1-4c5e-9409-633c45e4b3d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:45:06.414855 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1f7df-86e1-4c5e-9409-633c45e4b3d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:45:06.415310 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1f7df-86e1-4c5e-9409-633c45e4b3d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:45:06.420165 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-6dc1f7df-86e1-4c5e-9409-633c45e4b3d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:45:06.435374 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1f7df-86e1-4c5e-9409-633c45e4b3d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:45:06.436847 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1f7df-86e1-4c5e-9409-633c45e4b3d9 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:45:06.446700 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1177/2359] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:45:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:45:12.195261 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7727b-4b8b-4a2b-9b28-7172474bde8e None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:45:12.212952 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7727b-4b8b-4a2b-9b28-7172474bde8e None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:45:12.219571 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea9d34-af65-47ab-90dc-e8b365f28fa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:45:12.220188 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea9d34-af65-47ab-90dc-e8b365f28fa0 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:45:12.220487 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea9d34-af65-47ab-90dc-e8b365f28fa0 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:45:12.220763 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea9d34-af65-47ab-90dc-e8b365f28fa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:45:12.222791 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e4ea9d34-af65-47ab-90dc-e8b365f28fa0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:45:12.237134 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea9d34-af65-47ab-90dc-e8b365f28fa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:45:12.238911 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea9d34-af65-47ab-90dc-e8b365f28fa0 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:45:12.252469 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1183/2360] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:45:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:45:16.442342 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=12 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:22.246064 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=37 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:43.592640 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06542f0-6566-42a0-94c0-600b37c4b3fa None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:45:43.593271 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06542f0-6566-42a0-94c0-600b37c4b3fa None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:45:43.593271 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06542f0-6566-42a0-94c0-600b37c4b3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:45:43.615071 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-e06542f0-6566-42a0-94c0-600b37c4b3fa None None] MFA Rules not processed for user `fbdf19910c234794b8aeb480dba50d85`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:45:43.616219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e06542f0-6566-42a0-94c0-600b37c4b3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:45:43.624141 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1178/2361] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:45:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:45:53.609431 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:06.991034 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea9d34-af65-47ab-90dc-e8b365f28fa0 service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:07.090308 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea9d34-af65-47ab-90dc-e8b365f28fa0 service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:07.106859 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e351e72-e2c0-4c21-8ddb-8a12a48793f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63253cd786c04d6a9d099773198aee36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:07.107813 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e351e72-e2c0-4c21-8ddb-8a12a48793f1 service placement] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:07.108220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e351e72-e2c0-4c21-8ddb-8a12a48793f1 service placement] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:07.108716 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e351e72-e2c0-4c21-8ddb-8a12a48793f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:07.111726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6e351e72-e2c0-4c21-8ddb-8a12a48793f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:46:07.160958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e351e72-e2c0-4c21-8ddb-8a12a48793f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:07.165449 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e351e72-e2c0-4c21-8ddb-8a12a48793f1 service placement] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:07.176127 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1184/2362] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:46:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:46:15.075501 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06542f0-6566-42a0-94c0-600b37c4b3fa None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:15.111028 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06542f0-6566-42a0-94c0-600b37c4b3fa None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:15.116970 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8314e-409a-4076-95a3-8c8acf0f2217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:15.118659 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8314e-409a-4076-95a3-8c8acf0f2217 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:15.119210 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8314e-409a-4076-95a3-8c8acf0f2217 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:15.119633 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8314e-409a-4076-95a3-8c8acf0f2217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:15.122201 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-53f8314e-409a-4076-95a3-8c8acf0f2217 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:46:15.171362 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8314e-409a-4076-95a3-8c8acf0f2217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:15.172802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8314e-409a-4076-95a3-8c8acf0f2217 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:15.194404 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1179/2363] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:46:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:46:17.171379 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=36 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:17.804303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e351e72-e2c0-4c21-8ddb-8a12a48793f1 service placement] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:17.807203 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6e351e72-e2c0-4c21-8ddb-8a12a48793f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:46:17.843741 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e351e72-e2c0-4c21-8ddb-8a12a48793f1 service placement] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:17.858470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2bbf0-3cd7-4742-b773-c6c523f27b63 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63253cd786c04d6a9d099773198aee36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:17.865404 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2bbf0-3cd7-4742-b773-c6c523f27b63 service placement] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:17.869894 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2bbf0-3cd7-4742-b773-c6c523f27b63 service placement] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:17.869894 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2bbf0-3cd7-4742-b773-c6c523f27b63 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:17.870954 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e8e2bbf0-3cd7-4742-b773-c6c523f27b63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:46:17.895023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2bbf0-3cd7-4742-b773-c6c523f27b63 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:17.896784 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2bbf0-3cd7-4742-b773-c6c523f27b63 service placement] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:17.909103 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1185/2364] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:46:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:46:17.967723 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8314e-409a-4076-95a3-8c8acf0f2217 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:17.979433 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8314e-409a-4076-95a3-8c8acf0f2217 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:17.985652 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc5dee-17cf-4944-b9fc-554d687f035a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:17.986348 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc5dee-17cf-4944-b9fc-554d687f035a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:17.986629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc5dee-17cf-4944-b9fc-554d687f035a admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:17.986903 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc5dee-17cf-4944-b9fc-554d687f035a admin admin] PATH_INFO: `/v3/users/565cb12d581c4cc5939ca955b07ae842` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:17.988187 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc5dee-17cf-4944-b9fc-554d687f035a admin admin] RBAC: Authorizing `identity:delete_user(user_id=565cb12d581c4cc5939ca955b07ae842)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:17.990992 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc5dee-17cf-4944-b9fc-554d687f035a admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:18.305150 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-78dc5dee-17cf-4944-b9fc-554d687f035a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '565cb12d581c4cc5939ca955b07ae842'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:46:18.306697 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-78dc5dee-17cf-4944-b9fc-554d687f035a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '565cb12d581c4cc5939ca955b07ae842'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:46:18.332235 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-78dc5dee-17cf-4944-b9fc-554d687f035a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '565cb12d581c4cc5939ca955b07ae842'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:46:18.333362 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-78dc5dee-17cf-4944-b9fc-554d687f035a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '565cb12d581c4cc5939ca955b07ae842'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:46:18.422372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-78dc5dee-17cf-4944-b9fc-554d687f035a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '565cb12d581c4cc5939ca955b07ae842'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:46:18.445797 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1180/2365] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:46:17 2022] DELETE /identity/v3/users/565cb12d581c4cc5939ca955b07ae842 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:46:19.220005 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2bbf0-3cd7-4742-b773-c6c523f27b63 service placement] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:19.245338 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2bbf0-3cd7-4742-b773-c6c523f27b63 service placement] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:19.372669 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec249284-7d79-4924-9207-d61b698565fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:19.374108 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec249284-7d79-4924-9207-d61b698565fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:19.374630 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec249284-7d79-4924-9207-d61b698565fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:19.375113 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec249284-7d79-4924-9207-d61b698565fa admin admin] PATH_INFO: `/v3/projects/5ef660ba9b3f42a7aa15458d0a70eb25` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:19.377469 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec249284-7d79-4924-9207-d61b698565fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ef660ba9b3f42a7aa15458d0a70eb25)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:19.380911 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec249284-7d79-4924-9207-d61b698565fa admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:19.622263 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ec249284-7d79-4924-9207-d61b698565fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ef660ba9b3f42a7aa15458d0a70eb25', 'request_id': 'req-ec249284-7d79-4924-9207-d61b698565fa'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:46:19.749466 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ec249284-7d79-4924-9207-d61b698565fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ef660ba9b3f42a7aa15458d0a70eb25', 'request_id': 'req-ec249284-7d79-4924-9207-d61b698565fa'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:46:19.776420 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ec249284-7d79-4924-9207-d61b698565fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ef660ba9b3f42a7aa15458d0a70eb25', 'request_id': 'req-ec249284-7d79-4924-9207-d61b698565fa'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:46:19.791225 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ec249284-7d79-4924-9207-d61b698565fa admin admin] The token cache is being invalidate because project 5ef660ba9b3f42a7aa15458d0a70eb25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:46:19.791225 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ec249284-7d79-4924-9207-d61b698565fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:46:19.797482 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ec249284-7d79-4924-9207-d61b698565fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:46:19.797482 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1186/2366] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:46:19 2022] DELETE /identity/v3/projects/5ef660ba9b3f42a7aa15458d0a70eb25 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:46:19.799667 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61843e-b671-49fa-b754-3a5cb24c7fb6 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:19.800182 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61843e-b671-49fa-b754-3a5cb24c7fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:19.800297 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61843e-b671-49fa-b754-3a5cb24c7fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:19.886171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-4c61843e-b671-49fa-b754-3a5cb24c7fb6 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:46:19.887803 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4c61843e-b671-49fa-b754-3a5cb24c7fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:46:20.006956 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:20.042247 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1181/2367] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:46:20.055840 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e9208-7e13-45db-9036-3a2457e54c24 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:20.056265 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e9208-7e13-45db-9036-3a2457e54c24 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:20.056397 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e9208-7e13-45db-9036-3a2457e54c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:20.112766 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-904e9208-7e13-45db-9036-3a2457e54c24 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:46:20.114986 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-904e9208-7e13-45db-9036-3a2457e54c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:46:20.136731 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1187/2368] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:46:20.140961 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61843e-b671-49fa-b754-3a5cb24c7fb6 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:20.168897 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61843e-b671-49fa-b754-3a5cb24c7fb6 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:20.202877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6303d0d-88c7-440f-93ad-3f5be9d10b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:20.203728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6303d0d-88c7-440f-93ad-3f5be9d10b67 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:20.204245 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6303d0d-88c7-440f-93ad-3f5be9d10b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:20.204714 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6303d0d-88c7-440f-93ad-3f5be9d10b67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:20.205628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6303d0d-88c7-440f-93ad-3f5be9d10b67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:46:20.206133 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6303d0d-88c7-440f-93ad-3f5be9d10b67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:20.209048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6303d0d-88c7-440f-93ad-3f5be9d10b67 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:20.244898 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1182/2369] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:46:20.253541 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e9208-7e13-45db-9036-3a2457e54c24 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:20.297181 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e9208-7e13-45db-9036-3a2457e54c24 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:20.301591 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6303d0d-88c7-440f-93ad-3f5be9d10b67 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:20.301591 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f6303d0d-88c7-440f-93ad-3f5be9d10b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:46:20.306861 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b06dc-c76f-4fce-a0ac-198bd62d3a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:20.307872 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b06dc-c76f-4fce-a0ac-198bd62d3a20 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:20.308555 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b06dc-c76f-4fce-a0ac-198bd62d3a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:20.310264 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b06dc-c76f-4fce-a0ac-198bd62d3a20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:20.313869 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b06dc-c76f-4fce-a0ac-198bd62d3a20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:20.329344 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b06dc-c76f-4fce-a0ac-198bd62d3a20 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:20.440676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6303d0d-88c7-440f-93ad-3f5be9d10b67 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:20.447547 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4baf6be-2f21-4c44-a235-4fd2377f3957 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63253cd786c04d6a9d099773198aee36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:20.448600 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4baf6be-2f21-4c44-a235-4fd2377f3957 service placement] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:20.449096 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4baf6be-2f21-4c44-a235-4fd2377f3957 service placement] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:20.449581 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4baf6be-2f21-4c44-a235-4fd2377f3957 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:20.452494 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a4baf6be-2f21-4c44-a235-4fd2377f3957 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:46:20.467321 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4baf6be-2f21-4c44-a235-4fd2377f3957 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:20.469913 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4baf6be-2f21-4c44-a235-4fd2377f3957 service placement] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:20.489608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1183/2370] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:46:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:46:20.495758 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1188/2371] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:46:20 2022] POST /identity/v3/projects => generated 383 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:46:20.500831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4baf6be-2f21-4c44-a235-4fd2377f3957 service placement] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:20.521374 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4baf6be-2f21-4c44-a235-4fd2377f3957 service placement] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:20.573564 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b06dc-c76f-4fce-a0ac-198bd62d3a20 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:20.581692 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-221b06dc-c76f-4fce-a0ac-198bd62d3a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:46:20.654013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb448d82-6b42-47b6-81cb-aaa6c635f3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:20.655231 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb448d82-6b42-47b6-81cb-aaa6c635f3b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:20.655719 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb448d82-6b42-47b6-81cb-aaa6c635f3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:20.656372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb448d82-6b42-47b6-81cb-aaa6c635f3b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:20.657700 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb448d82-6b42-47b6-81cb-aaa6c635f3b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:20.661108 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb448d82-6b42-47b6-81cb-aaa6c635f3b9 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:20.692359 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:20.726427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b06dc-c76f-4fce-a0ac-198bd62d3a20 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:20.735915 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c35f4b-38e1-41e9-9b7b-cabe9ced7bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:20.737194 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c35f4b-38e1-41e9-9b7b-cabe9ced7bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:20.737791 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c35f4b-38e1-41e9-9b7b-cabe9ced7bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:20.738347 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c35f4b-38e1-41e9-9b7b-cabe9ced7bbf admin admin] PATH_INFO: `/v3/users/3acc0010e3f54283934b75f58bb6ec93` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:20.740793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c35f4b-38e1-41e9-9b7b-cabe9ced7bbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3acc0010e3f54283934b75f58bb6ec93)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:20.744611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c35f4b-38e1-41e9-9b7b-cabe9ced7bbf admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:20.793537 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1184/2372] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:46:20 2022] POST /identity/v3/users => generated 292 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:46:20.799034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb448d82-6b42-47b6-81cb-aaa6c635f3b9 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:20.813108 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb448d82-6b42-47b6-81cb-aaa6c635f3b9 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:20.821428 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11e1ff-853f-4af1-b30c-ebc5bc089d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:20.823801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11e1ff-853f-4af1-b30c-ebc5bc089d98 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:20.824306 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11e1ff-853f-4af1-b30c-ebc5bc089d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:20.824676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11e1ff-853f-4af1-b30c-ebc5bc089d98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:20.825873 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11e1ff-853f-4af1-b30c-ebc5bc089d98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:20.828172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11e1ff-853f-4af1-b30c-ebc5bc089d98 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:20.849272 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1185/2373] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:46:20.855016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11e1ff-853f-4af1-b30c-ebc5bc089d98 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:20.870587 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11e1ff-853f-4af1-b30c-ebc5bc089d98 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:20.876253 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1726d-4c4a-4c74-9d26-a369c8c45845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:20.877726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1726d-4c4a-4c74-9d26-a369c8c45845 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:20.878053 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1726d-4c4a-4c74-9d26-a369c8c45845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:20.878341 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1726d-4c4a-4c74-9d26-a369c8c45845 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:20.881923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1726d-4c4a-4c74-9d26-a369c8c45845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:20.881923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1726d-4c4a-4c74-9d26-a369c8c45845 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:20.901982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1186/2374] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:46:20.903492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1726d-4c4a-4c74-9d26-a369c8c45845 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:20.916174 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1726d-4c4a-4c74-9d26-a369c8c45845 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:20.923725 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de33bd9-f2d8-445d-ab32-49369ebc5111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:20.925529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de33bd9-f2d8-445d-ab32-49369ebc5111 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:20.925837 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de33bd9-f2d8-445d-ab32-49369ebc5111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:20.926109 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de33bd9-f2d8-445d-ab32-49369ebc5111 admin admin] PATH_INFO: `/v3/projects/1a8ff5bc8c6d4adaac8b73d5dfadfc31/users/cde1ea819e2d47e8b1a8ef5247bc61e0/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:20.951339 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de33bd9-f2d8-445d-ab32-49369ebc5111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a8ff5bc8c6d4adaac8b73d5dfadfc31, user_id=cde1ea819e2d47e8b1a8ef5247bc61e0, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:20.957006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de33bd9-f2d8-445d-ab32-49369ebc5111 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:21.037489 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-53c35f4b-38e1-41e9-9b7b-cabe9ced7bbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3acc0010e3f54283934b75f58bb6ec93'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:46:21.038572 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-53c35f4b-38e1-41e9-9b7b-cabe9ced7bbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3acc0010e3f54283934b75f58bb6ec93'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:46:21.040433 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-53c35f4b-38e1-41e9-9b7b-cabe9ced7bbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3acc0010e3f54283934b75f58bb6ec93'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:46:21.063550 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-53c35f4b-38e1-41e9-9b7b-cabe9ced7bbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3acc0010e3f54283934b75f58bb6ec93'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:46:21.173346 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-53c35f4b-38e1-41e9-9b7b-cabe9ced7bbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3acc0010e3f54283934b75f58bb6ec93'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:46:21.184587 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1187/2375] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:46:20 2022] PUT /identity/v3/projects/1a8ff5bc8c6d4adaac8b73d5dfadfc31/users/cde1ea819e2d47e8b1a8ef5247bc61e0/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:46:21.187019 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915374af-69f9-438a-8862-ce28c9ea999d None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:21.187561 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915374af-69f9-438a-8862-ce28c9ea999d None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:21.187971 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915374af-69f9-438a-8862-ce28c9ea999d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:21.211974 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1189/2376] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:46:20 2022] DELETE /identity/v3/users/3acc0010e3f54283934b75f58bb6ec93 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:46:21.217035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:21.228374 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-915374af-69f9-438a-8862-ce28c9ea999d None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:46:21.229865 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-915374af-69f9-438a-8862-ce28c9ea999d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:46:21.364404 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1188/2377] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:46:21.377952 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c35f4b-38e1-41e9-9b7b-cabe9ced7bbf admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:21.380765 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-53c35f4b-38e1-41e9-9b7b-cabe9ced7bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:46:21.562206 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c35f4b-38e1-41e9-9b7b-cabe9ced7bbf admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:21.569134 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eea732-99b6-4a38-9432-05a1b07a806d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:21.570031 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eea732-99b6-4a38-9432-05a1b07a806d service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:21.571277 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eea732-99b6-4a38-9432-05a1b07a806d service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:21.573236 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eea732-99b6-4a38-9432-05a1b07a806d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:21.583926 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eea732-99b6-4a38-9432-05a1b07a806d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:21.585419 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eea732-99b6-4a38-9432-05a1b07a806d service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:21.598118 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1190/2378] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:46:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:46:21.706027 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915374af-69f9-438a-8862-ce28c9ea999d None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:21.707798 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-915374af-69f9-438a-8862-ce28c9ea999d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:46:21.723059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915374af-69f9-438a-8862-ce28c9ea999d None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:21.729307 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46d43b-8eab-4c7e-8045-8f4f6ab4813f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:21.729994 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46d43b-8eab-4c7e-8045-8f4f6ab4813f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:21.730276 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46d43b-8eab-4c7e-8045-8f4f6ab4813f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:21.730638 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46d43b-8eab-4c7e-8045-8f4f6ab4813f admin admin] PATH_INFO: `/v3/projects/6c5abfb715e14ddf84e0b4519a3d724b` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:21.731902 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46d43b-8eab-4c7e-8045-8f4f6ab4813f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c5abfb715e14ddf84e0b4519a3d724b)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:21.733904 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46d43b-8eab-4c7e-8045-8f4f6ab4813f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:21.919765 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-bc46d43b-8eab-4c7e-8045-8f4f6ab4813f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c5abfb715e14ddf84e0b4519a3d724b', 'request_id': 'req-bc46d43b-8eab-4c7e-8045-8f4f6ab4813f'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:46:22.058916 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-bc46d43b-8eab-4c7e-8045-8f4f6ab4813f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c5abfb715e14ddf84e0b4519a3d724b', 'request_id': 'req-bc46d43b-8eab-4c7e-8045-8f4f6ab4813f'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:46:22.073620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-bc46d43b-8eab-4c7e-8045-8f4f6ab4813f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c5abfb715e14ddf84e0b4519a3d724b', 'request_id': 'req-bc46d43b-8eab-4c7e-8045-8f4f6ab4813f'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:46:22.086661 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-bc46d43b-8eab-4c7e-8045-8f4f6ab4813f admin admin] The token cache is being invalidate because project 6c5abfb715e14ddf84e0b4519a3d724b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:46:22.087170 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-bc46d43b-8eab-4c7e-8045-8f4f6ab4813f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:46:22.088001 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-bc46d43b-8eab-4c7e-8045-8f4f6ab4813f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:46:22.090166 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1189/2379] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:46:21 2022] DELETE /identity/v3/projects/6c5abfb715e14ddf84e0b4519a3d724b => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:46:22.100278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd45d65-8ac3-4c83-bc3f-04b8700a436b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:22.100278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd45d65-8ac3-4c83-bc3f-04b8700a436b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:22.100278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd45d65-8ac3-4c83-bc3f-04b8700a436b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:22.118236 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-bfd45d65-8ac3-4c83-bc3f-04b8700a436b None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:46:22.119381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-bfd45d65-8ac3-4c83-bc3f-04b8700a436b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:46:22.190731 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:22.202260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1191/2380] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:46:22.215847 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a3563-e90a-43c2-ae08-6e2789b44398 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:22.216358 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a3563-e90a-43c2-ae08-6e2789b44398 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:22.216839 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a3563-e90a-43c2-ae08-6e2789b44398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:22.248843 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-794a3563-e90a-43c2-ae08-6e2789b44398 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:46:22.251014 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-794a3563-e90a-43c2-ae08-6e2789b44398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:46:22.270366 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1190/2381] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:46:22.276634 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd45d65-8ac3-4c83-bc3f-04b8700a436b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:22.288713 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd45d65-8ac3-4c83-bc3f-04b8700a436b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:22.296654 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084b788-8a7a-4204-8648-2b4fa0ce25b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:22.297661 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084b788-8a7a-4204-8648-2b4fa0ce25b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:22.298181 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084b788-8a7a-4204-8648-2b4fa0ce25b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:22.298658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084b788-8a7a-4204-8648-2b4fa0ce25b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:22.299737 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084b788-8a7a-4204-8648-2b4fa0ce25b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:46:22.300110 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084b788-8a7a-4204-8648-2b4fa0ce25b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:22.302664 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084b788-8a7a-4204-8648-2b4fa0ce25b9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:22.327152 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1192/2382] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:46:22.332423 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a3563-e90a-43c2-ae08-6e2789b44398 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:22.346918 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a3563-e90a-43c2-ae08-6e2789b44398 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:22.353639 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4e0e1-1147-42a2-84b1-c4dc2fc452d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:22.354220 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4e0e1-1147-42a2-84b1-c4dc2fc452d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:22.354509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4e0e1-1147-42a2-84b1-c4dc2fc452d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:22.354805 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4e0e1-1147-42a2-84b1-c4dc2fc452d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:22.355412 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4e0e1-1147-42a2-84b1-c4dc2fc452d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:22.357341 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4e0e1-1147-42a2-84b1-c4dc2fc452d6 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:22.541816 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1191/2383] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:46:22 2022] POST /identity/v3/projects => generated 381 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:46:22.545275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084b788-8a7a-4204-8648-2b4fa0ce25b9 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:22.566996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084b788-8a7a-4204-8648-2b4fa0ce25b9 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:22.683936 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ddcbb-1e0f-4f18-9542-d6120614fe2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:22.686412 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ddcbb-1e0f-4f18-9542-d6120614fe2c admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:22.687872 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ddcbb-1e0f-4f18-9542-d6120614fe2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:22.688544 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ddcbb-1e0f-4f18-9542-d6120614fe2c admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:22.689911 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ddcbb-1e0f-4f18-9542-d6120614fe2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:22.693267 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ddcbb-1e0f-4f18-9542-d6120614fe2c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:22.810813 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1193/2384] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:46:22 2022] POST /identity/v3/users => generated 291 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:46:22.812111 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4e0e1-1147-42a2-84b1-c4dc2fc452d6 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:22.831582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4e0e1-1147-42a2-84b1-c4dc2fc452d6 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:22.839999 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e339b2-4589-4c45-9ab6-2acb1dbf0b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:22.841020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e339b2-4589-4c45-9ab6-2acb1dbf0b32 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:22.841507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e339b2-4589-4c45-9ab6-2acb1dbf0b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:22.842068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e339b2-4589-4c45-9ab6-2acb1dbf0b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:22.843194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e339b2-4589-4c45-9ab6-2acb1dbf0b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:22.846210 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e339b2-4589-4c45-9ab6-2acb1dbf0b32 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:22.868254 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1192/2385] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:46:22.873435 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ddcbb-1e0f-4f18-9542-d6120614fe2c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:22.886742 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ddcbb-1e0f-4f18-9542-d6120614fe2c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:22.894423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca16a1-8a95-4167-9ad1-9478477e95cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:22.894423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca16a1-8a95-4167-9ad1-9478477e95cc admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:22.894423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca16a1-8a95-4167-9ad1-9478477e95cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:22.894423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca16a1-8a95-4167-9ad1-9478477e95cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:22.895154 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca16a1-8a95-4167-9ad1-9478477e95cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:22.896425 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca16a1-8a95-4167-9ad1-9478477e95cc admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:22.910325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1194/2386] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:46:22.914856 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e339b2-4589-4c45-9ab6-2acb1dbf0b32 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:22.925816 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e339b2-4589-4c45-9ab6-2acb1dbf0b32 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:22.938131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84e32b-094f-4f98-8da9-8df05a575e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:22.939307 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84e32b-094f-4f98-8da9-8df05a575e9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:22.939504 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84e32b-094f-4f98-8da9-8df05a575e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:22.939852 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84e32b-094f-4f98-8da9-8df05a575e9e admin admin] PATH_INFO: `/v3/projects/13d426499b5b40818dca1573cb839b16/users/f88f7857e1d24bb0b038b7f6e98a6f34/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:22.967906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84e32b-094f-4f98-8da9-8df05a575e9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d426499b5b40818dca1573cb839b16, user_id=f88f7857e1d24bb0b038b7f6e98a6f34, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:22.970677 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84e32b-094f-4f98-8da9-8df05a575e9e admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:23.078138 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1193/2387] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:46:22 2022] PUT /identity/v3/projects/13d426499b5b40818dca1573cb839b16/users/f88f7857e1d24bb0b038b7f6e98a6f34/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:46:23.083488 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74e5a6-0218-48c3-a835-d3bbd70c32bc None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:23.083768 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74e5a6-0218-48c3-a835-d3bbd70c32bc None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:23.084852 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74e5a6-0218-48c3-a835-d3bbd70c32bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:23.108430 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-3a74e5a6-0218-48c3-a835-d3bbd70c32bc None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:46:23.111303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3a74e5a6-0218-48c3-a835-d3bbd70c32bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:46:23.213666 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1195/2388] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:46:23.225815 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84e32b-094f-4f98-8da9-8df05a575e9e admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:23.230041 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9c84e32b-094f-4f98-8da9-8df05a575e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:46:23.309354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:23.341719 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84e32b-094f-4f98-8da9-8df05a575e9e admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:23.346653 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9262a41-da21-4865-b2e7-8eca5e94252f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:23.347814 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9262a41-da21-4865-b2e7-8eca5e94252f service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:23.348213 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9262a41-da21-4865-b2e7-8eca5e94252f service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:23.348656 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9262a41-da21-4865-b2e7-8eca5e94252f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:23.372268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9262a41-da21-4865-b2e7-8eca5e94252f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:23.374409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9262a41-da21-4865-b2e7-8eca5e94252f service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:23.393060 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1194/2389] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:46:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:46:28.853931 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7cdcd-5bb6-47fa-9b14-4d826a2910c1 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:28.855311 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7cdcd-5bb6-47fa-9b14-4d826a2910c1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:28.855866 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7cdcd-5bb6-47fa-9b14-4d826a2910c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:28.909956 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-11c7cdcd-5bb6-47fa-9b14-4d826a2910c1 None None] MFA Rules not processed for user `556b3a886df740cda4a94e55d2fcc08a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:46:28.912153 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-11c7cdcd-5bb6-47fa-9b14-4d826a2910c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:46:29.066187 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1196/2390] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:46:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:46:30.183151 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66265245-e05e-42f1-88c3-e1767b1d4d61 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:30.183725 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66265245-e05e-42f1-88c3-e1767b1d4d61 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:30.183725 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66265245-e05e-42f1-88c3-e1767b1d4d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:30.218861 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-66265245-e05e-42f1-88c3-e1767b1d4d61 None None] MFA Rules not processed for user `cde1ea819e2d47e8b1a8ef5247bc61e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:46:30.220644 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-66265245-e05e-42f1-88c3-e1767b1d4d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:46:30.327395 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1195/2391] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:46:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:46:30.328323 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7cdcd-5bb6-47fa-9b14-4d826a2910c1 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:30.329924 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-11c7cdcd-5bb6-47fa-9b14-4d826a2910c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:46:30.348342 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7cdcd-5bb6-47fa-9b14-4d826a2910c1 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:30.354937 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd6d07-4c84-472e-bf86-b697b5daf78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:30.355983 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd6d07-4c84-472e-bf86-b697b5daf78b admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:30.356450 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd6d07-4c84-472e-bf86-b697b5daf78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:30.356933 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd6d07-4c84-472e-bf86-b697b5daf78b admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:30.357883 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd6d07-4c84-472e-bf86-b697b5daf78b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:30.360577 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd6d07-4c84-472e-bf86-b697b5daf78b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:30.372705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:30.540288 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1197/2392] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:46:30 2022] POST /identity/v3/projects => generated 385 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:46:30.544844 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66265245-e05e-42f1-88c3-e1767b1d4d61 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:30.562599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66265245-e05e-42f1-88c3-e1767b1d4d61 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:30.690728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71c42d-4bd5-49f5-8798-dc9ea3b36e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:30.691589 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71c42d-4bd5-49f5-8798-dc9ea3b36e5e admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:30.692019 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71c42d-4bd5-49f5-8798-dc9ea3b36e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:30.692410 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71c42d-4bd5-49f5-8798-dc9ea3b36e5e admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:30.693197 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71c42d-4bd5-49f5-8798-dc9ea3b36e5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:30.695722 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71c42d-4bd5-49f5-8798-dc9ea3b36e5e admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:30.834276 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1196/2393] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:46:30 2022] POST /identity/v3/users => generated 299 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:46:30.835596 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd6d07-4c84-472e-bf86-b697b5daf78b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:30.850311 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd6d07-4c84-472e-bf86-b697b5daf78b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:30.866554 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d07975-6d4e-4a19-82d0-bf69a47cda13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:30.868339 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d07975-6d4e-4a19-82d0-bf69a47cda13 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:30.868791 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d07975-6d4e-4a19-82d0-bf69a47cda13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:30.869229 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d07975-6d4e-4a19-82d0-bf69a47cda13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:30.870084 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d07975-6d4e-4a19-82d0-bf69a47cda13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:30.874087 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d07975-6d4e-4a19-82d0-bf69a47cda13 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:30.899983 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1198/2394] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:46:30.915787 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71c42d-4bd5-49f5-8798-dc9ea3b36e5e admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:30.933966 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71c42d-4bd5-49f5-8798-dc9ea3b36e5e admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:30.946083 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb186bac-8f0d-4624-bbe1-f131fc473446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:30.946649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb186bac-8f0d-4624-bbe1-f131fc473446 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:30.950713 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb186bac-8f0d-4624-bbe1-f131fc473446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:30.950713 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb186bac-8f0d-4624-bbe1-f131fc473446 admin admin] PATH_INFO: `/v3/projects/cff7650e371a42179e8256fb88d3529f/users/bf5cb506dd97465b9ac9b4765d663a04/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:30.975826 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb186bac-8f0d-4624-bbe1-f131fc473446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cff7650e371a42179e8256fb88d3529f, user_id=bf5cb506dd97465b9ac9b4765d663a04, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:30.980998 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb186bac-8f0d-4624-bbe1-f131fc473446 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:31.114890 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1197/2395] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:46:30 2022] PUT /identity/v3/projects/cff7650e371a42179e8256fb88d3529f/users/bf5cb506dd97465b9ac9b4765d663a04/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:46:31.119553 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d07975-6d4e-4a19-82d0-bf69a47cda13 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:31.141931 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d07975-6d4e-4a19-82d0-bf69a47cda13 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:31.325925 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7ce28-4a88-4e1c-8746-9f01f1989351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:31.327002 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7ce28-4a88-4e1c-8746-9f01f1989351 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:31.329089 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7ce28-4a88-4e1c-8746-9f01f1989351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:31.329668 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7ce28-4a88-4e1c-8746-9f01f1989351 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:31.333535 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a7ce28-4a88-4e1c-8746-9f01f1989351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:31.335677 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a7ce28-4a88-4e1c-8746-9f01f1989351 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:31.359038 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1199/2396] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:46:31.364043 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb186bac-8f0d-4624-bbe1-f131fc473446 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:31.395782 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb186bac-8f0d-4624-bbe1-f131fc473446 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:31.410660 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfc26c-b6ec-4358-8c0b-4410a3686ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:31.411679 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfc26c-b6ec-4358-8c0b-4410a3686ea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:31.412185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfc26c-b6ec-4358-8c0b-4410a3686ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:31.412650 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfc26c-b6ec-4358-8c0b-4410a3686ea0 admin admin] PATH_INFO: `/v3/projects/cff7650e371a42179e8256fb88d3529f/users/bf5cb506dd97465b9ac9b4765d663a04/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:31.416524 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bfc26c-b6ec-4358-8c0b-4410a3686ea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cff7650e371a42179e8256fb88d3529f, user_id=bf5cb506dd97465b9ac9b4765d663a04, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:31.420497 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bfc26c-b6ec-4358-8c0b-4410a3686ea0 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:31.439413 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1198/2397] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:46:31 2022] PUT /identity/v3/projects/cff7650e371a42179e8256fb88d3529f/users/bf5cb506dd97465b9ac9b4765d663a04/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:46:33.768090 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcef5e-5939-499c-ad0c-996a82b2de24 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:33.769656 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcef5e-5939-499c-ad0c-996a82b2de24 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:33.770261 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcef5e-5939-499c-ad0c-996a82b2de24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:33.817039 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-7fbcef5e-5939-499c-ad0c-996a82b2de24 None None] MFA Rules not processed for user `f88f7857e1d24bb0b038b7f6e98a6f34`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:46:33.819018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7fbcef5e-5939-499c-ad0c-996a82b2de24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:46:33.922948 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1200/2398] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:46:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:46:33.939493 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfc26c-b6ec-4358-8c0b-4410a3686ea0 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:33.943960 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b5bfc26c-b6ec-4358-8c0b-4410a3686ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:46:33.979857 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:34.152265 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfc26c-b6ec-4358-8c0b-4410a3686ea0 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:34.167955 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ef64a-610c-4396-a686-fe5f7512abfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:34.168995 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ef64a-610c-4396-a686-fe5f7512abfa service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:34.169482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ef64a-610c-4396-a686-fe5f7512abfa service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:34.169482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ef64a-610c-4396-a686-fe5f7512abfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:34.189358 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ef64a-610c-4396-a686-fe5f7512abfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:34.191564 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ef64a-610c-4396-a686-fe5f7512abfa service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:34.208299 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1199/2399] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:46:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:46:39.251405 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82a100-4114-4147-8486-c678b87dcee2 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:39.253096 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82a100-4114-4147-8486-c678b87dcee2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:39.263265 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82a100-4114-4147-8486-c678b87dcee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:39.312645 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4c82a100-4114-4147-8486-c678b87dcee2 None None] MFA Rules not processed for user `f88f7857e1d24bb0b038b7f6e98a6f34`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:46:39.316219 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4c82a100-4114-4147-8486-c678b87dcee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:46:39.340367 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1201/2400] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:46:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:46:43.303395 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d8c09-6640-45cd-b174-b6bf90c838d9 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:43.308258 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d8c09-6640-45cd-b174-b6bf90c838d9 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:43.308258 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d8c09-6640-45cd-b174-b6bf90c838d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:43.359447 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-140d8c09-6640-45cd-b174-b6bf90c838d9 None None] MFA Rules not processed for user `bf5cb506dd97465b9ac9b4765d663a04`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:46:43.362308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-140d8c09-6640-45cd-b174-b6bf90c838d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:46:43.562984 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1200/2401] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:46:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:46:43.580560 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82a100-4114-4147-8486-c678b87dcee2 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:43.582213 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4c82a100-4114-4147-8486-c678b87dcee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:46:43.705150 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82a100-4114-4147-8486-c678b87dcee2 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:43.709948 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526005e-d611-40aa-8127-6cd84b64428f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78745f9dbf544ab291acfa7a063c1493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:43.710927 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526005e-d611-40aa-8127-6cd84b64428f service glance] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:43.711407 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526005e-d611-40aa-8127-6cd84b64428f service glance] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:43.711685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526005e-d611-40aa-8127-6cd84b64428f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:43.724155 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:43.841359 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6526005e-d611-40aa-8127-6cd84b64428f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:43.842998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6526005e-d611-40aa-8127-6cd84b64428f service glance] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:43.854960 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1202/2402] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:46:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:46:44.309103 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d789f0-2774-4c49-96f7-65c663a30a7d None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:44.309103 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d789f0-2774-4c49-96f7-65c663a30a7d None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:44.309103 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d789f0-2774-4c49-96f7-65c663a30a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:44.364847 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-49d789f0-2774-4c49-96f7-65c663a30a7d None None] MFA Rules not processed for user `477ab357d285415e8c0c82d414d242ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:46:44.369160 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-49d789f0-2774-4c49-96f7-65c663a30a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:46:44.441389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:44.462732 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1201/2403] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 14:46:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:46:44.651031 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526005e-d611-40aa-8127-6cd84b64428f service glance] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:46:44.653119 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6526005e-d611-40aa-8127-6cd84b64428f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:46:44.772727 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526005e-d611-40aa-8127-6cd84b64428f service glance] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:46:44.781083 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167d491-1721-422b-9d93-1cd0ac481a06 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b3c32ecfdcf40629f09a7f52b2b5fa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:46:44.781722 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167d491-1721-422b-9d93-1cd0ac481a06 service swift] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:44.782583 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167d491-1721-422b-9d93-1cd0ac481a06 service swift] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:44.782583 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167d491-1721-422b-9d93-1cd0ac481a06 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:44.792044 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167d491-1721-422b-9d93-1cd0ac481a06 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:46:44.793670 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167d491-1721-422b-9d93-1cd0ac481a06 service swift] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:46:44.803055 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1203/2404] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 14:46:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 14:46:55.034660 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=4 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:55.064132 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=54 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:57.898059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4263a0-c54d-4d68-8860-14f4cc498749 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:46:57.898705 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4263a0-c54d-4d68-8860-14f4cc498749 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:46:57.901550 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4263a0-c54d-4d68-8860-14f4cc498749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:46:57.919772 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-da4263a0-c54d-4d68-8860-14f4cc498749 None None] MFA Rules not processed for user `cde1ea819e2d47e8b1a8ef5247bc61e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:46:57.921003 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-da4263a0-c54d-4d68-8860-14f4cc498749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:46:57.929576 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1202/2405] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:46:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:47:02.194909 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c4a80-9fbc-42ac-bbd1-3062e8404ca0 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:02.195717 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c4a80-9fbc-42ac-bbd1-3062e8404ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:02.195717 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c4a80-9fbc-42ac-bbd1-3062e8404ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:02.224278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d88c4a80-9fbc-42ac-bbd1-3062e8404ca0 None None] MFA Rules not processed for user `477ab357d285415e8c0c82d414d242ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:47:02.226945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d88c4a80-9fbc-42ac-bbd1-3062e8404ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:02.236500 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1204/2406] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 14:47:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:47:02.254728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4263a0-c54d-4d68-8860-14f4cc498749 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:47:02.275576 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4263a0-c54d-4d68-8860-14f4cc498749 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:47:02.282979 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddc98b-83aa-4b26-b7da-c47e8aa8f1ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b3c32ecfdcf40629f09a7f52b2b5fa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:47:02.286427 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddc98b-83aa-4b26-b7da-c47e8aa8f1ef service swift] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:02.286427 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddc98b-83aa-4b26-b7da-c47e8aa8f1ef service swift] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:02.286427 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddc98b-83aa-4b26-b7da-c47e8aa8f1ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:02.296465 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ddc98b-83aa-4b26-b7da-c47e8aa8f1ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:47:02.298317 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ddc98b-83aa-4b26-b7da-c47e8aa8f1ef service swift] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:47:02.310873 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1203/2407] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 14:47:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 14:47:12.230667 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:12.304657 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=9 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:41.153473 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c4a80-9fbc-42ac-bbd1-3062e8404ca0 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:47:41.214644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c4a80-9fbc-42ac-bbd1-3062e8404ca0 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:47:41.218514 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64f803-a7a8-47f8-abf0-df7cbf4c51dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:47:41.219172 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64f803-a7a8-47f8-abf0-df7cbf4c51dd service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:41.219444 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64f803-a7a8-47f8-abf0-df7cbf4c51dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:41.219713 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64f803-a7a8-47f8-abf0-df7cbf4c51dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:41.230633 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64f803-a7a8-47f8-abf0-df7cbf4c51dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:47:41.237250 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64f803-a7a8-47f8-abf0-df7cbf4c51dd service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:47:41.244123 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1205/2408] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:47:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:47:51.237780 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=26 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:52.284132 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddc98b-83aa-4b26-b7da-c47e8aa8f1ef service swift] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:47:52.285738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-86ddc98b-83aa-4b26-b7da-c47e8aa8f1ef service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:52.298635 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddc98b-83aa-4b26-b7da-c47e8aa8f1ef service swift] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:47:52.302261 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f1fb9-0b6b-43f7-93ac-b5e442a294ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:47:52.302858 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f1fb9-0b6b-43f7-93ac-b5e442a294ad service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:52.303133 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f1fb9-0b6b-43f7-93ac-b5e442a294ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:52.303403 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f1fb9-0b6b-43f7-93ac-b5e442a294ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:52.305297 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-5f2f1fb9-0b6b-43f7-93ac-b5e442a294ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:52.321467 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f1fb9-0b6b-43f7-93ac-b5e442a294ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:47:52.324143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f1fb9-0b6b-43f7-93ac-b5e442a294ad service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:47:52.343785 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1204/2409] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:47:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:47:53.549632 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64f803-a7a8-47f8-abf0-df7cbf4c51dd service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:47:53.559372 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64f803-a7a8-47f8-abf0-df7cbf4c51dd service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:47:53.563078 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f528d-eb44-412b-b0f2-42648b6ee686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:47:53.563684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f528d-eb44-412b-b0f2-42648b6ee686 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:53.563959 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f528d-eb44-412b-b0f2-42648b6ee686 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:53.564232 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f528d-eb44-412b-b0f2-42648b6ee686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:53.566003 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-258f528d-eb44-412b-b0f2-42648b6ee686 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:53.580326 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f528d-eb44-412b-b0f2-42648b6ee686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:47:53.581776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f528d-eb44-412b-b0f2-42648b6ee686 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:47:53.593696 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1206/2410] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:47:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:48:02.335628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=6 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:03.588596 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=6 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:04.315606 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f1fb9-0b6b-43f7-93ac-b5e442a294ad service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:48:04.317142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-5f2f1fb9-0b6b-43f7-93ac-b5e442a294ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:04.331867 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f1fb9-0b6b-43f7-93ac-b5e442a294ad service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:48:04.337989 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115dd9d6-7b4f-4e1e-9242-02312e37b3a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:48:04.338599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dd9d6-7b4f-4e1e-9242-02312e37b3a9 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:04.338882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dd9d6-7b4f-4e1e-9242-02312e37b3a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:04.339170 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dd9d6-7b4f-4e1e-9242-02312e37b3a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:04.340956 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-115dd9d6-7b4f-4e1e-9242-02312e37b3a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:04.427374 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115dd9d6-7b4f-4e1e-9242-02312e37b3a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:48:04.428952 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115dd9d6-7b4f-4e1e-9242-02312e37b3a9 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:48:04.448510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1205/2411] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:48:04 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:48:09.250901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1891e11-c401-4a3d-b033-4b398cbb5a61 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:09.251470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1891e11-c401-4a3d-b033-4b398cbb5a61 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:09.251470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1891e11-c401-4a3d-b033-4b398cbb5a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:09.277582 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e1891e11-c401-4a3d-b033-4b398cbb5a61 None None] MFA Rules not processed for user `477ab357d285415e8c0c82d414d242ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:48:09.278862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e1891e11-c401-4a3d-b033-4b398cbb5a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:09.286290 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1207/2412] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 14:48:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:48:09.342106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115dd9d6-7b4f-4e1e-9242-02312e37b3a9 service nova] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:48:09.356407 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115dd9d6-7b4f-4e1e-9242-02312e37b3a9 service nova] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:48:09.361926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8aa9c5-394d-4e05-b783-65e49ca9f4e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b3c32ecfdcf40629f09a7f52b2b5fa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:48:09.362543 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8aa9c5-394d-4e05-b783-65e49ca9f4e8 service swift] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:09.362822 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8aa9c5-394d-4e05-b783-65e49ca9f4e8 service swift] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:09.363124 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8aa9c5-394d-4e05-b783-65e49ca9f4e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:09.373410 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8aa9c5-394d-4e05-b783-65e49ca9f4e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:48:09.375149 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8aa9c5-394d-4e05-b783-65e49ca9f4e8 service swift] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:48:09.384876 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1206/2413] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 14:48:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 14:48:09.988674 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27aab3-72c2-4412-bf7b-ea35a66394e8 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:09.988992 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27aab3-72c2-4412-bf7b-ea35a66394e8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:09.989358 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27aab3-72c2-4412-bf7b-ea35a66394e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:10.014086 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-0f27aab3-72c2-4412-bf7b-ea35a66394e8 None None] MFA Rules not processed for user `3b7c54ebd95f4b3eb396982d75615f23`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:48:10.016620 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0f27aab3-72c2-4412-bf7b-ea35a66394e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:10.102703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1208/2414] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:48:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:48:11.526619 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8aa9c5-394d-4e05-b783-65e49ca9f4e8 service swift] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:48:11.529882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ec8aa9c5-394d-4e05-b783-65e49ca9f4e8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:11.702557 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8aa9c5-394d-4e05-b783-65e49ca9f4e8 service swift] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:48:11.719337 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8aae5f-484d-4fb1-b937-613e8fe58276 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63253cd786c04d6a9d099773198aee36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:48:11.722998 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aae5f-484d-4fb1-b937-613e8fe58276 service placement] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:11.722998 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aae5f-484d-4fb1-b937-613e8fe58276 service placement] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:11.722998 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aae5f-484d-4fb1-b937-613e8fe58276 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:11.723599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-7a8aae5f-484d-4fb1-b937-613e8fe58276 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:11.739661 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8aae5f-484d-4fb1-b937-613e8fe58276 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:48:11.741456 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8aae5f-484d-4fb1-b937-613e8fe58276 service placement] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:48:11.776838 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1207/2415] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:48:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:48:20.092018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=28 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:21.757603 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=79 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:24.289870 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27aab3-72c2-4412-bf7b-ea35a66394e8 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:48:24.300793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27aab3-72c2-4412-bf7b-ea35a66394e8 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:48:24.304396 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b7a43-455b-46b9-835c-ae29f3d7bd9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:48:24.305003 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b7a43-455b-46b9-835c-ae29f3d7bd9d service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:24.305277 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b7a43-455b-46b9-835c-ae29f3d7bd9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:24.305684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b7a43-455b-46b9-835c-ae29f3d7bd9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:24.308261 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7b6b7a43-455b-46b9-835c-ae29f3d7bd9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:24.318813 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b7a43-455b-46b9-835c-ae29f3d7bd9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:48:24.320261 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b7a43-455b-46b9-835c-ae29f3d7bd9d service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:48:24.329854 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1209/2416] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:48:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:48:31.284407 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8aae5f-484d-4fb1-b937-613e8fe58276 service placement] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:48:31.299488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8aae5f-484d-4fb1-b937-613e8fe58276 service placement] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:48:31.303611 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4f4ec-42d8-40f5-b457-22f728b3cc4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:48:31.308138 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4f4ec-42d8-40f5-b457-22f728b3cc4b service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:31.308138 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4f4ec-42d8-40f5-b457-22f728b3cc4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:31.308138 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4f4ec-42d8-40f5-b457-22f728b3cc4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:31.309642 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-95c4f4ec-42d8-40f5-b457-22f728b3cc4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:31.323786 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4f4ec-42d8-40f5-b457-22f728b3cc4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:48:31.327222 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4f4ec-42d8-40f5-b457-22f728b3cc4b service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:48:31.336075 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1208/2417] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:48:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:48:31.835974 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f1839-839f-4201-b859-1d319610ba86 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:31.836684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f1839-839f-4201-b859-1d319610ba86 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:31.836684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f1839-839f-4201-b859-1d319610ba86 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:31.838038 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1210/2418] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 14:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:48:31.845891 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205ca78-3bdd-4b42-9b64-e01c2fda72ec None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:31.846580 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205ca78-3bdd-4b42-9b64-e01c2fda72ec None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:31.846977 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205ca78-3bdd-4b42-9b64-e01c2fda72ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:31.899850 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-c205ca78-3bdd-4b42-9b64-e01c2fda72ec None None] MFA Rules not processed for user `8d099678d6454f7eb494892a69feaf62`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:48:31.901083 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c205ca78-3bdd-4b42-9b64-e01c2fda72ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:31.911841 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1209/2419] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 14:48:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:48:31.926227 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f1839-839f-4201-b859-1d319610ba86 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:48:31.944051 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f1839-839f-4201-b859-1d319610ba86 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:48:31.951857 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0abe3-4464-409d-a99e-b64c6d2d3194 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78745f9dbf544ab291acfa7a063c1493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:48:31.952484 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0abe3-4464-409d-a99e-b64c6d2d3194 service glance] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:31.952764 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0abe3-4464-409d-a99e-b64c6d2d3194 service glance] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:31.953040 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0abe3-4464-409d-a99e-b64c6d2d3194 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:31.965920 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0abe3-4464-409d-a99e-b64c6d2d3194 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:48:31.967265 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0abe3-4464-409d-a99e-b64c6d2d3194 service glance] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:48:31.982813 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1211/2420] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:48:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:48:32.200831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4cb97-08ae-41c4-89c3-29d66ed0da36 None None] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:32.201117 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4cb97-08ae-41c4-89c3-29d66ed0da36 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:32.201398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4cb97-08ae-41c4-89c3-29d66ed0da36 None None] PATH_INFO: `/` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:32.202880 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1210/2421] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 14:48:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:48:32.208178 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8dd84-d622-4657-8872-fa35b2fbf194 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:32.208464 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8dd84-d622-4657-8872-fa35b2fbf194 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:32.208738 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8dd84-d622-4657-8872-fa35b2fbf194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:32.251077 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-80d8dd84-d622-4657-8872-fa35b2fbf194 None None] MFA Rules not processed for user `cb5021b569db41a08218cbec928442af`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:48:32.252298 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-80d8dd84-d622-4657-8872-fa35b2fbf194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:32.259003 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1212/2422] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 14:48:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:48:32.272222 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4cb97-08ae-41c4-89c3-29d66ed0da36 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:48:32.284308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4cb97-08ae-41c4-89c3-29d66ed0da36 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:48:32.289933 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d502f15-90a2-4ed5-8a56-5a746eae7a27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:48:32.289933 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d502f15-90a2-4ed5-8a56-5a746eae7a27 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:32.289933 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d502f15-90a2-4ed5-8a56-5a746eae7a27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:32.289933 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d502f15-90a2-4ed5-8a56-5a746eae7a27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:32.297644 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d502f15-90a2-4ed5-8a56-5a746eae7a27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:48:32.299115 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d502f15-90a2-4ed5-8a56-5a746eae7a27 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:48:32.307663 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1211/2423] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:48:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:48:32.401557 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc5ae8-37e1-41b7-84d2-ac622d25f8fe None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:32.402110 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc5ae8-37e1-41b7-84d2-ac622d25f8fe None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:32.402616 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc5ae8-37e1-41b7-84d2-ac622d25f8fe None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:32.404604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1213/2424] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 14:48:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:48:32.410302 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93d7fb-f13b-4a13-b96a-a92534a5c5da None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:32.410634 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93d7fb-f13b-4a13-b96a-a92534a5c5da None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:32.410957 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93d7fb-f13b-4a13-b96a-a92534a5c5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:32.431404 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ee93d7fb-f13b-4a13-b96a-a92534a5c5da None None] MFA Rules not processed for user `8d099678d6454f7eb494892a69feaf62`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:48:32.432648 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ee93d7fb-f13b-4a13-b96a-a92534a5c5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:32.442930 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1212/2425] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 14:48:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:48:32.453587 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc5ae8-37e1-41b7-84d2-ac622d25f8fe None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:48:32.464369 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc5ae8-37e1-41b7-84d2-ac622d25f8fe None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:48:32.468428 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b93a3f-d74b-46c4-991e-70e13105102c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:48:32.469031 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b93a3f-d74b-46c4-991e-70e13105102c service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:32.469303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b93a3f-d74b-46c4-991e-70e13105102c service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:32.469567 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b93a3f-d74b-46c4-991e-70e13105102c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:32.481774 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b93a3f-d74b-46c4-991e-70e13105102c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:48:32.483214 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b93a3f-d74b-46c4-991e-70e13105102c service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:48:32.494348 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1214/2426] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:48:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:48:34.743211 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93d7fb-f13b-4a13-b96a-a92534a5c5da None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:48:34.754945 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93d7fb-f13b-4a13-b96a-a92534a5c5da None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:48:34.758747 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e39f8a-caa3-448e-a6b9-34a414f37b07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:48:34.759352 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e39f8a-caa3-448e-a6b9-34a414f37b07 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:34.759633 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e39f8a-caa3-448e-a6b9-34a414f37b07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:34.759907 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e39f8a-caa3-448e-a6b9-34a414f37b07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:34.762397 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-30e39f8a-caa3-448e-a6b9-34a414f37b07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:34.854330 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e39f8a-caa3-448e-a6b9-34a414f37b07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:48:34.855844 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e39f8a-caa3-448e-a6b9-34a414f37b07 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:48:34.867608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1213/2427] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:48:34 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:48:36.032103 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb048b80-928f-471d-800e-327135af838e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:36.032641 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb048b80-928f-471d-800e-327135af838e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:36.032641 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb048b80-928f-471d-800e-327135af838e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:36.087753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-cb048b80-928f-471d-800e-327135af838e None None] MFA Rules not processed for user `477ab357d285415e8c0c82d414d242ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:48:36.087753 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-cb048b80-928f-471d-800e-327135af838e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:36.103098 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1215/2428] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 14:48:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:48:36.115822 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e39f8a-caa3-448e-a6b9-34a414f37b07 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:48:36.137876 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e39f8a-caa3-448e-a6b9-34a414f37b07 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:48:36.143016 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99918150-91be-41b1-92b2-9a7c1bdd9bcd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b3c32ecfdcf40629f09a7f52b2b5fa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:48:36.143602 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99918150-91be-41b1-92b2-9a7c1bdd9bcd service swift] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:36.143883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99918150-91be-41b1-92b2-9a7c1bdd9bcd service swift] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:36.144164 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99918150-91be-41b1-92b2-9a7c1bdd9bcd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:36.153357 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99918150-91be-41b1-92b2-9a7c1bdd9bcd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:48:36.155370 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99918150-91be-41b1-92b2-9a7c1bdd9bcd service swift] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:48:36.163815 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1214/2429] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 14:48:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 14:48:46.100059 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=45 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:46.160484 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=64 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:01.513311 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cc8dd-ebeb-404d-ade2-2a96842d6c7c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:01.513816 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cc8dd-ebeb-404d-ade2-2a96842d6c7c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:01.513816 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cc8dd-ebeb-404d-ade2-2a96842d6c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:01.539388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-415cc8dd-ebeb-404d-ade2-2a96842d6c7c None None] MFA Rules not processed for user `477ab357d285415e8c0c82d414d242ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:49:01.540990 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-415cc8dd-ebeb-404d-ade2-2a96842d6c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:01.549416 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1216/2430] 10.222.0.65 () {58 vars in 967 bytes} [Wed Aug 24 14:49:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:49:01.565297 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99918150-91be-41b1-92b2-9a7c1bdd9bcd service swift] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:01.576169 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99918150-91be-41b1-92b2-9a7c1bdd9bcd service swift] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:01.581901 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98c40f-fd7c-4222-bf08-64cad1c41e7d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b3c32ecfdcf40629f09a7f52b2b5fa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:01.582567 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98c40f-fd7c-4222-bf08-64cad1c41e7d service swift] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:01.582848 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98c40f-fd7c-4222-bf08-64cad1c41e7d service swift] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:01.583124 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98c40f-fd7c-4222-bf08-64cad1c41e7d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:01.592356 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a98c40f-fd7c-4222-bf08-64cad1c41e7d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:01.593989 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a98c40f-fd7c-4222-bf08-64cad1c41e7d service swift] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:01.603416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1215/2431] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 14:49:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 14:49:11.531838 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:11.599467 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=6 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:17.507883 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415cc8dd-ebeb-404d-ade2-2a96842d6c7c None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:17.510046 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-415cc8dd-ebeb-404d-ade2-2a96842d6c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:17.592692 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415cc8dd-ebeb-404d-ade2-2a96842d6c7c None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:17.596981 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e2d4a-1e68-4dd6-a639-0931b75fdebd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:17.597585 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e2d4a-1e68-4dd6-a639-0931b75fdebd service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:17.597886 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e2d4a-1e68-4dd6-a639-0931b75fdebd service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:17.598158 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e2d4a-1e68-4dd6-a639-0931b75fdebd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:17.600141 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0e6e2d4a-1e68-4dd6-a639-0931b75fdebd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:17.683550 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e2d4a-1e68-4dd6-a639-0931b75fdebd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:17.685005 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e2d4a-1e68-4dd6-a639-0931b75fdebd service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:17.703782 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1217/2432] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:49:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:49:17.931008 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774ec0a-6b94-43ac-a96e-40cb509c058d None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:17.931548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774ec0a-6b94-43ac-a96e-40cb509c058d None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:17.931548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774ec0a-6b94-43ac-a96e-40cb509c058d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:17.951350 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-9774ec0a-6b94-43ac-a96e-40cb509c058d None None] MFA Rules not processed for user `f88f7857e1d24bb0b038b7f6e98a6f34`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:49:17.952570 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9774ec0a-6b94-43ac-a96e-40cb509c058d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:17.960568 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1216/2433] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:49:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:49:27.701180 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=70 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:27.945617 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:37.670588 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e2d4a-1e68-4dd6-a639-0931b75fdebd service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:37.684232 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e2d4a-1e68-4dd6-a639-0931b75fdebd service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:37.689832 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486d4e5-5ea8-44d8-a39b-d7f8c8fa37b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:37.690445 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486d4e5-5ea8-44d8-a39b-d7f8c8fa37b4 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:37.690724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486d4e5-5ea8-44d8-a39b-d7f8c8fa37b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:37.690991 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486d4e5-5ea8-44d8-a39b-d7f8c8fa37b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:37.693413 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b486d4e5-5ea8-44d8-a39b-d7f8c8fa37b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:37.708636 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486d4e5-5ea8-44d8-a39b-d7f8c8fa37b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:37.710975 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486d4e5-5ea8-44d8-a39b-d7f8c8fa37b4 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:37.725097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1218/2434] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:49:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:49:43.814572 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774ec0a-6b94-43ac-a96e-40cb509c058d None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:43.826249 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774ec0a-6b94-43ac-a96e-40cb509c058d None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:43.830123 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a560f-8460-439e-a711-55c59d544681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:43.830728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a560f-8460-439e-a711-55c59d544681 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:43.831035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a560f-8460-439e-a711-55c59d544681 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:43.831283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a560f-8460-439e-a711-55c59d544681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:43.833086 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-5b4a560f-8460-439e-a711-55c59d544681 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:43.901364 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a560f-8460-439e-a711-55c59d544681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:43.902885 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a560f-8460-439e-a711-55c59d544681 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:43.913938 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1217/2435] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:49:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:49:47.719252 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=6 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:48.583084 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486d4e5-5ea8-44d8-a39b-d7f8c8fa37b4 service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:48.583840 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b486d4e5-5ea8-44d8-a39b-d7f8c8fa37b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:48.601497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486d4e5-5ea8-44d8-a39b-d7f8c8fa37b4 service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:48.607036 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101440f6-505d-4646-87b4-2c5672537bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:48.607655 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101440f6-505d-4646-87b4-2c5672537bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:48.607931 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101440f6-505d-4646-87b4-2c5672537bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:48.608204 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101440f6-505d-4646-87b4-2c5672537bc9 admin admin] PATH_INFO: `/v3/users/556b3a886df740cda4a94e55d2fcc08a` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:48.609383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101440f6-505d-4646-87b4-2c5672537bc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=556b3a886df740cda4a94e55d2fcc08a)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:48.611429 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101440f6-505d-4646-87b4-2c5672537bc9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:48.828456 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-101440f6-505d-4646-87b4-2c5672537bc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '556b3a886df740cda4a94e55d2fcc08a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:49:48.829200 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-101440f6-505d-4646-87b4-2c5672537bc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '556b3a886df740cda4a94e55d2fcc08a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:49:48.829716 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-101440f6-505d-4646-87b4-2c5672537bc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '556b3a886df740cda4a94e55d2fcc08a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:49:48.842220 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-101440f6-505d-4646-87b4-2c5672537bc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '556b3a886df740cda4a94e55d2fcc08a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:49:48.911454 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-101440f6-505d-4646-87b4-2c5672537bc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '556b3a886df740cda4a94e55d2fcc08a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:49:48.934442 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1219/2436] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:49:48 2022] DELETE /identity/v3/users/556b3a886df740cda4a94e55d2fcc08a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:49:49.221332 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a560f-8460-439e-a711-55c59d544681 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:49.233097 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a560f-8460-439e-a711-55c59d544681 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:49.306521 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12c630-86e3-4771-a142-a9805dcaa4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:49.307327 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12c630-86e3-4771-a142-a9805dcaa4b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:49.307603 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12c630-86e3-4771-a142-a9805dcaa4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:49.307873 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12c630-86e3-4771-a142-a9805dcaa4b3 admin admin] PATH_INFO: `/v3/projects/2395c1dafb6a4174a7dd095c4809c181` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:49.309039 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d12c630-86e3-4771-a142-a9805dcaa4b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2395c1dafb6a4174a7dd095c4809c181)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:49.311047 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d12c630-86e3-4771-a142-a9805dcaa4b3 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:49.426562 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0d12c630-86e3-4771-a142-a9805dcaa4b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2395c1dafb6a4174a7dd095c4809c181', 'request_id': 'req-0d12c630-86e3-4771-a142-a9805dcaa4b3'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:49:49.482573 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0d12c630-86e3-4771-a142-a9805dcaa4b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2395c1dafb6a4174a7dd095c4809c181', 'request_id': 'req-0d12c630-86e3-4771-a142-a9805dcaa4b3'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:49:49.489442 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0d12c630-86e3-4771-a142-a9805dcaa4b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2395c1dafb6a4174a7dd095c4809c181', 'request_id': 'req-0d12c630-86e3-4771-a142-a9805dcaa4b3'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:49:49.500740 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0d12c630-86e3-4771-a142-a9805dcaa4b3 admin admin] The token cache is being invalidate because project 2395c1dafb6a4174a7dd095c4809c181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:49:49.501023 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0d12c630-86e3-4771-a142-a9805dcaa4b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:49:49.501668 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-0d12c630-86e3-4771-a142-a9805dcaa4b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:49:49.503192 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1218/2437] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:49:49 2022] DELETE /identity/v3/projects/2395c1dafb6a4174a7dd095c4809c181 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:49:49.508143 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0c45d-645a-4038-b952-49b1f5d75859 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:49.508429 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0c45d-645a-4038-b952-49b1f5d75859 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:49.508801 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0c45d-645a-4038-b952-49b1f5d75859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:49.529441 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-76e0c45d-645a-4038-b952-49b1f5d75859 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:49:49.530704 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-76e0c45d-645a-4038-b952-49b1f5d75859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:49.591193 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1220/2438] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:49:49.600266 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d21f0-8409-43c2-a069-0861c4241ae2 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:49.600547 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d21f0-8409-43c2-a069-0861c4241ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:49.600824 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d21f0-8409-43c2-a069-0861c4241ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:49.623076 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-fc2d21f0-8409-43c2-a069-0861c4241ae2 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:49:49.624331 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-fc2d21f0-8409-43c2-a069-0861c4241ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:49.632638 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1219/2439] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:49:49.636955 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0c45d-645a-4038-b952-49b1f5d75859 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:49.647295 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0c45d-645a-4038-b952-49b1f5d75859 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:49.652742 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115789e-d398-4514-9334-cd2d9ba45cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:49.653350 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115789e-d398-4514-9334-cd2d9ba45cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:49.653623 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115789e-d398-4514-9334-cd2d9ba45cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:49.653924 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115789e-d398-4514-9334-cd2d9ba45cd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:49.654575 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115789e-d398-4514-9334-cd2d9ba45cd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:49:49.654870 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115789e-d398-4514-9334-cd2d9ba45cd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:49.656462 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115789e-d398-4514-9334-cd2d9ba45cd5 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:49.670532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1221/2440] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:49:49.675043 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d21f0-8409-43c2-a069-0861c4241ae2 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:49.684939 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d21f0-8409-43c2-a069-0861c4241ae2 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:49.689824 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061de4bc-f320-4e99-b357-5688706d4b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:49.690432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061de4bc-f320-4e99-b357-5688706d4b42 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:49.690711 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061de4bc-f320-4e99-b357-5688706d4b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:49.691476 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061de4bc-f320-4e99-b357-5688706d4b42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:49.691594 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061de4bc-f320-4e99-b357-5688706d4b42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:49.693519 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061de4bc-f320-4e99-b357-5688706d4b42 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:49.709640 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:49.828790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1220/2441] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:49:49 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:49:49.833094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115789e-d398-4514-9334-cd2d9ba45cd5 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:49.844639 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115789e-d398-4514-9334-cd2d9ba45cd5 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:49.903217 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd314b-9f12-40b0-8366-3045f4ae47bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:49.903851 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd314b-9f12-40b0-8366-3045f4ae47bc admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:49.904129 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd314b-9f12-40b0-8366-3045f4ae47bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:49.904403 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd314b-9f12-40b0-8366-3045f4ae47bc admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:49.905079 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd314b-9f12-40b0-8366-3045f4ae47bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:49.907025 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd314b-9f12-40b0-8366-3045f4ae47bc admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:49.915873 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:50.026316 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1222/2442] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:49:49 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:49:50.031105 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061de4bc-f320-4e99-b357-5688706d4b42 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:50.041822 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061de4bc-f320-4e99-b357-5688706d4b42 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:50.046435 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d7bbf-061d-45d6-9ab9-7f623a8f041c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:50.047038 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d7bbf-061d-45d6-9ab9-7f623a8f041c admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:50.047311 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d7bbf-061d-45d6-9ab9-7f623a8f041c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:50.047581 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d7bbf-061d-45d6-9ab9-7f623a8f041c admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:50.048223 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d7bbf-061d-45d6-9ab9-7f623a8f041c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:50.049857 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d7bbf-061d-45d6-9ab9-7f623a8f041c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:50.059993 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1221/2443] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:49:50.064051 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd314b-9f12-40b0-8366-3045f4ae47bc admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:50.074787 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd314b-9f12-40b0-8366-3045f4ae47bc admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:50.079597 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07359c02-7d18-4bd9-b31a-1450f8bf4e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:50.080107 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07359c02-7d18-4bd9-b31a-1450f8bf4e47 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:50.080383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07359c02-7d18-4bd9-b31a-1450f8bf4e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:50.080654 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07359c02-7d18-4bd9-b31a-1450f8bf4e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:50.081386 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07359c02-7d18-4bd9-b31a-1450f8bf4e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:50.083031 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07359c02-7d18-4bd9-b31a-1450f8bf4e47 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:50.094819 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1223/2444] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:49:50.098969 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d7bbf-061d-45d6-9ab9-7f623a8f041c admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:50.109564 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d7bbf-061d-45d6-9ab9-7f623a8f041c admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:50.114576 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9e5b2-4256-4ddf-9169-aff458669a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:50.115398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9e5b2-4256-4ddf-9169-aff458669a30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:50.115699 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9e5b2-4256-4ddf-9169-aff458669a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:50.115972 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9e5b2-4256-4ddf-9169-aff458669a30 admin admin] PATH_INFO: `/v3/projects/7653b27c868d484785d929372661ae16/users/a9d2248d8d364c1ca8147d1ff93a01aa/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:50.131153 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9e5b2-4256-4ddf-9169-aff458669a30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7653b27c868d484785d929372661ae16, user_id=a9d2248d8d364c1ca8147d1ff93a01aa, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:50.134637 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9e5b2-4256-4ddf-9169-aff458669a30 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:50.215395 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1222/2445] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:49:50 2022] PUT /identity/v3/projects/7653b27c868d484785d929372661ae16/users/a9d2248d8d364c1ca8147d1ff93a01aa/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:49:50.226338 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1d7a3-ad7a-4592-ae71-644bf33b421c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:50.226925 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1d7a3-ad7a-4592-ae71-644bf33b421c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:50.227284 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1d7a3-ad7a-4592-ae71-644bf33b421c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:50.256688 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-45b1d7a3-ad7a-4592-ae71-644bf33b421c None None] MFA Rules not processed for user `a9d2248d8d364c1ca8147d1ff93a01aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:49:50.258009 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-45b1d7a3-ad7a-4592-ae71-644bf33b421c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:50.331469 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1224/2446] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:49:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:49:50.343557 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9e5b2-4256-4ddf-9169-aff458669a30 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:50.345400 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-08d9e5b2-4256-4ddf-9169-aff458669a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:50.421465 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9e5b2-4256-4ddf-9169-aff458669a30 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:50.427318 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb0919-87ef-4e5b-839c-9cdbe2aff5ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:50.427923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb0919-87ef-4e5b-839c-9cdbe2aff5ce service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:50.428198 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb0919-87ef-4e5b-839c-9cdbe2aff5ce service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:50.428466 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb0919-87ef-4e5b-839c-9cdbe2aff5ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:50.438800 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb0919-87ef-4e5b-839c-9cdbe2aff5ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:50.440417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb0919-87ef-4e5b-839c-9cdbe2aff5ce service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:50.450659 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1223/2447] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:49:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:50:00.328119 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:00.445561 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:03.065715 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1d7a3-ad7a-4592-ae71-644bf33b421c None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:03.128518 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1d7a3-ad7a-4592-ae71-644bf33b421c None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:03.134258 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e8c0a-bcca-4ca1-b04e-ce9024103d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:03.134910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e8c0a-bcca-4ca1-b04e-ce9024103d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:03.135207 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e8c0a-bcca-4ca1-b04e-ce9024103d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:03.135478 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e8c0a-bcca-4ca1-b04e-ce9024103d92 admin admin] PATH_INFO: `/v3/users/a9d2248d8d364c1ca8147d1ff93a01aa` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:03.137393 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e8c0a-bcca-4ca1-b04e-ce9024103d92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9d2248d8d364c1ca8147d1ff93a01aa)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:03.139611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e8c0a-bcca-4ca1-b04e-ce9024103d92 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:03.359935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-380e8c0a-bcca-4ca1-b04e-ce9024103d92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9d2248d8d364c1ca8147d1ff93a01aa'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:03.360659 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-380e8c0a-bcca-4ca1-b04e-ce9024103d92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9d2248d8d364c1ca8147d1ff93a01aa'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:03.361284 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-380e8c0a-bcca-4ca1-b04e-ce9024103d92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9d2248d8d364c1ca8147d1ff93a01aa'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:03.374595 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-380e8c0a-bcca-4ca1-b04e-ce9024103d92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9d2248d8d364c1ca8147d1ff93a01aa'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:03.465546 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-380e8c0a-bcca-4ca1-b04e-ce9024103d92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9d2248d8d364c1ca8147d1ff93a01aa'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:03.478797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1225/2448] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:50:03 2022] DELETE /identity/v3/users/a9d2248d8d364c1ca8147d1ff93a01aa => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:03.484499 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ace8d7-050a-457a-8768-8a7cc43e6ebe None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:03.484981 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ace8d7-050a-457a-8768-8a7cc43e6ebe None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:03.485086 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ace8d7-050a-457a-8768-8a7cc43e6ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:03.504972 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-41ace8d7-050a-457a-8768-8a7cc43e6ebe None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:03.506264 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-41ace8d7-050a-457a-8768-8a7cc43e6ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:03.571924 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1224/2449] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:50:03.581913 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e8c0a-bcca-4ca1-b04e-ce9024103d92 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:03.583535 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-380e8c0a-bcca-4ca1-b04e-ce9024103d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:03.643110 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e8c0a-bcca-4ca1-b04e-ce9024103d92 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:03.646766 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187b367-5491-47e1-8c77-ef8cd2de6b79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:03.647430 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187b367-5491-47e1-8c77-ef8cd2de6b79 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:03.647712 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187b367-5491-47e1-8c77-ef8cd2de6b79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:03.647980 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187b367-5491-47e1-8c77-ef8cd2de6b79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:03.658116 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187b367-5491-47e1-8c77-ef8cd2de6b79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:03.659414 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187b367-5491-47e1-8c77-ef8cd2de6b79 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:03.670290 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1226/2450] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:50:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:50:04.135423 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ace8d7-050a-457a-8768-8a7cc43e6ebe None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:04.137648 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-41ace8d7-050a-457a-8768-8a7cc43e6ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:04.155998 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ace8d7-050a-457a-8768-8a7cc43e6ebe None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:04.159603 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a31bd9-23b1-44eb-a6b4-5f9de68ee052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:04.160263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a31bd9-23b1-44eb-a6b4-5f9de68ee052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:04.160556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a31bd9-23b1-44eb-a6b4-5f9de68ee052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:04.160801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a31bd9-23b1-44eb-a6b4-5f9de68ee052 admin admin] PATH_INFO: `/v3/projects/7653b27c868d484785d929372661ae16` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:04.162060 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a31bd9-23b1-44eb-a6b4-5f9de68ee052 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7653b27c868d484785d929372661ae16)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:04.169213 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a31bd9-23b1-44eb-a6b4-5f9de68ee052 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:04.302900 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-49a31bd9-23b1-44eb-a6b4-5f9de68ee052 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7653b27c868d484785d929372661ae16', 'request_id': 'req-49a31bd9-23b1-44eb-a6b4-5f9de68ee052'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:04.362790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-49a31bd9-23b1-44eb-a6b4-5f9de68ee052 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7653b27c868d484785d929372661ae16', 'request_id': 'req-49a31bd9-23b1-44eb-a6b4-5f9de68ee052'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:04.370247 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-49a31bd9-23b1-44eb-a6b4-5f9de68ee052 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7653b27c868d484785d929372661ae16', 'request_id': 'req-49a31bd9-23b1-44eb-a6b4-5f9de68ee052'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:04.383712 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-49a31bd9-23b1-44eb-a6b4-5f9de68ee052 admin admin] The token cache is being invalidate because project 7653b27c868d484785d929372661ae16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:50:04.383967 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-49a31bd9-23b1-44eb-a6b4-5f9de68ee052 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:04.384993 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-49a31bd9-23b1-44eb-a6b4-5f9de68ee052 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:04.388103 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1225/2451] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:50:04 2022] DELETE /identity/v3/projects/7653b27c868d484785d929372661ae16 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:04.395789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35080d-9da4-42e4-96cb-8cd5524f02c3 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:04.396347 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35080d-9da4-42e4-96cb-8cd5524f02c3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:04.396772 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35080d-9da4-42e4-96cb-8cd5524f02c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:04.421402 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-2c35080d-9da4-42e4-96cb-8cd5524f02c3 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:04.422706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2c35080d-9da4-42e4-96cb-8cd5524f02c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:04.449924 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:04.496900 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1227/2452] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:50:04.505206 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cb473-d98f-45e0-b0c8-ceab93e92709 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:04.508706 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cb473-d98f-45e0-b0c8-ceab93e92709 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:04.508706 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cb473-d98f-45e0-b0c8-ceab93e92709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:04.530697 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-520cb473-d98f-45e0-b0c8-ceab93e92709 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:04.532342 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-520cb473-d98f-45e0-b0c8-ceab93e92709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:04.540614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1226/2453] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:50:04.551501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35080d-9da4-42e4-96cb-8cd5524f02c3 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:04.562663 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35080d-9da4-42e4-96cb-8cd5524f02c3 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:04.567629 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9d400-f52d-4740-88b7-b9cba6a7c0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:04.568248 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9d400-f52d-4740-88b7-b9cba6a7c0ce admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:04.568745 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9d400-f52d-4740-88b7-b9cba6a7c0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:04.569386 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9d400-f52d-4740-88b7-b9cba6a7c0ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:04.570120 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe9d400-f52d-4740-88b7-b9cba6a7c0ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:50:04.570430 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe9d400-f52d-4740-88b7-b9cba6a7c0ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:04.572357 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe9d400-f52d-4740-88b7-b9cba6a7c0ce admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:04.587008 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1228/2454] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:50:04.591618 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520cb473-d98f-45e0-b0c8-ceab93e92709 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:04.601579 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520cb473-d98f-45e0-b0c8-ceab93e92709 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:04.607307 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b88221-720a-4651-b58a-2855c08af84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:04.607921 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b88221-720a-4651-b58a-2855c08af84c admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:04.608204 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b88221-720a-4651-b58a-2855c08af84c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:04.609061 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b88221-720a-4651-b58a-2855c08af84c admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:04.609422 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b88221-720a-4651-b58a-2855c08af84c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:04.611118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b88221-720a-4651-b58a-2855c08af84c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:04.707994 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1227/2455] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:50:04 2022] POST /identity/v3/projects => generated 365 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:50:04.712375 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9d400-f52d-4740-88b7-b9cba6a7c0ce admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:04.722927 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9d400-f52d-4740-88b7-b9cba6a7c0ce admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:04.781080 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e4530-95fd-4a1b-b81e-e5221a504d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:04.782161 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e4530-95fd-4a1b-b81e-e5221a504d40 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:04.782161 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e4530-95fd-4a1b-b81e-e5221a504d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:04.782410 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e4530-95fd-4a1b-b81e-e5221a504d40 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:04.782887 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e4530-95fd-4a1b-b81e-e5221a504d40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:04.784965 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e4530-95fd-4a1b-b81e-e5221a504d40 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:04.900015 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1229/2456] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:50:04 2022] POST /identity/v3/users => generated 283 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:50:04.904849 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b88221-720a-4651-b58a-2855c08af84c admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:04.916261 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b88221-720a-4651-b58a-2855c08af84c admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:04.922141 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa6ae8-76b1-4b3b-929c-bedfc0a93c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:04.922792 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa6ae8-76b1-4b3b-929c-bedfc0a93c5c admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:04.923069 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa6ae8-76b1-4b3b-929c-bedfc0a93c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:04.923338 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa6ae8-76b1-4b3b-929c-bedfc0a93c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:04.923977 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa6ae8-76b1-4b3b-929c-bedfc0a93c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:04.925910 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa6ae8-76b1-4b3b-929c-bedfc0a93c5c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:04.937526 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1228/2457] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:50:04.941895 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e4530-95fd-4a1b-b81e-e5221a504d40 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:04.953359 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e4530-95fd-4a1b-b81e-e5221a504d40 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:04.958680 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10fd448-87db-41cf-8a4d-bc146f494371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:04.959216 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fd448-87db-41cf-8a4d-bc146f494371 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:04.959499 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fd448-87db-41cf-8a4d-bc146f494371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:04.959781 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fd448-87db-41cf-8a4d-bc146f494371 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:04.960474 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10fd448-87db-41cf-8a4d-bc146f494371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:04.962206 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10fd448-87db-41cf-8a4d-bc146f494371 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:04.975307 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1230/2458] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:50:04.980308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa6ae8-76b1-4b3b-929c-bedfc0a93c5c admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:04.990766 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa6ae8-76b1-4b3b-929c-bedfc0a93c5c admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:04.996105 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff991e4-ee2e-431e-91b5-280ba5b559ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:04.996858 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff991e4-ee2e-431e-91b5-280ba5b559ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:04.997140 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff991e4-ee2e-431e-91b5-280ba5b559ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:04.997415 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff991e4-ee2e-431e-91b5-280ba5b559ac admin admin] PATH_INFO: `/v3/projects/8ed80e9428ec40c88dd69151275cd9f8/users/bb62ec2d075944e1983d75ccc98ad81d/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:05.012263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff991e4-ee2e-431e-91b5-280ba5b559ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ed80e9428ec40c88dd69151275cd9f8, user_id=bb62ec2d075944e1983d75ccc98ad81d, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:05.015028 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff991e4-ee2e-431e-91b5-280ba5b559ac admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:05.124420 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1229/2459] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:50:04 2022] PUT /identity/v3/projects/8ed80e9428ec40c88dd69151275cd9f8/users/bb62ec2d075944e1983d75ccc98ad81d/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:50:05.136265 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fa6e8-2fdb-495f-81b0-71e3669831f7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:05.137690 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fa6e8-2fdb-495f-81b0-71e3669831f7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:05.137690 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fa6e8-2fdb-495f-81b0-71e3669831f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:05.165124 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-5e7fa6e8-2fdb-495f-81b0-71e3669831f7 None None] MFA Rules not processed for user `bb62ec2d075944e1983d75ccc98ad81d`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:05.166388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5e7fa6e8-2fdb-495f-81b0-71e3669831f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:05.237038 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1231/2460] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:50:05.241477 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff991e4-ee2e-431e-91b5-280ba5b559ac admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:05.267125 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:05.313367 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff991e4-ee2e-431e-91b5-280ba5b559ac admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:05.318863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f1330-3d89-49c4-851c-4ba0f814d629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:05.319483 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f1330-3d89-49c4-851c-4ba0f814d629 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:05.319760 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f1330-3d89-49c4-851c-4ba0f814d629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:05.320037 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f1330-3d89-49c4-851c-4ba0f814d629 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:05.320661 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f1330-3d89-49c4-851c-4ba0f814d629 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:05.322632 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f1330-3d89-49c4-851c-4ba0f814d629 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:05.473644 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1230/2461] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:50:05 2022] POST /identity/v3/projects => generated 363 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:50:05.478180 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7fa6e8-2fdb-495f-81b0-71e3669831f7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:05.491021 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7fa6e8-2fdb-495f-81b0-71e3669831f7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:05.503851 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:05.553359 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5c1bc-c678-4f42-8a93-6c3ab4f2a3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:05.554007 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5c1bc-c678-4f42-8a93-6c3ab4f2a3b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:05.554287 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5c1bc-c678-4f42-8a93-6c3ab4f2a3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:05.554559 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5c1bc-c678-4f42-8a93-6c3ab4f2a3b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:05.555229 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5c1bc-c678-4f42-8a93-6c3ab4f2a3b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:05.557164 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5c1bc-c678-4f42-8a93-6c3ab4f2a3b4 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:05.643212 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1232/2462] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:50:05 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:50:05.647475 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f1330-3d89-49c4-851c-4ba0f814d629 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:05.658986 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f1330-3d89-49c4-851c-4ba0f814d629 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:05.664067 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7dd6ee-715a-4c68-823f-4efe1f43d2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:05.664741 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dd6ee-715a-4c68-823f-4efe1f43d2bd admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:05.665019 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dd6ee-715a-4c68-823f-4efe1f43d2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:05.665294 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dd6ee-715a-4c68-823f-4efe1f43d2bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:05.665997 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7dd6ee-715a-4c68-823f-4efe1f43d2bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:05.668405 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7dd6ee-715a-4c68-823f-4efe1f43d2bd admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:05.679777 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1231/2463] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:50:05.684756 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5c1bc-c678-4f42-8a93-6c3ab4f2a3b4 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:05.695170 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5c1bc-c678-4f42-8a93-6c3ab4f2a3b4 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:05.700285 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150478ab-0eea-414e-b7a4-b448bf0cff17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:05.700927 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150478ab-0eea-414e-b7a4-b448bf0cff17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:05.701205 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150478ab-0eea-414e-b7a4-b448bf0cff17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:05.701476 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150478ab-0eea-414e-b7a4-b448bf0cff17 admin admin] PATH_INFO: `/v3/projects/f0becf985ccc4c9ba0cbc2df33aef28b/users/9db99d78d0b64aa0a738f7902d89f835/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:05.716053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150478ab-0eea-414e-b7a4-b448bf0cff17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0becf985ccc4c9ba0cbc2df33aef28b, user_id=9db99d78d0b64aa0a738f7902d89f835, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:05.718803 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150478ab-0eea-414e-b7a4-b448bf0cff17 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:05.803721 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1233/2464] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:50:05 2022] PUT /identity/v3/projects/f0becf985ccc4c9ba0cbc2df33aef28b/users/9db99d78d0b64aa0a738f7902d89f835/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:50:05.807965 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7dd6ee-715a-4c68-823f-4efe1f43d2bd admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:05.819787 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7dd6ee-715a-4c68-823f-4efe1f43d2bd admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:05.877989 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d990be5-b59e-49f5-b271-0810be738ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:05.878597 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d990be5-b59e-49f5-b271-0810be738ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:05.878878 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d990be5-b59e-49f5-b271-0810be738ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:05.879149 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d990be5-b59e-49f5-b271-0810be738ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:05.882312 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d990be5-b59e-49f5-b271-0810be738ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:05.882312 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d990be5-b59e-49f5-b271-0810be738ea2 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:05.892589 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1232/2465] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:50:05.898888 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150478ab-0eea-414e-b7a4-b448bf0cff17 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:05.910224 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150478ab-0eea-414e-b7a4-b448bf0cff17 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:05.915101 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3e644-64c7-48b1-87ff-d96d11c50f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:05.915771 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3e644-64c7-48b1-87ff-d96d11c50f83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:05.916052 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3e644-64c7-48b1-87ff-d96d11c50f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:05.916324 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3e644-64c7-48b1-87ff-d96d11c50f83 admin admin] PATH_INFO: `/v3/projects/f0becf985ccc4c9ba0cbc2df33aef28b/users/9db99d78d0b64aa0a738f7902d89f835/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:05.918921 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3e644-64c7-48b1-87ff-d96d11c50f83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0becf985ccc4c9ba0cbc2df33aef28b, user_id=9db99d78d0b64aa0a738f7902d89f835, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:05.921606 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3e644-64c7-48b1-87ff-d96d11c50f83 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:05.933449 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1234/2466] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:50:05 2022] PUT /identity/v3/projects/f0becf985ccc4c9ba0cbc2df33aef28b/users/9db99d78d0b64aa0a738f7902d89f835/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:05.944796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5252062-8126-4f7e-9dfc-cbf9a645e85f None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:05.944796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5252062-8126-4f7e-9dfc-cbf9a645e85f None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:05.944796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5252062-8126-4f7e-9dfc-cbf9a645e85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:05.975461 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-c5252062-8126-4f7e-9dfc-cbf9a645e85f None None] MFA Rules not processed for user `9db99d78d0b64aa0a738f7902d89f835`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:05.976719 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c5252062-8126-4f7e-9dfc-cbf9a645e85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:06.048216 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1233/2467] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:05 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:50:06.059708 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3e644-64c7-48b1-87ff-d96d11c50f83 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:06.061419 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1cb3e644-64c7-48b1-87ff-d96d11c50f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:06.121991 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3e644-64c7-48b1-87ff-d96d11c50f83 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:06.126049 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ad861-0121-4f71-8148-72d50c494ddf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:06.126677 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ad861-0121-4f71-8148-72d50c494ddf service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:06.126962 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ad861-0121-4f71-8148-72d50c494ddf service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:06.127238 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ad861-0121-4f71-8148-72d50c494ddf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:06.138001 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ad861-0121-4f71-8148-72d50c494ddf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:06.139454 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ad861-0121-4f71-8148-72d50c494ddf service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:06.150145 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1235/2468] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:50:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:50:07.157868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5252062-8126-4f7e-9dfc-cbf9a645e85f None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:07.176261 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:07.235721 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5252062-8126-4f7e-9dfc-cbf9a645e85f None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:07.242708 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1993bfe-bd65-4171-9098-f50cc61021e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:07.244115 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1993bfe-bd65-4171-9098-f50cc61021e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:07.244407 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1993bfe-bd65-4171-9098-f50cc61021e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:07.244767 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1993bfe-bd65-4171-9098-f50cc61021e5 admin admin] PATH_INFO: `/v3/users/bb62ec2d075944e1983d75ccc98ad81d` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:07.246472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1993bfe-bd65-4171-9098-f50cc61021e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb62ec2d075944e1983d75ccc98ad81d)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:07.248497 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1993bfe-bd65-4171-9098-f50cc61021e5 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:07.471475 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a1993bfe-bd65-4171-9098-f50cc61021e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb62ec2d075944e1983d75ccc98ad81d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:07.472074 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a1993bfe-bd65-4171-9098-f50cc61021e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb62ec2d075944e1983d75ccc98ad81d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:07.487624 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a1993bfe-bd65-4171-9098-f50cc61021e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb62ec2d075944e1983d75ccc98ad81d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:07.488484 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a1993bfe-bd65-4171-9098-f50cc61021e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb62ec2d075944e1983d75ccc98ad81d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:07.562594 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a1993bfe-bd65-4171-9098-f50cc61021e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb62ec2d075944e1983d75ccc98ad81d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:07.578068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1234/2469] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:50:07 2022] DELETE /identity/v3/users/bb62ec2d075944e1983d75ccc98ad81d => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:07.582679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010a8de-d5d9-477d-aaaf-3e2fc649ba19 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:07.583200 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010a8de-d5d9-477d-aaaf-3e2fc649ba19 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:07.583200 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010a8de-d5d9-477d-aaaf-3e2fc649ba19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:07.603800 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-6010a8de-d5d9-477d-aaaf-3e2fc649ba19 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:07.604989 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6010a8de-d5d9-477d-aaaf-3e2fc649ba19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:07.672527 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1236/2470] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:50:07.686262 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1993bfe-bd65-4171-9098-f50cc61021e5 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:07.687915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a1993bfe-bd65-4171-9098-f50cc61021e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:07.751692 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1993bfe-bd65-4171-9098-f50cc61021e5 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:07.755220 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1bb81-3802-429a-ab8e-bf2281b22c0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:07.755817 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1bb81-3802-429a-ab8e-bf2281b22c0e service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:07.756091 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1bb81-3802-429a-ab8e-bf2281b22c0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:07.756357 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1bb81-3802-429a-ab8e-bf2281b22c0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:07.766308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1bb81-3802-429a-ab8e-bf2281b22c0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:07.767783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1bb81-3802-429a-ab8e-bf2281b22c0e service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:07.777521 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1235/2471] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:50:08.165030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010a8de-d5d9-477d-aaaf-3e2fc649ba19 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:08.166610 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6010a8de-d5d9-477d-aaaf-3e2fc649ba19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:08.179862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010a8de-d5d9-477d-aaaf-3e2fc649ba19 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:08.185437 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e644e0-b98b-428a-a80b-08f2907c1a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:08.186230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e644e0-b98b-428a-a80b-08f2907c1a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:08.186506 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e644e0-b98b-428a-a80b-08f2907c1a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:08.186775 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e644e0-b98b-428a-a80b-08f2907c1a2a admin admin] PATH_INFO: `/v3/projects/8ed80e9428ec40c88dd69151275cd9f8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:08.187919 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e644e0-b98b-428a-a80b-08f2907c1a2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ed80e9428ec40c88dd69151275cd9f8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:08.189854 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e644e0-b98b-428a-a80b-08f2907c1a2a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:08.198881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:08.313536 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-45e644e0-b98b-428a-a80b-08f2907c1a2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ed80e9428ec40c88dd69151275cd9f8', 'request_id': 'req-45e644e0-b98b-428a-a80b-08f2907c1a2a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:08.385401 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-45e644e0-b98b-428a-a80b-08f2907c1a2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ed80e9428ec40c88dd69151275cd9f8', 'request_id': 'req-45e644e0-b98b-428a-a80b-08f2907c1a2a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:08.392549 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-45e644e0-b98b-428a-a80b-08f2907c1a2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ed80e9428ec40c88dd69151275cd9f8', 'request_id': 'req-45e644e0-b98b-428a-a80b-08f2907c1a2a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:08.403144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-45e644e0-b98b-428a-a80b-08f2907c1a2a admin admin] The token cache is being invalidate because project 8ed80e9428ec40c88dd69151275cd9f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:50:08.403417 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-45e644e0-b98b-428a-a80b-08f2907c1a2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:08.404068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-45e644e0-b98b-428a-a80b-08f2907c1a2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:08.405550 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1237/2472] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:50:08 2022] DELETE /identity/v3/projects/8ed80e9428ec40c88dd69151275cd9f8 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:08.409785 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1bb81-3802-429a-ab8e-bf2281b22c0e service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:08.420119 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1bb81-3802-429a-ab8e-bf2281b22c0e service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:08.453686 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:08.486478 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e398c-3b58-47fc-b7a8-0f524c7a30a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:08.487148 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e398c-3b58-47fc-b7a8-0f524c7a30a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:08.487426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e398c-3b58-47fc-b7a8-0f524c7a30a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:08.487697 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e398c-3b58-47fc-b7a8-0f524c7a30a4 admin admin] PATH_INFO: `/v3/users/9db99d78d0b64aa0a738f7902d89f835` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:08.488879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e398c-3b58-47fc-b7a8-0f524c7a30a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9db99d78d0b64aa0a738f7902d89f835)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:08.490861 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e398c-3b58-47fc-b7a8-0f524c7a30a4 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:08.728749 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-eb4e398c-3b58-47fc-b7a8-0f524c7a30a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9db99d78d0b64aa0a738f7902d89f835'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:08.729312 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-eb4e398c-3b58-47fc-b7a8-0f524c7a30a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9db99d78d0b64aa0a738f7902d89f835'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:08.742945 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-eb4e398c-3b58-47fc-b7a8-0f524c7a30a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9db99d78d0b64aa0a738f7902d89f835'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:08.743749 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-eb4e398c-3b58-47fc-b7a8-0f524c7a30a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9db99d78d0b64aa0a738f7902d89f835'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:08.819695 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-eb4e398c-3b58-47fc-b7a8-0f524c7a30a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9db99d78d0b64aa0a738f7902d89f835'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:08.834430 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1236/2473] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:50:08 2022] DELETE /identity/v3/users/9db99d78d0b64aa0a738f7902d89f835 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:09.273085 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e644e0-b98b-428a-a80b-08f2907c1a2a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:09.274565 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-45e644e0-b98b-428a-a80b-08f2907c1a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:09.289942 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e644e0-b98b-428a-a80b-08f2907c1a2a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:09.352307 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26571d81-7711-45d3-8852-2745b45fa4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:09.352949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26571d81-7711-45d3-8852-2745b45fa4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:09.353226 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26571d81-7711-45d3-8852-2745b45fa4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:09.353501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26571d81-7711-45d3-8852-2745b45fa4ab admin admin] PATH_INFO: `/v3/projects/f0becf985ccc4c9ba0cbc2df33aef28b` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:09.356217 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26571d81-7711-45d3-8852-2745b45fa4ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0becf985ccc4c9ba0cbc2df33aef28b)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:09.358807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26571d81-7711-45d3-8852-2745b45fa4ab admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:09.466347 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-26571d81-7711-45d3-8852-2745b45fa4ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0becf985ccc4c9ba0cbc2df33aef28b', 'request_id': 'req-26571d81-7711-45d3-8852-2745b45fa4ab'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:09.545227 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-26571d81-7711-45d3-8852-2745b45fa4ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0becf985ccc4c9ba0cbc2df33aef28b', 'request_id': 'req-26571d81-7711-45d3-8852-2745b45fa4ab'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:09.552353 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-26571d81-7711-45d3-8852-2745b45fa4ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0becf985ccc4c9ba0cbc2df33aef28b', 'request_id': 'req-26571d81-7711-45d3-8852-2745b45fa4ab'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:09.564285 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-26571d81-7711-45d3-8852-2745b45fa4ab admin admin] The token cache is being invalidate because project f0becf985ccc4c9ba0cbc2df33aef28b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:50:09.564578 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-26571d81-7711-45d3-8852-2745b45fa4ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:09.565244 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-26571d81-7711-45d3-8852-2745b45fa4ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:09.566908 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1238/2474] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:50:09 2022] DELETE /identity/v3/projects/f0becf985ccc4c9ba0cbc2df33aef28b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:09.571788 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7448590-c83b-4045-a972-8c1293c3b2ca None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:09.572324 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7448590-c83b-4045-a972-8c1293c3b2ca None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:09.572485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7448590-c83b-4045-a972-8c1293c3b2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:09.596992 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-f7448590-c83b-4045-a972-8c1293c3b2ca None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:09.598268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f7448590-c83b-4045-a972-8c1293c3b2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:09.661005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1237/2475] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:50:09.669485 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff52fa2-f8e5-4f07-a855-9e1b5d95e4c8 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:09.669843 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff52fa2-f8e5-4f07-a855-9e1b5d95e4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:09.670174 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff52fa2-f8e5-4f07-a855-9e1b5d95e4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:09.692707 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-7ff52fa2-f8e5-4f07-a855-9e1b5d95e4c8 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:09.693995 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7ff52fa2-f8e5-4f07-a855-9e1b5d95e4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:09.703048 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1239/2476] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:50:09.707558 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7448590-c83b-4045-a972-8c1293c3b2ca None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:09.718783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7448590-c83b-4045-a972-8c1293c3b2ca None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:09.723602 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab6552-08bf-492e-872f-bd1f40b92953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:09.724639 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab6552-08bf-492e-872f-bd1f40b92953 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:09.724919 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab6552-08bf-492e-872f-bd1f40b92953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:09.725877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab6552-08bf-492e-872f-bd1f40b92953 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:09.725877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab6552-08bf-492e-872f-bd1f40b92953 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:50:09.726154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab6552-08bf-492e-872f-bd1f40b92953 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:09.727816 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab6552-08bf-492e-872f-bd1f40b92953 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:09.740952 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1238/2477] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:50:09.745936 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff52fa2-f8e5-4f07-a855-9e1b5d95e4c8 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:09.757207 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff52fa2-f8e5-4f07-a855-9e1b5d95e4c8 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:09.762669 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd389cc0-0075-46d9-8b0e-75cae0ea441b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:09.763262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd389cc0-0075-46d9-8b0e-75cae0ea441b admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:09.763564 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd389cc0-0075-46d9-8b0e-75cae0ea441b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:09.763837 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd389cc0-0075-46d9-8b0e-75cae0ea441b admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:09.764484 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd389cc0-0075-46d9-8b0e-75cae0ea441b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:09.766473 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd389cc0-0075-46d9-8b0e-75cae0ea441b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:09.843620 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:09.851303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1240/2478] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:50:09 2022] POST /identity/v3/projects => generated 399 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:50:09.855640 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab6552-08bf-492e-872f-bd1f40b92953 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:09.866089 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab6552-08bf-492e-872f-bd1f40b92953 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:09.911495 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:09.926623 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff82b9-7c3a-43cd-9730-4835e434f189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:09.927219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff82b9-7c3a-43cd-9730-4835e434f189 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:09.927525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff82b9-7c3a-43cd-9730-4835e434f189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:09.927795 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff82b9-7c3a-43cd-9730-4835e434f189 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:09.928550 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff82b9-7c3a-43cd-9730-4835e434f189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:09.930513 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff82b9-7c3a-43cd-9730-4835e434f189 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:10.014740 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1239/2479] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:50:09 2022] POST /identity/v3/users => generated 300 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:50:10.020114 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd389cc0-0075-46d9-8b0e-75cae0ea441b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:10.035826 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd389cc0-0075-46d9-8b0e-75cae0ea441b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:10.040679 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c1f73-454a-4054-b333-5e798782d0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:10.041289 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c1f73-454a-4054-b333-5e798782d0dc admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:10.041571 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c1f73-454a-4054-b333-5e798782d0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:10.041874 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c1f73-454a-4054-b333-5e798782d0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:10.042557 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c1f73-454a-4054-b333-5e798782d0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:10.044202 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c1f73-454a-4054-b333-5e798782d0dc admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:10.178667 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1241/2480] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:50:10.182725 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff82b9-7c3a-43cd-9730-4835e434f189 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:10.194030 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff82b9-7c3a-43cd-9730-4835e434f189 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:10.198752 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d192b-e163-445c-9461-fefbd9042fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:10.199353 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d192b-e163-445c-9461-fefbd9042fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:10.200243 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d192b-e163-445c-9461-fefbd9042fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:10.200659 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d192b-e163-445c-9461-fefbd9042fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:10.201315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d192b-e163-445c-9461-fefbd9042fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:10.202987 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d192b-e163-445c-9461-fefbd9042fe6 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:10.214138 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1240/2481] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:50:10.218560 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c1f73-454a-4054-b333-5e798782d0dc admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:10.229050 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c1f73-454a-4054-b333-5e798782d0dc admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:10.234319 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eba7cd-62bd-4c1b-957e-51ab7ca6a2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:10.235410 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eba7cd-62bd-4c1b-957e-51ab7ca6a2d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:10.235410 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eba7cd-62bd-4c1b-957e-51ab7ca6a2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:10.235608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eba7cd-62bd-4c1b-957e-51ab7ca6a2d1 admin admin] PATH_INFO: `/v3/projects/b2f30d7f3db547f2ad7c370a4840a69b/users/2a594f31d5db4d14b741a9325a22e2a4/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:10.252512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eba7cd-62bd-4c1b-957e-51ab7ca6a2d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2f30d7f3db547f2ad7c370a4840a69b, user_id=2a594f31d5db4d14b741a9325a22e2a4, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:10.255308 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eba7cd-62bd-4c1b-957e-51ab7ca6a2d1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:10.345812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1242/2482] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:50:10 2022] PUT /identity/v3/projects/b2f30d7f3db547f2ad7c370a4840a69b/users/2a594f31d5db4d14b741a9325a22e2a4/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:10.357836 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0f0f0-141b-4d0a-9d58-50fa04538c15 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:10.358149 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0f0f0-141b-4d0a-9d58-50fa04538c15 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:10.358418 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0f0f0-141b-4d0a-9d58-50fa04538c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:10.388220 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-20d0f0f0-141b-4d0a-9d58-50fa04538c15 None None] MFA Rules not processed for user `2a594f31d5db4d14b741a9325a22e2a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:10.389548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-20d0f0f0-141b-4d0a-9d58-50fa04538c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:10.456428 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1241/2483] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:10 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:50:10.460781 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eba7cd-62bd-4c1b-957e-51ab7ca6a2d1 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:10.525423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eba7cd-62bd-4c1b-957e-51ab7ca6a2d1 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:10.533001 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9236f-2ac5-467d-a04f-43bc1ae120d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:10.533790 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9236f-2ac5-467d-a04f-43bc1ae120d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:10.534127 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9236f-2ac5-467d-a04f-43bc1ae120d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:10.534494 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9236f-2ac5-467d-a04f-43bc1ae120d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:10.535360 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9236f-2ac5-467d-a04f-43bc1ae120d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:10.537453 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9236f-2ac5-467d-a04f-43bc1ae120d5 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:10.660880 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1243/2484] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:50:10 2022] POST /identity/v3/projects => generated 399 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:50:10.665047 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0f0f0-141b-4d0a-9d58-50fa04538c15 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:10.676884 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0f0f0-141b-4d0a-9d58-50fa04538c15 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:10.734457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c815233-0eec-496a-9036-875d33c11918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:10.734979 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c815233-0eec-496a-9036-875d33c11918 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:10.735256 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c815233-0eec-496a-9036-875d33c11918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:10.735527 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c815233-0eec-496a-9036-875d33c11918 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:10.736146 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c815233-0eec-496a-9036-875d33c11918 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:10.738150 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c815233-0eec-496a-9036-875d33c11918 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:10.833189 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1242/2485] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:50:10 2022] POST /identity/v3/users => generated 306 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:50:10.838086 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9236f-2ac5-467d-a04f-43bc1ae120d5 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:10.849761 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9236f-2ac5-467d-a04f-43bc1ae120d5 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:10.854821 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e374b-9296-4f96-873e-baf6efcecfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:10.855453 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e374b-9296-4f96-873e-baf6efcecfcd admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:10.855733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e374b-9296-4f96-873e-baf6efcecfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:10.858069 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e374b-9296-4f96-873e-baf6efcecfcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:10.858069 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e374b-9296-4f96-873e-baf6efcecfcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:10.858985 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e374b-9296-4f96-873e-baf6efcecfcd admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:10.869234 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1244/2486] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:50:10.874320 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c815233-0eec-496a-9036-875d33c11918 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:10.884800 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c815233-0eec-496a-9036-875d33c11918 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:10.889907 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa75002-5ad7-40ad-87e9-c0be75dfc34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:10.890553 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa75002-5ad7-40ad-87e9-c0be75dfc34f admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:10.890859 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa75002-5ad7-40ad-87e9-c0be75dfc34f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:10.891132 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa75002-5ad7-40ad-87e9-c0be75dfc34f admin admin] PATH_INFO: `/v3/projects/df441bf384364be19378ff7be27ae0b6/users/05bb55e9f991493c89aff7d5b61d2ff0/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:10.906638 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa75002-5ad7-40ad-87e9-c0be75dfc34f admin admin] RBAC: Authorizing `identity:create_grant(project_id=df441bf384364be19378ff7be27ae0b6, user_id=05bb55e9f991493c89aff7d5b61d2ff0, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:10.909289 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa75002-5ad7-40ad-87e9-c0be75dfc34f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:10.986927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1243/2487] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:50:10 2022] PUT /identity/v3/projects/df441bf384364be19378ff7be27ae0b6/users/05bb55e9f991493c89aff7d5b61d2ff0/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:10.991128 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e374b-9296-4f96-873e-baf6efcecfcd admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:11.001657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e374b-9296-4f96-873e-baf6efcecfcd admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:11.060339 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8764903-94ed-4f38-9b8d-8e12feb46995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:11.060942 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8764903-94ed-4f38-9b8d-8e12feb46995 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:11.061228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8764903-94ed-4f38-9b8d-8e12feb46995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:11.061500 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8764903-94ed-4f38-9b8d-8e12feb46995 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:11.062187 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8764903-94ed-4f38-9b8d-8e12feb46995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:11.063779 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8764903-94ed-4f38-9b8d-8e12feb46995 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:11.073373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1245/2488] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:50:11.078487 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa75002-5ad7-40ad-87e9-c0be75dfc34f admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:11.088834 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa75002-5ad7-40ad-87e9-c0be75dfc34f admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:11.094378 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4d638-f497-4ada-9ff8-8b2ac936ddc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:11.095031 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4d638-f497-4ada-9ff8-8b2ac936ddc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:11.095306 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4d638-f497-4ada-9ff8-8b2ac936ddc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:11.095578 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4d638-f497-4ada-9ff8-8b2ac936ddc2 admin admin] PATH_INFO: `/v3/projects/df441bf384364be19378ff7be27ae0b6/users/05bb55e9f991493c89aff7d5b61d2ff0/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:11.097478 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a4d638-f497-4ada-9ff8-8b2ac936ddc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df441bf384364be19378ff7be27ae0b6, user_id=05bb55e9f991493c89aff7d5b61d2ff0, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:11.100544 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a4d638-f497-4ada-9ff8-8b2ac936ddc2 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:11.112953 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1244/2489] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:50:11 2022] PUT /identity/v3/projects/df441bf384364be19378ff7be27ae0b6/users/05bb55e9f991493c89aff7d5b61d2ff0/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:11.123319 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5f025-80e6-4a57-bb68-5e7d40d2023e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:11.123599 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5f025-80e6-4a57-bb68-5e7d40d2023e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:11.126517 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5f025-80e6-4a57-bb68-5e7d40d2023e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:11.155801 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a4a5f025-80e6-4a57-bb68-5e7d40d2023e None None] MFA Rules not processed for user `05bb55e9f991493c89aff7d5b61d2ff0`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:11.161035 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a4a5f025-80e6-4a57-bb68-5e7d40d2023e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:11.177737 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:11.228376 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1246/2490] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:11 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:50:11.245984 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4d638-f497-4ada-9ff8-8b2ac936ddc2 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:11.245984 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-91a4d638-f497-4ada-9ff8-8b2ac936ddc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:11.247566 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:11.301713 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4d638-f497-4ada-9ff8-8b2ac936ddc2 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:11.305334 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d985eff-8f6c-4a11-aefe-c8db4bf7b4f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:11.309933 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d985eff-8f6c-4a11-aefe-c8db4bf7b4f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:11.309933 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d985eff-8f6c-4a11-aefe-c8db4bf7b4f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:11.309933 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d985eff-8f6c-4a11-aefe-c8db4bf7b4f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:11.316825 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d985eff-8f6c-4a11-aefe-c8db4bf7b4f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:11.318366 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d985eff-8f6c-4a11-aefe-c8db4bf7b4f0 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:11.328638 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1245/2491] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:50:11 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:50:11.600630 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5f025-80e6-4a57-bb68-5e7d40d2023e None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:11.612270 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5f025-80e6-4a57-bb68-5e7d40d2023e None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:11.615870 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0b9f0-51b0-4abd-9c96-b562cf43ce9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:11.616472 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0b9f0-51b0-4abd-9c96-b562cf43ce9b service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:11.616752 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0b9f0-51b0-4abd-9c96-b562cf43ce9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:11.617020 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0b9f0-51b0-4abd-9c96-b562cf43ce9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:11.674480 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0b9f0-51b0-4abd-9c96-b562cf43ce9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:11.675987 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0b9f0-51b0-4abd-9c96-b562cf43ce9b service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:11.685365 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1247/2492] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:50:11 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:50:17.696898 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d985eff-8f6c-4a11-aefe-c8db4bf7b4f0 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:17.760130 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d985eff-8f6c-4a11-aefe-c8db4bf7b4f0 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:17.764802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aceffc-d615-4e2c-bd80-99fd44b1711d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:17.765424 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aceffc-d615-4e2c-bd80-99fd44b1711d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:17.765704 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aceffc-d615-4e2c-bd80-99fd44b1711d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:17.766006 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aceffc-d615-4e2c-bd80-99fd44b1711d admin admin] PATH_INFO: `/v3/users/2a594f31d5db4d14b741a9325a22e2a4` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:17.767268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aceffc-d615-4e2c-bd80-99fd44b1711d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a594f31d5db4d14b741a9325a22e2a4)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:17.769271 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aceffc-d615-4e2c-bd80-99fd44b1711d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:17.961441 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-45aceffc-d615-4e2c-bd80-99fd44b1711d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a594f31d5db4d14b741a9325a22e2a4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:17.962064 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-45aceffc-d615-4e2c-bd80-99fd44b1711d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a594f31d5db4d14b741a9325a22e2a4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:17.975428 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-45aceffc-d615-4e2c-bd80-99fd44b1711d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a594f31d5db4d14b741a9325a22e2a4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:17.976115 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-45aceffc-d615-4e2c-bd80-99fd44b1711d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a594f31d5db4d14b741a9325a22e2a4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:18.042286 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-45aceffc-d615-4e2c-bd80-99fd44b1711d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a594f31d5db4d14b741a9325a22e2a4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:18.056969 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1246/2493] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:50:17 2022] DELETE /identity/v3/users/2a594f31d5db4d14b741a9325a22e2a4 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:18.061862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce332b5b-6a19-4c18-9167-bcffbde097d4 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:18.064158 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce332b5b-6a19-4c18-9167-bcffbde097d4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:18.064158 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce332b5b-6a19-4c18-9167-bcffbde097d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:18.081541 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ce332b5b-6a19-4c18-9167-bcffbde097d4 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:18.082675 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ce332b5b-6a19-4c18-9167-bcffbde097d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:18.141976 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1248/2494] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:50:18.151437 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aceffc-d615-4e2c-bd80-99fd44b1711d admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:18.153431 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-45aceffc-d615-4e2c-bd80-99fd44b1711d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:18.183517 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:18.210397 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aceffc-d615-4e2c-bd80-99fd44b1711d admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:18.214609 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92fbed-9b58-42c5-9682-afaff39896de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:18.215813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92fbed-9b58-42c5-9682-afaff39896de service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:18.216090 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92fbed-9b58-42c5-9682-afaff39896de service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:18.216365 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92fbed-9b58-42c5-9682-afaff39896de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:18.226121 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e92fbed-9b58-42c5-9682-afaff39896de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:18.227595 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e92fbed-9b58-42c5-9682-afaff39896de service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:18.238181 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1247/2495] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:50:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:50:18.649666 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce332b5b-6a19-4c18-9167-bcffbde097d4 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:18.651347 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ce332b5b-6a19-4c18-9167-bcffbde097d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:18.666544 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce332b5b-6a19-4c18-9167-bcffbde097d4 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:18.670322 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a14c5-85d1-42e9-ae08-2caf3ed824d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:18.670939 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a14c5-85d1-42e9-ae08-2caf3ed824d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:18.671242 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a14c5-85d1-42e9-ae08-2caf3ed824d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:18.671484 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a14c5-85d1-42e9-ae08-2caf3ed824d0 admin admin] PATH_INFO: `/v3/projects/b2f30d7f3db547f2ad7c370a4840a69b` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:18.672703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a14c5-85d1-42e9-ae08-2caf3ed824d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2f30d7f3db547f2ad7c370a4840a69b)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:18.675080 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a14c5-85d1-42e9-ae08-2caf3ed824d0 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:18.781349 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b45a14c5-85d1-42e9-ae08-2caf3ed824d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2f30d7f3db547f2ad7c370a4840a69b', 'request_id': 'req-b45a14c5-85d1-42e9-ae08-2caf3ed824d0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:18.783905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:18.870859 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b45a14c5-85d1-42e9-ae08-2caf3ed824d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2f30d7f3db547f2ad7c370a4840a69b', 'request_id': 'req-b45a14c5-85d1-42e9-ae08-2caf3ed824d0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:18.877928 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b45a14c5-85d1-42e9-ae08-2caf3ed824d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2f30d7f3db547f2ad7c370a4840a69b', 'request_id': 'req-b45a14c5-85d1-42e9-ae08-2caf3ed824d0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:18.889505 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b45a14c5-85d1-42e9-ae08-2caf3ed824d0 admin admin] The token cache is being invalidate because project b2f30d7f3db547f2ad7c370a4840a69b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:50:18.889825 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b45a14c5-85d1-42e9-ae08-2caf3ed824d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:18.890481 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b45a14c5-85d1-42e9-ae08-2caf3ed824d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:18.892191 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1249/2496] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:50:18 2022] DELETE /identity/v3/projects/b2f30d7f3db547f2ad7c370a4840a69b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:18.896283 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92fbed-9b58-42c5-9682-afaff39896de service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:18.907823 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92fbed-9b58-42c5-9682-afaff39896de service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:18.973204 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e4f7d-0186-4beb-9625-92bb4f210031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:18.974168 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e4f7d-0186-4beb-9625-92bb4f210031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:18.974446 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e4f7d-0186-4beb-9625-92bb4f210031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:18.974719 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e4f7d-0186-4beb-9625-92bb4f210031 admin admin] PATH_INFO: `/v3/users/05bb55e9f991493c89aff7d5b61d2ff0` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:18.975881 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e4f7d-0186-4beb-9625-92bb4f210031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05bb55e9f991493c89aff7d5b61d2ff0)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:18.978131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e4f7d-0186-4beb-9625-92bb4f210031 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:19.148533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a81e4f7d-0186-4beb-9625-92bb4f210031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05bb55e9f991493c89aff7d5b61d2ff0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:19.149369 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a81e4f7d-0186-4beb-9625-92bb4f210031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05bb55e9f991493c89aff7d5b61d2ff0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:19.163655 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a81e4f7d-0186-4beb-9625-92bb4f210031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05bb55e9f991493c89aff7d5b61d2ff0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:19.164417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a81e4f7d-0186-4beb-9625-92bb4f210031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05bb55e9f991493c89aff7d5b61d2ff0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:19.230594 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a81e4f7d-0186-4beb-9625-92bb4f210031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05bb55e9f991493c89aff7d5b61d2ff0'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:19.244413 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1248/2497] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:50:18 2022] DELETE /identity/v3/users/05bb55e9f991493c89aff7d5b61d2ff0 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:19.707374 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a14c5-85d1-42e9-ae08-2caf3ed824d0 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:19.709013 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b45a14c5-85d1-42e9-ae08-2caf3ed824d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:19.724703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a14c5-85d1-42e9-ae08-2caf3ed824d0 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:19.785107 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc792f-febc-4e72-8ae4-359391dd427c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:19.785740 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc792f-febc-4e72-8ae4-359391dd427c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:19.786042 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc792f-febc-4e72-8ae4-359391dd427c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:19.786312 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc792f-febc-4e72-8ae4-359391dd427c admin admin] PATH_INFO: `/v3/projects/df441bf384364be19378ff7be27ae0b6` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:19.787421 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc792f-febc-4e72-8ae4-359391dd427c admin admin] RBAC: Authorizing `identity:delete_project(project_id=df441bf384364be19378ff7be27ae0b6)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:19.789318 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc792f-febc-4e72-8ae4-359391dd427c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:19.969134 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-96bc792f-febc-4e72-8ae4-359391dd427c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df441bf384364be19378ff7be27ae0b6', 'request_id': 'req-96bc792f-febc-4e72-8ae4-359391dd427c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:20.047857 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-96bc792f-febc-4e72-8ae4-359391dd427c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df441bf384364be19378ff7be27ae0b6', 'request_id': 'req-96bc792f-febc-4e72-8ae4-359391dd427c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:20.054958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-96bc792f-febc-4e72-8ae4-359391dd427c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df441bf384364be19378ff7be27ae0b6', 'request_id': 'req-96bc792f-febc-4e72-8ae4-359391dd427c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:20.066383 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-96bc792f-febc-4e72-8ae4-359391dd427c admin admin] The token cache is being invalidate because project df441bf384364be19378ff7be27ae0b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:50:20.066674 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-96bc792f-febc-4e72-8ae4-359391dd427c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:20.067356 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-96bc792f-febc-4e72-8ae4-359391dd427c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:20.070328 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1250/2498] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:50:19 2022] DELETE /identity/v3/projects/df441bf384364be19378ff7be27ae0b6 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:20.073835 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96976d-d7ec-45b8-b304-44218c64c5c2 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:20.074335 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96976d-d7ec-45b8-b304-44218c64c5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:20.074968 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96976d-d7ec-45b8-b304-44218c64c5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:20.094864 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-2a96976d-d7ec-45b8-b304-44218c64c5c2 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:20.096089 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2a96976d-d7ec-45b8-b304-44218c64c5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:20.141976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:20.157553 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1249/2499] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:50:20.167202 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda0c86-4bdb-402f-b308-dbd4c81a6918 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:20.167513 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda0c86-4bdb-402f-b308-dbd4c81a6918 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:20.167767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda0c86-4bdb-402f-b308-dbd4c81a6918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:20.188208 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4bda0c86-4bdb-402f-b308-dbd4c81a6918 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:20.189433 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4bda0c86-4bdb-402f-b308-dbd4c81a6918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:20.197504 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1251/2500] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:50:20.202930 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96976d-d7ec-45b8-b304-44218c64c5c2 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:20.213146 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96976d-d7ec-45b8-b304-44218c64c5c2 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:20.218191 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7046c68-a7c7-4b9a-a8e1-3606fb911c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:20.218802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7046c68-a7c7-4b9a-a8e1-3606fb911c72 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:20.219083 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7046c68-a7c7-4b9a-a8e1-3606fb911c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:20.219451 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7046c68-a7c7-4b9a-a8e1-3606fb911c72 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:20.220046 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7046c68-a7c7-4b9a-a8e1-3606fb911c72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:50:20.220350 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7046c68-a7c7-4b9a-a8e1-3606fb911c72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:20.222043 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7046c68-a7c7-4b9a-a8e1-3606fb911c72 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:20.235689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1250/2501] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:50:20.240356 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda0c86-4bdb-402f-b308-dbd4c81a6918 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:20.250372 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda0c86-4bdb-402f-b308-dbd4c81a6918 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:20.255311 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189f272-7e22-4df9-a7a5-6be936ba6c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:20.255923 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189f272-7e22-4df9-a7a5-6be936ba6c63 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:20.256208 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189f272-7e22-4df9-a7a5-6be936ba6c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:20.256476 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189f272-7e22-4df9-a7a5-6be936ba6c63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:20.257136 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189f272-7e22-4df9-a7a5-6be936ba6c63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:20.260542 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189f272-7e22-4df9-a7a5-6be936ba6c63 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:20.386818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1252/2502] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:50:20 2022] POST /identity/v3/projects => generated 367 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:50:20.391082 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7046c68-a7c7-4b9a-a8e1-3606fb911c72 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:20.401382 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7046c68-a7c7-4b9a-a8e1-3606fb911c72 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:20.459627 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b607d-b245-4ba6-a6fa-653d0b173568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:20.460245 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b607d-b245-4ba6-a6fa-653d0b173568 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:20.460533 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b607d-b245-4ba6-a6fa-653d0b173568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:20.460811 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b607d-b245-4ba6-a6fa-653d0b173568 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:20.461481 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b607d-b245-4ba6-a6fa-653d0b173568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:20.463467 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b607d-b245-4ba6-a6fa-653d0b173568 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:20.546594 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1251/2503] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:50:20 2022] POST /identity/v3/users => generated 284 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:50:20.550824 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189f272-7e22-4df9-a7a5-6be936ba6c63 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:20.562111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189f272-7e22-4df9-a7a5-6be936ba6c63 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:20.566875 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bcf80c-f99a-49d2-a666-c8adf346724b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:20.573313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcf80c-f99a-49d2-a666-c8adf346724b admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:20.573313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcf80c-f99a-49d2-a666-c8adf346724b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:20.573313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcf80c-f99a-49d2-a666-c8adf346724b admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:20.573313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bcf80c-f99a-49d2-a666-c8adf346724b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:20.573313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bcf80c-f99a-49d2-a666-c8adf346724b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:20.580592 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1253/2504] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:50:20.584926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b607d-b245-4ba6-a6fa-653d0b173568 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:20.596189 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b607d-b245-4ba6-a6fa-653d0b173568 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:20.601427 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981835fe-4dc4-49e4-8967-94f281fe452b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:20.602081 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981835fe-4dc4-49e4-8967-94f281fe452b admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:20.602364 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981835fe-4dc4-49e4-8967-94f281fe452b admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:20.602640 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981835fe-4dc4-49e4-8967-94f281fe452b admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:20.603286 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981835fe-4dc4-49e4-8967-94f281fe452b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:20.604896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981835fe-4dc4-49e4-8967-94f281fe452b admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:20.616898 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1252/2505] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:50:20.621295 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bcf80c-f99a-49d2-a666-c8adf346724b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:20.631965 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bcf80c-f99a-49d2-a666-c8adf346724b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:20.636769 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c72953-95d3-45b5-85ce-d9de92208d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:20.637600 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c72953-95d3-45b5-85ce-d9de92208d90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:20.637935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c72953-95d3-45b5-85ce-d9de92208d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:20.638207 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c72953-95d3-45b5-85ce-d9de92208d90 admin admin] PATH_INFO: `/v3/projects/852a2ab282d5428ea235ef621012e102/users/2b9ac94ed71f487384815026cd639dac/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:20.653606 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c72953-95d3-45b5-85ce-d9de92208d90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=852a2ab282d5428ea235ef621012e102, user_id=2b9ac94ed71f487384815026cd639dac, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:20.656288 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c72953-95d3-45b5-85ce-d9de92208d90 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:20.735188 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1254/2506] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:50:20 2022] PUT /identity/v3/projects/852a2ab282d5428ea235ef621012e102/users/2b9ac94ed71f487384815026cd639dac/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:20.745676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9b96b-fbc8-4cea-8890-e00d7af8418d None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:20.746015 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9b96b-fbc8-4cea-8890-e00d7af8418d None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:20.746317 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9b96b-fbc8-4cea-8890-e00d7af8418d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:20.774746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-c7e9b96b-fbc8-4cea-8890-e00d7af8418d None None] MFA Rules not processed for user `2b9ac94ed71f487384815026cd639dac`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:20.776388 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c7e9b96b-fbc8-4cea-8890-e00d7af8418d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:20.843108 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1253/2507] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:50:20.847689 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c72953-95d3-45b5-85ce-d9de92208d90 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:20.857841 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:20.913157 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c72953-95d3-45b5-85ce-d9de92208d90 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:20.919190 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a130f-ed17-40af-9efc-18ae5efb911d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:20.919791 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a130f-ed17-40af-9efc-18ae5efb911d admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:20.920066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a130f-ed17-40af-9efc-18ae5efb911d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:20.920335 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a130f-ed17-40af-9efc-18ae5efb911d admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:20.920967 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a130f-ed17-40af-9efc-18ae5efb911d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:20.923171 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a130f-ed17-40af-9efc-18ae5efb911d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:20.993654 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1255/2508] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:50:20 2022] POST /identity/v3/projects => generated 365 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:50:20.998029 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9b96b-fbc8-4cea-8890-e00d7af8418d None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:21.009107 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9b96b-fbc8-4cea-8890-e00d7af8418d None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:21.054473 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:21.070028 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2567c-0fcc-4159-a87d-9476dc0de74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:21.070644 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2567c-0fcc-4159-a87d-9476dc0de74f admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:21.070918 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2567c-0fcc-4159-a87d-9476dc0de74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:21.071316 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2567c-0fcc-4159-a87d-9476dc0de74f admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:21.071915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2567c-0fcc-4159-a87d-9476dc0de74f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:21.073857 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2567c-0fcc-4159-a87d-9476dc0de74f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:21.167325 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1254/2509] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:50:20 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:50:21.168672 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a130f-ed17-40af-9efc-18ae5efb911d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:21.180678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a130f-ed17-40af-9efc-18ae5efb911d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:21.185320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630239a-f6ed-43cf-8105-d30fd6915641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:21.193098 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630239a-f6ed-43cf-8105-d30fd6915641 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:21.193098 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630239a-f6ed-43cf-8105-d30fd6915641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:21.193098 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630239a-f6ed-43cf-8105-d30fd6915641 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:21.193098 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630239a-f6ed-43cf-8105-d30fd6915641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:21.193098 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630239a-f6ed-43cf-8105-d30fd6915641 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:21.202494 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1256/2510] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:50:21.206977 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2567c-0fcc-4159-a87d-9476dc0de74f admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:21.219111 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2567c-0fcc-4159-a87d-9476dc0de74f admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:21.224847 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d05a2f-43ab-4e0a-80ea-273167fb6e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:21.225583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d05a2f-43ab-4e0a-80ea-273167fb6e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:21.225953 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d05a2f-43ab-4e0a-80ea-273167fb6e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:21.226308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d05a2f-43ab-4e0a-80ea-273167fb6e81 admin admin] PATH_INFO: `/v3/projects/db3157e26b054e8584ab34e36a26ba95/users/ddd6bf5b08bb45b4be25d775cdac2de0/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:21.242389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d05a2f-43ab-4e0a-80ea-273167fb6e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db3157e26b054e8584ab34e36a26ba95, user_id=ddd6bf5b08bb45b4be25d775cdac2de0, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:21.245067 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d05a2f-43ab-4e0a-80ea-273167fb6e81 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:21.392373 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1255/2511] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:50:21 2022] PUT /identity/v3/projects/db3157e26b054e8584ab34e36a26ba95/users/ddd6bf5b08bb45b4be25d775cdac2de0/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:21.397355 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630239a-f6ed-43cf-8105-d30fd6915641 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:21.407714 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630239a-f6ed-43cf-8105-d30fd6915641 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:21.469360 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d05f6-1a56-4418-9034-6cb755fa99a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:21.469987 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d05f6-1a56-4418-9034-6cb755fa99a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:21.470263 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d05f6-1a56-4418-9034-6cb755fa99a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:21.470533 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d05f6-1a56-4418-9034-6cb755fa99a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:21.471172 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d05f6-1a56-4418-9034-6cb755fa99a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:21.472762 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d05f6-1a56-4418-9034-6cb755fa99a8 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:21.483732 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1257/2512] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:50:21.489860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d05a2f-43ab-4e0a-80ea-273167fb6e81 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:21.501724 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d05a2f-43ab-4e0a-80ea-273167fb6e81 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:21.506566 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98095e-6905-41a4-9191-b495a9f08037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:21.507221 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98095e-6905-41a4-9191-b495a9f08037 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:21.507572 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98095e-6905-41a4-9191-b495a9f08037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:21.507923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98095e-6905-41a4-9191-b495a9f08037 admin admin] PATH_INFO: `/v3/projects/db3157e26b054e8584ab34e36a26ba95/users/ddd6bf5b08bb45b4be25d775cdac2de0/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:21.509840 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98095e-6905-41a4-9191-b495a9f08037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db3157e26b054e8584ab34e36a26ba95, user_id=ddd6bf5b08bb45b4be25d775cdac2de0, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:21.513143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98095e-6905-41a4-9191-b495a9f08037 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:21.523946 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1256/2513] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:50:21 2022] PUT /identity/v3/projects/db3157e26b054e8584ab34e36a26ba95/users/ddd6bf5b08bb45b4be25d775cdac2de0/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:21.534446 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32ee8c-c3a9-4433-8925-1fd167734c44 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:21.534729 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32ee8c-c3a9-4433-8925-1fd167734c44 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:21.534999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32ee8c-c3a9-4433-8925-1fd167734c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:21.566384 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-6a32ee8c-c3a9-4433-8925-1fd167734c44 None None] MFA Rules not processed for user `ddd6bf5b08bb45b4be25d775cdac2de0`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:21.567797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6a32ee8c-c3a9-4433-8925-1fd167734c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:21.646592 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1258/2514] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:21 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:50:21.659314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98095e-6905-41a4-9191-b495a9f08037 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:21.661277 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3c98095e-6905-41a4-9191-b495a9f08037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:21.731738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98095e-6905-41a4-9191-b495a9f08037 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:21.735558 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb0613-2c43-48ce-a57b-fb34ece23522 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:21.736163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb0613-2c43-48ce-a57b-fb34ece23522 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:21.736439 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb0613-2c43-48ce-a57b-fb34ece23522 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:21.736713 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb0613-2c43-48ce-a57b-fb34ece23522 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:21.746743 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb0613-2c43-48ce-a57b-fb34ece23522 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:21.748458 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb0613-2c43-48ce-a57b-fb34ece23522 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:21.758628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1257/2515] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:50:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:50:22.080933 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32ee8c-c3a9-4433-8925-1fd167734c44 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:22.085540 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:22.091583 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32ee8c-c3a9-4433-8925-1fd167734c44 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:22.095435 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2300d-511e-4e04-b849-1a75c1c2368f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:22.096064 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2300d-511e-4e04-b849-1a75c1c2368f service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:22.096341 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2300d-511e-4e04-b849-1a75c1c2368f service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:22.096614 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2300d-511e-4e04-b849-1a75c1c2368f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:22.156702 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2300d-511e-4e04-b849-1a75c1c2368f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:22.158190 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2300d-511e-4e04-b849-1a75c1c2368f service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:22.167914 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1259/2516] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:50:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:50:25.024232 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb0613-2c43-48ce-a57b-fb34ece23522 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:25.026488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-8ecb0613-2c43-48ce-a57b-fb34ece23522 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:25.161549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb0613-2c43-48ce-a57b-fb34ece23522 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:25.169268 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16c952-6392-4f47-b4f1-568fe4d2119c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:25.170109 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16c952-6392-4f47-b4f1-568fe4d2119c service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:25.170397 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16c952-6392-4f47-b4f1-568fe4d2119c service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:25.170790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16c952-6392-4f47-b4f1-568fe4d2119c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:25.173204 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0d16c952-6392-4f47-b4f1-568fe4d2119c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:25.187260 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16c952-6392-4f47-b4f1-568fe4d2119c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:25.189018 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16c952-6392-4f47-b4f1-568fe4d2119c service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:25.200968 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1258/2517] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:50:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:50:30.418518 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2300d-511e-4e04-b849-1a75c1c2368f service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:30.490607 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2300d-511e-4e04-b849-1a75c1c2368f service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:30.495669 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab662558-aaff-474e-9052-a064ebe806dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:30.497140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab662558-aaff-474e-9052-a064ebe806dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:30.497280 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab662558-aaff-474e-9052-a064ebe806dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:30.497542 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab662558-aaff-474e-9052-a064ebe806dd admin admin] PATH_INFO: `/v3/users/2b9ac94ed71f487384815026cd639dac` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:30.498874 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab662558-aaff-474e-9052-a064ebe806dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b9ac94ed71f487384815026cd639dac)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:30.500792 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab662558-aaff-474e-9052-a064ebe806dd admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:30.619473 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16c952-6392-4f47-b4f1-568fe4d2119c service nova] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:30.621470 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0d16c952-6392-4f47-b4f1-568fe4d2119c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:30.651581 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:30.682590 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16c952-6392-4f47-b4f1-568fe4d2119c service nova] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:30.687091 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413664e-93f6-480e-b187-d15354289ef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:30.687738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413664e-93f6-480e-b187-d15354289ef7 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:30.688020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413664e-93f6-480e-b187-d15354289ef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:30.688291 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413664e-93f6-480e-b187-d15354289ef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:30.690185 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d413664e-93f6-480e-b187-d15354289ef7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:30.704176 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413664e-93f6-480e-b187-d15354289ef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:30.705812 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413664e-93f6-480e-b187-d15354289ef7 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:30.717229 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1259/2518] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:50:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:50:30.806249 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ab662558-aaff-474e-9052-a064ebe806dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b9ac94ed71f487384815026cd639dac'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:30.807018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ab662558-aaff-474e-9052-a064ebe806dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b9ac94ed71f487384815026cd639dac'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:30.807699 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ab662558-aaff-474e-9052-a064ebe806dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b9ac94ed71f487384815026cd639dac'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:30.821809 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ab662558-aaff-474e-9052-a064ebe806dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b9ac94ed71f487384815026cd639dac'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:30.910565 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ab662558-aaff-474e-9052-a064ebe806dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b9ac94ed71f487384815026cd639dac'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:30.927283 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1260/2519] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:50:30 2022] DELETE /identity/v3/users/2b9ac94ed71f487384815026cd639dac => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:30.932012 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2073e0-c7e9-43e2-96a5-fdd51eb7430a None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:30.932299 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2073e0-c7e9-43e2-96a5-fdd51eb7430a None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:30.932576 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2073e0-c7e9-43e2-96a5-fdd51eb7430a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:30.953496 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ea2073e0-c7e9-43e2-96a5-fdd51eb7430a None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:30.955224 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ea2073e0-c7e9-43e2-96a5-fdd51eb7430a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:31.019796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1260/2520] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:50:31.029934 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab662558-aaff-474e-9052-a064ebe806dd admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:31.031376 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ab662558-aaff-474e-9052-a064ebe806dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:31.057340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:31.095835 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab662558-aaff-474e-9052-a064ebe806dd admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:31.100008 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62021195-0646-42d9-bc07-a3bb3c3bc140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:31.100620 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62021195-0646-42d9-bc07-a3bb3c3bc140 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:31.100899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62021195-0646-42d9-bc07-a3bb3c3bc140 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:31.101175 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62021195-0646-42d9-bc07-a3bb3c3bc140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:31.111474 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62021195-0646-42d9-bc07-a3bb3c3bc140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:31.113381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62021195-0646-42d9-bc07-a3bb3c3bc140 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:31.123022 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1261/2521] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:50:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:50:31.581820 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2073e0-c7e9-43e2-96a5-fdd51eb7430a None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:31.584582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ea2073e0-c7e9-43e2-96a5-fdd51eb7430a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:31.603300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2073e0-c7e9-43e2-96a5-fdd51eb7430a None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:31.608621 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f18f86-426a-4ec1-8e42-b6afc7ee52f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:31.609322 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f18f86-426a-4ec1-8e42-b6afc7ee52f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:31.609610 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f18f86-426a-4ec1-8e42-b6afc7ee52f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:31.609921 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f18f86-426a-4ec1-8e42-b6afc7ee52f7 admin admin] PATH_INFO: `/v3/projects/852a2ab282d5428ea235ef621012e102` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:31.611172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f18f86-426a-4ec1-8e42-b6afc7ee52f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=852a2ab282d5428ea235ef621012e102)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:31.613139 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f18f86-426a-4ec1-8e42-b6afc7ee52f7 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:31.716294 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-36f18f86-426a-4ec1-8e42-b6afc7ee52f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '852a2ab282d5428ea235ef621012e102', 'request_id': 'req-36f18f86-426a-4ec1-8e42-b6afc7ee52f7'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:31.768617 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-36f18f86-426a-4ec1-8e42-b6afc7ee52f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '852a2ab282d5428ea235ef621012e102', 'request_id': 'req-36f18f86-426a-4ec1-8e42-b6afc7ee52f7'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:31.775629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-36f18f86-426a-4ec1-8e42-b6afc7ee52f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '852a2ab282d5428ea235ef621012e102', 'request_id': 'req-36f18f86-426a-4ec1-8e42-b6afc7ee52f7'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:31.788439 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-36f18f86-426a-4ec1-8e42-b6afc7ee52f7 admin admin] The token cache is being invalidate because project 852a2ab282d5428ea235ef621012e102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:50:31.788849 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-36f18f86-426a-4ec1-8e42-b6afc7ee52f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:31.789518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-36f18f86-426a-4ec1-8e42-b6afc7ee52f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:31.791050 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1261/2522] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:50:31 2022] DELETE /identity/v3/projects/852a2ab282d5428ea235ef621012e102 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:31.797691 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62021195-0646-42d9-bc07-a3bb3c3bc140 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:31.807890 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62021195-0646-42d9-bc07-a3bb3c3bc140 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:31.913090 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21c5fa-29a9-49b7-9ff8-1546d1aa37fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:31.914864 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21c5fa-29a9-49b7-9ff8-1546d1aa37fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:31.915335 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21c5fa-29a9-49b7-9ff8-1546d1aa37fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:31.915810 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21c5fa-29a9-49b7-9ff8-1546d1aa37fa admin admin] PATH_INFO: `/v3/users/ddd6bf5b08bb45b4be25d775cdac2de0` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:31.918768 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21c5fa-29a9-49b7-9ff8-1546d1aa37fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddd6bf5b08bb45b4be25d775cdac2de0)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:31.921832 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21c5fa-29a9-49b7-9ff8-1546d1aa37fa admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:32.182466 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2e21c5fa-29a9-49b7-9ff8-1546d1aa37fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddd6bf5b08bb45b4be25d775cdac2de0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:32.183032 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2e21c5fa-29a9-49b7-9ff8-1546d1aa37fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddd6bf5b08bb45b4be25d775cdac2de0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:32.184625 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2e21c5fa-29a9-49b7-9ff8-1546d1aa37fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddd6bf5b08bb45b4be25d775cdac2de0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:32.200039 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2e21c5fa-29a9-49b7-9ff8-1546d1aa37fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddd6bf5b08bb45b4be25d775cdac2de0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:32.282106 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2e21c5fa-29a9-49b7-9ff8-1546d1aa37fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddd6bf5b08bb45b4be25d775cdac2de0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:32.296901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1262/2523] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:50:31 2022] DELETE /identity/v3/users/ddd6bf5b08bb45b4be25d775cdac2de0 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:32.820788 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f18f86-426a-4ec1-8e42-b6afc7ee52f7 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:32.820788 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-36f18f86-426a-4ec1-8e42-b6afc7ee52f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:32.863365 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f18f86-426a-4ec1-8e42-b6afc7ee52f7 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:32.930175 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:32.947431 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34da78b-8baf-4cb0-af82-bad5e1c9a09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:32.948258 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34da78b-8baf-4cb0-af82-bad5e1c9a09c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:32.948685 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34da78b-8baf-4cb0-af82-bad5e1c9a09c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:32.949831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34da78b-8baf-4cb0-af82-bad5e1c9a09c admin admin] PATH_INFO: `/v3/projects/db3157e26b054e8584ab34e36a26ba95` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:32.951860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34da78b-8baf-4cb0-af82-bad5e1c9a09c admin admin] RBAC: Authorizing `identity:delete_project(project_id=db3157e26b054e8584ab34e36a26ba95)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:32.953912 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34da78b-8baf-4cb0-af82-bad5e1c9a09c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:33.079719 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a34da78b-8baf-4cb0-af82-bad5e1c9a09c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db3157e26b054e8584ab34e36a26ba95', 'request_id': 'req-a34da78b-8baf-4cb0-af82-bad5e1c9a09c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:33.172736 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a34da78b-8baf-4cb0-af82-bad5e1c9a09c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db3157e26b054e8584ab34e36a26ba95', 'request_id': 'req-a34da78b-8baf-4cb0-af82-bad5e1c9a09c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:33.179958 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a34da78b-8baf-4cb0-af82-bad5e1c9a09c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db3157e26b054e8584ab34e36a26ba95', 'request_id': 'req-a34da78b-8baf-4cb0-af82-bad5e1c9a09c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:33.192549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a34da78b-8baf-4cb0-af82-bad5e1c9a09c admin admin] The token cache is being invalidate because project db3157e26b054e8584ab34e36a26ba95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:50:33.192838 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a34da78b-8baf-4cb0-af82-bad5e1c9a09c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:33.193549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a34da78b-8baf-4cb0-af82-bad5e1c9a09c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:33.195376 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1262/2524] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:50:32 2022] DELETE /identity/v3/projects/db3157e26b054e8584ab34e36a26ba95 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:33.201254 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd900c0-3d3b-4f5a-bb4c-dc58c5bb501f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:33.201983 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd900c0-3d3b-4f5a-bb4c-dc58c5bb501f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:33.201983 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd900c0-3d3b-4f5a-bb4c-dc58c5bb501f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:33.223597 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4fd900c0-3d3b-4f5a-bb4c-dc58c5bb501f None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:33.224831 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4fd900c0-3d3b-4f5a-bb4c-dc58c5bb501f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:33.290492 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:33.340382 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a7e2d-d1f2-42db-a553-9760b38f3fa2 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:33.340722 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a7e2d-d1f2-42db-a553-9760b38f3fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:33.340852 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1263/2525] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:50:33.341038 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a7e2d-d1f2-42db-a553-9760b38f3fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:33.366274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-b33a7e2d-d1f2-42db-a553-9760b38f3fa2 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:33.368214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b33a7e2d-d1f2-42db-a553-9760b38f3fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:33.378019 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1263/2526] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:50:33.382054 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd900c0-3d3b-4f5a-bb4c-dc58c5bb501f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:33.394023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd900c0-3d3b-4f5a-bb4c-dc58c5bb501f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:33.399512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432dbfb7-d2a9-4825-9781-689a27fa9e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:33.400603 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dbfb7-d2a9-4825-9781-689a27fa9e1d admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:33.403599 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dbfb7-d2a9-4825-9781-689a27fa9e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:33.403599 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dbfb7-d2a9-4825-9781-689a27fa9e1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:33.408475 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432dbfb7-d2a9-4825-9781-689a27fa9e1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:50:33.408475 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432dbfb7-d2a9-4825-9781-689a27fa9e1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:33.408475 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432dbfb7-d2a9-4825-9781-689a27fa9e1d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:33.427147 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1264/2527] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:50:33.431441 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a7e2d-d1f2-42db-a553-9760b38f3fa2 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:33.447944 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a7e2d-d1f2-42db-a553-9760b38f3fa2 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:33.454352 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9aacc-e9bd-4ba0-98b0-a927a2d0e433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:33.454971 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9aacc-e9bd-4ba0-98b0-a927a2d0e433 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:33.455253 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9aacc-e9bd-4ba0-98b0-a927a2d0e433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:33.455528 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9aacc-e9bd-4ba0-98b0-a927a2d0e433 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:33.456378 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc9aacc-e9bd-4ba0-98b0-a927a2d0e433 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:33.458349 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc9aacc-e9bd-4ba0-98b0-a927a2d0e433 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:33.554182 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1264/2528] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:50:33 2022] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:50:33.555611 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432dbfb7-d2a9-4825-9781-689a27fa9e1d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:33.566393 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432dbfb7-d2a9-4825-9781-689a27fa9e1d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:33.628593 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66241893-9c30-4198-a96c-bcba19ba263f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:33.629243 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66241893-9c30-4198-a96c-bcba19ba263f admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:33.629524 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66241893-9c30-4198-a96c-bcba19ba263f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:33.629830 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66241893-9c30-4198-a96c-bcba19ba263f admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:33.630509 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66241893-9c30-4198-a96c-bcba19ba263f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:33.632821 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66241893-9c30-4198-a96c-bcba19ba263f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:33.721362 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1265/2529] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:50:33 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:50:33.725892 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9aacc-e9bd-4ba0-98b0-a927a2d0e433 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:33.739907 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9aacc-e9bd-4ba0-98b0-a927a2d0e433 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:33.753163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493aea89-7206-4db7-8b3e-7cc8e6fcee7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:33.753163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493aea89-7206-4db7-8b3e-7cc8e6fcee7e admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:33.753163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493aea89-7206-4db7-8b3e-7cc8e6fcee7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:33.753163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493aea89-7206-4db7-8b3e-7cc8e6fcee7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:33.754228 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493aea89-7206-4db7-8b3e-7cc8e6fcee7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:33.754228 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493aea89-7206-4db7-8b3e-7cc8e6fcee7e admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:33.767428 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1265/2530] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:50:33.774544 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66241893-9c30-4198-a96c-bcba19ba263f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:33.794627 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66241893-9c30-4198-a96c-bcba19ba263f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:33.799772 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92e48f-26f2-40ce-8ffe-401e2f225d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:33.800435 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92e48f-26f2-40ce-8ffe-401e2f225d79 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:33.800767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92e48f-26f2-40ce-8ffe-401e2f225d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:33.801103 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92e48f-26f2-40ce-8ffe-401e2f225d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:33.801813 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92e48f-26f2-40ce-8ffe-401e2f225d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:33.803569 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92e48f-26f2-40ce-8ffe-401e2f225d79 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:33.816037 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1266/2531] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:50:33.820530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493aea89-7206-4db7-8b3e-7cc8e6fcee7e admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:33.831233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493aea89-7206-4db7-8b3e-7cc8e6fcee7e admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:33.835929 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e560aca-82da-44d4-ae3f-0ce951c5b7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:33.836598 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e560aca-82da-44d4-ae3f-0ce951c5b7e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:33.836876 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e560aca-82da-44d4-ae3f-0ce951c5b7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:33.837147 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e560aca-82da-44d4-ae3f-0ce951c5b7e2 admin admin] PATH_INFO: `/v3/projects/51f6fd0364a74260bbbb5935b57a7eb8/users/4c9375921b904d45916b0cc722067559/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:33.853192 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e560aca-82da-44d4-ae3f-0ce951c5b7e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51f6fd0364a74260bbbb5935b57a7eb8, user_id=4c9375921b904d45916b0cc722067559, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:33.856122 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e560aca-82da-44d4-ae3f-0ce951c5b7e2 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:33.948784 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1266/2532] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:50:33 2022] PUT /identity/v3/projects/51f6fd0364a74260bbbb5935b57a7eb8/users/4c9375921b904d45916b0cc722067559/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:50:33.973174 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf030c-7d44-4b07-801d-3899f6a6bd11 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:33.973722 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf030c-7d44-4b07-801d-3899f6a6bd11 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:33.974234 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf030c-7d44-4b07-801d-3899f6a6bd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:34.029517 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-babf030c-7d44-4b07-801d-3899f6a6bd11 None None] MFA Rules not processed for user `4c9375921b904d45916b0cc722067559`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:34.030837 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-babf030c-7d44-4b07-801d-3899f6a6bd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:34.128451 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1267/2533] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:50:34.134478 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e560aca-82da-44d4-ae3f-0ce951c5b7e2 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:34.211576 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e560aca-82da-44d4-ae3f-0ce951c5b7e2 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:34.217076 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6ebc4-9323-4873-934d-06ae3e0750f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:34.217795 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6ebc4-9323-4873-934d-06ae3e0750f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:34.218130 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6ebc4-9323-4873-934d-06ae3e0750f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:34.218488 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6ebc4-9323-4873-934d-06ae3e0750f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:34.219194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e6ebc4-9323-4873-934d-06ae3e0750f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:34.221183 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e6ebc4-9323-4873-934d-06ae3e0750f0 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:34.372518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1267/2534] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:50:34 2022] POST /identity/v3/projects => generated 379 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:50:34.374294 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf030c-7d44-4b07-801d-3899f6a6bd11 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:34.397097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf030c-7d44-4b07-801d-3899f6a6bd11 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:34.453819 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:34.478339 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafc057-0022-402b-ba28-e8e2ef947ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:34.478952 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafc057-0022-402b-ba28-e8e2ef947ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:34.479231 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafc057-0022-402b-ba28-e8e2ef947ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:34.479624 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafc057-0022-402b-ba28-e8e2ef947ac2 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:34.480630 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eafc057-0022-402b-ba28-e8e2ef947ac2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:34.482651 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eafc057-0022-402b-ba28-e8e2ef947ac2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:34.566311 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1268/2535] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:50:34 2022] POST /identity/v3/users => generated 296 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:50:34.571153 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6ebc4-9323-4873-934d-06ae3e0750f0 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:34.579112 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:34.584856 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6ebc4-9323-4873-934d-06ae3e0750f0 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:34.596881 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aab79b-aa87-45a0-9c83-c69f4f240c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:34.597570 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aab79b-aa87-45a0-9c83-c69f4f240c27 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:34.598055 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aab79b-aa87-45a0-9c83-c69f4f240c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:34.598683 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aab79b-aa87-45a0-9c83-c69f4f240c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:34.599325 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aab79b-aa87-45a0-9c83-c69f4f240c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:34.600928 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aab79b-aa87-45a0-9c83-c69f4f240c27 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:34.621906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1268/2536] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:50:34.622783 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafc057-0022-402b-ba28-e8e2ef947ac2 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:34.634146 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafc057-0022-402b-ba28-e8e2ef947ac2 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:34.639216 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c524c68-4c41-4363-b465-90a0afd0611f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:34.639961 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c524c68-4c41-4363-b465-90a0afd0611f admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:34.640318 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c524c68-4c41-4363-b465-90a0afd0611f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:34.640593 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c524c68-4c41-4363-b465-90a0afd0611f admin admin] PATH_INFO: `/v3/projects/fe7747579d0948249915e7dc290a3065/users/080fedd4b51640579e9769ad0522048a/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:34.656791 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c524c68-4c41-4363-b465-90a0afd0611f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe7747579d0948249915e7dc290a3065, user_id=080fedd4b51640579e9769ad0522048a, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:34.659469 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c524c68-4c41-4363-b465-90a0afd0611f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:34.737100 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aab79b-aa87-45a0-9c83-c69f4f240c27 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:34.739113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b3aab79b-aa87-45a0-9c83-c69f4f240c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:34.754214 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1269/2537] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:50:34 2022] PUT /identity/v3/projects/fe7747579d0948249915e7dc290a3065/users/080fedd4b51640579e9769ad0522048a/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:50:34.755710 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aab79b-aa87-45a0-9c83-c69f4f240c27 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:34.758096 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c524c68-4c41-4363-b465-90a0afd0611f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:34.817477 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46446248-850b-46b7-80c1-c23b2a675599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:34.818080 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46446248-850b-46b7-80c1-c23b2a675599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:34.818361 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46446248-850b-46b7-80c1-c23b2a675599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:34.818633 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46446248-850b-46b7-80c1-c23b2a675599 admin admin] PATH_INFO: `/v3/users/fbdf19910c234794b8aeb480dba50d85` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:34.820758 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46446248-850b-46b7-80c1-c23b2a675599 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbdf19910c234794b8aeb480dba50d85)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:34.822779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46446248-850b-46b7-80c1-c23b2a675599 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:34.825675 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c524c68-4c41-4363-b465-90a0afd0611f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:34.830583 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a98ae5-bca5-47ad-95a5-b61234b38a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:34.831183 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a98ae5-bca5-47ad-95a5-b61234b38a70 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:34.831458 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a98ae5-bca5-47ad-95a5-b61234b38a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:34.831727 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a98ae5-bca5-47ad-95a5-b61234b38a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:34.832366 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a98ae5-bca5-47ad-95a5-b61234b38a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:34.833983 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a98ae5-bca5-47ad-95a5-b61234b38a70 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:34.845225 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1270/2538] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:50:34.849939 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a98ae5-bca5-47ad-95a5-b61234b38a70 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:34.860638 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a98ae5-bca5-47ad-95a5-b61234b38a70 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:34.866707 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2440e6d-e27d-4e19-b801-1e7aca6266be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:34.867402 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2440e6d-e27d-4e19-b801-1e7aca6266be admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:34.867729 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2440e6d-e27d-4e19-b801-1e7aca6266be admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:34.867941 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2440e6d-e27d-4e19-b801-1e7aca6266be admin admin] PATH_INFO: `/v3/projects/fe7747579d0948249915e7dc290a3065/users/080fedd4b51640579e9769ad0522048a/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:34.874863 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2440e6d-e27d-4e19-b801-1e7aca6266be admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe7747579d0948249915e7dc290a3065, user_id=080fedd4b51640579e9769ad0522048a, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:34.874863 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2440e6d-e27d-4e19-b801-1e7aca6266be admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:34.883915 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1271/2539] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:50:34 2022] PUT /identity/v3/projects/fe7747579d0948249915e7dc290a3065/users/080fedd4b51640579e9769ad0522048a/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:50:34.895547 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac684ee9-5129-4992-bab4-750654c6abc1 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:34.895829 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac684ee9-5129-4992-bab4-750654c6abc1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:34.896112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac684ee9-5129-4992-bab4-750654c6abc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:34.928312 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ac684ee9-5129-4992-bab4-750654c6abc1 None None] MFA Rules not processed for user `080fedd4b51640579e9769ad0522048a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:34.929555 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ac684ee9-5129-4992-bab4-750654c6abc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:35.003876 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1272/2540] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:50:35.015975 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac684ee9-5129-4992-bab4-750654c6abc1 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:35.017422 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ac684ee9-5129-4992-bab4-750654c6abc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:35.020087 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-46446248-850b-46b7-80c1-c23b2a675599 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbdf19910c234794b8aeb480dba50d85'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:35.020838 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-46446248-850b-46b7-80c1-c23b2a675599 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbdf19910c234794b8aeb480dba50d85'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:35.035602 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:35.039256 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-46446248-850b-46b7-80c1-c23b2a675599 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbdf19910c234794b8aeb480dba50d85'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:35.040329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-46446248-850b-46b7-80c1-c23b2a675599 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbdf19910c234794b8aeb480dba50d85'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:35.095613 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac684ee9-5129-4992-bab4-750654c6abc1 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:35.101830 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada69405-4328-4d2c-8863-989543dddb4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:35.102004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada69405-4328-4d2c-8863-989543dddb4d service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:35.102364 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada69405-4328-4d2c-8863-989543dddb4d service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:35.102897 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada69405-4328-4d2c-8863-989543dddb4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:35.106318 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ada69405-4328-4d2c-8863-989543dddb4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:35.126520 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada69405-4328-4d2c-8863-989543dddb4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:35.127902 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada69405-4328-4d2c-8863-989543dddb4d service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:35.132934 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-46446248-850b-46b7-80c1-c23b2a675599 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbdf19910c234794b8aeb480dba50d85'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:35.138941 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1273/2541] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:50:35 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:50:35.147714 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1269/2542] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:50:34 2022] DELETE /identity/v3/users/fbdf19910c234794b8aeb480dba50d85 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:35.327719 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada69405-4328-4d2c-8863-989543dddb4d service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:35.329194 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ada69405-4328-4d2c-8863-989543dddb4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:35.341786 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada69405-4328-4d2c-8863-989543dddb4d service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:35.396061 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf36482-2469-4117-94ca-8c2f60e1a6d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:35.403609 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf36482-2469-4117-94ca-8c2f60e1a6d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:35.403609 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf36482-2469-4117-94ca-8c2f60e1a6d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:35.403609 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf36482-2469-4117-94ca-8c2f60e1a6d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:35.403609 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3cf36482-2469-4117-94ca-8c2f60e1a6d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:35.461392 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf36482-2469-4117-94ca-8c2f60e1a6d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:35.462886 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf36482-2469-4117-94ca-8c2f60e1a6d8 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:35.475955 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1274/2543] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:50:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:50:35.494788 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46446248-850b-46b7-80c1-c23b2a675599 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:35.497280 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-46446248-850b-46b7-80c1-c23b2a675599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:35.586075 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46446248-850b-46b7-80c1-c23b2a675599 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:35.591836 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9f323-44e1-41de-a3ba-ae7fbc5b8521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:35.592500 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9f323-44e1-41de-a3ba-ae7fbc5b8521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:35.592793 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9f323-44e1-41de-a3ba-ae7fbc5b8521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:35.593064 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9f323-44e1-41de-a3ba-ae7fbc5b8521 admin admin] PATH_INFO: `/v3/projects/25aaf7039f994f4a83bf8ce6db68f3a1` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:35.594212 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9f323-44e1-41de-a3ba-ae7fbc5b8521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25aaf7039f994f4a83bf8ce6db68f3a1)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:35.596155 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9f323-44e1-41de-a3ba-ae7fbc5b8521 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:35.610723 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:35.758897 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d4c9f323-44e1-41de-a3ba-ae7fbc5b8521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25aaf7039f994f4a83bf8ce6db68f3a1', 'request_id': 'req-d4c9f323-44e1-41de-a3ba-ae7fbc5b8521'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:35.836625 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d4c9f323-44e1-41de-a3ba-ae7fbc5b8521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25aaf7039f994f4a83bf8ce6db68f3a1', 'request_id': 'req-d4c9f323-44e1-41de-a3ba-ae7fbc5b8521'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:35.843956 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d4c9f323-44e1-41de-a3ba-ae7fbc5b8521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25aaf7039f994f4a83bf8ce6db68f3a1', 'request_id': 'req-d4c9f323-44e1-41de-a3ba-ae7fbc5b8521'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:35.855344 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d4c9f323-44e1-41de-a3ba-ae7fbc5b8521 admin admin] The token cache is being invalidate because project 25aaf7039f994f4a83bf8ce6db68f3a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:50:35.855649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d4c9f323-44e1-41de-a3ba-ae7fbc5b8521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:35.856312 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-d4c9f323-44e1-41de-a3ba-ae7fbc5b8521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:35.857905 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1270/2544] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:50:35 2022] DELETE /identity/v3/projects/25aaf7039f994f4a83bf8ce6db68f3a1 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:50:35.863016 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c97703-7658-41cd-bafa-0e59dd8360fb None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:35.863305 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c97703-7658-41cd-bafa-0e59dd8360fb None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:35.863586 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c97703-7658-41cd-bafa-0e59dd8360fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:35.890672 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e5c97703-7658-41cd-bafa-0e59dd8360fb None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:35.891912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e5c97703-7658-41cd-bafa-0e59dd8360fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:35.958102 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1275/2545] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:50:35.966452 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264843e-3ddc-40ae-91f7-b853a964fb65 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:35.966739 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264843e-3ddc-40ae-91f7-b853a964fb65 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:35.967014 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264843e-3ddc-40ae-91f7-b853a964fb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:35.990260 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-1264843e-3ddc-40ae-91f7-b853a964fb65 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:35.992252 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1264843e-3ddc-40ae-91f7-b853a964fb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:36.004188 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1271/2546] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:50:36.008627 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c97703-7658-41cd-bafa-0e59dd8360fb None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:36.019053 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c97703-7658-41cd-bafa-0e59dd8360fb None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:36.023863 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c14cbe-7bea-40bb-842f-8d2c229b39f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:36.024469 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c14cbe-7bea-40bb-842f-8d2c229b39f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:36.024743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c14cbe-7bea-40bb-842f-8d2c229b39f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:36.025013 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c14cbe-7bea-40bb-842f-8d2c229b39f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:36.025819 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c14cbe-7bea-40bb-842f-8d2c229b39f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:50:36.026122 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c14cbe-7bea-40bb-842f-8d2c229b39f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:36.028213 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c14cbe-7bea-40bb-842f-8d2c229b39f4 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:36.031138 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:36.042128 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1276/2547] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:50:36.048143 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264843e-3ddc-40ae-91f7-b853a964fb65 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:36.055092 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c14cbe-7bea-40bb-842f-8d2c229b39f4 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:36.056818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-93c14cbe-7bea-40bb-842f-8d2c229b39f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:36.064510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264843e-3ddc-40ae-91f7-b853a964fb65 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:36.071607 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c14cbe-7bea-40bb-842f-8d2c229b39f4 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:36.076928 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79781972-6f46-4585-956d-aface8ad7c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:36.076928 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79781972-6f46-4585-956d-aface8ad7c59 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:36.076928 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79781972-6f46-4585-956d-aface8ad7c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:36.076928 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79781972-6f46-4585-956d-aface8ad7c59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:36.077594 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79781972-6f46-4585-956d-aface8ad7c59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:36.077731 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3082f6-1246-4d0f-b8a6-c4b66b0cc0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:36.077932 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79781972-6f46-4585-956d-aface8ad7c59 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:36.078110 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3082f6-1246-4d0f-b8a6-c4b66b0cc0a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:36.078110 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3082f6-1246-4d0f-b8a6-c4b66b0cc0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:36.078110 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3082f6-1246-4d0f-b8a6-c4b66b0cc0a8 admin admin] PATH_INFO: `/v3/users/4c9375921b904d45916b0cc722067559` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:36.079562 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3082f6-1246-4d0f-b8a6-c4b66b0cc0a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c9375921b904d45916b0cc722067559)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:36.081490 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3082f6-1246-4d0f-b8a6-c4b66b0cc0a8 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:36.187608 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1272/2548] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:50:36 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:50:36.191860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79781972-6f46-4585-956d-aface8ad7c59 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:36.254586 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79781972-6f46-4585-956d-aface8ad7c59 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:36.259278 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c71c6-12f3-4744-b3fa-f94c8ba26dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:36.259887 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c71c6-12f3-4744-b3fa-f94c8ba26dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:36.260170 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c71c6-12f3-4744-b3fa-f94c8ba26dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:36.260473 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c71c6-12f3-4744-b3fa-f94c8ba26dc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:36.261238 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c71c6-12f3-4744-b3fa-f94c8ba26dc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:36.263201 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c71c6-12f3-4744-b3fa-f94c8ba26dc8 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:36.324748 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-df3082f6-1246-4d0f-b8a6-c4b66b0cc0a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c9375921b904d45916b0cc722067559'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:36.325450 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-df3082f6-1246-4d0f-b8a6-c4b66b0cc0a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c9375921b904d45916b0cc722067559'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:36.326088 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-df3082f6-1246-4d0f-b8a6-c4b66b0cc0a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c9375921b904d45916b0cc722067559'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:36.340764 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-df3082f6-1246-4d0f-b8a6-c4b66b0cc0a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c9375921b904d45916b0cc722067559'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:36.397788 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1273/2549] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:50:36 2022] POST /identity/v3/users => generated 286 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:50:36.402345 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c71c6-12f3-4744-b3fa-f94c8ba26dc8 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:36.404393 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-514c71c6-12f3-4744-b3fa-f94c8ba26dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:36.417139 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c71c6-12f3-4744-b3fa-f94c8ba26dc8 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:36.422352 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624df708-001a-4528-b44f-ffdd4ed2b681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:36.423010 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624df708-001a-4528-b44f-ffdd4ed2b681 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:36.423316 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624df708-001a-4528-b44f-ffdd4ed2b681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:36.423618 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624df708-001a-4528-b44f-ffdd4ed2b681 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:36.424308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624df708-001a-4528-b44f-ffdd4ed2b681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:36.425965 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624df708-001a-4528-b44f-ffdd4ed2b681 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:36.436256 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-df3082f6-1246-4d0f-b8a6-c4b66b0cc0a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c9375921b904d45916b0cc722067559'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:36.441470 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1274/2550] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:50:36.442797 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624df708-001a-4528-b44f-ffdd4ed2b681 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:36.455616 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624df708-001a-4528-b44f-ffdd4ed2b681 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:36.457723 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1277/2551] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:50:36 2022] DELETE /identity/v3/users/4c9375921b904d45916b0cc722067559 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:50:36.464097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adffbc5-6257-4d22-be90-38a4ba51d5cf None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:36.464811 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adffbc5-6257-4d22-be90-38a4ba51d5cf None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:36.465030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adffbc5-6257-4d22-be90-38a4ba51d5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:36.486939 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-5adffbc5-6257-4d22-be90-38a4ba51d5cf None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:36.488826 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5adffbc5-6257-4d22-be90-38a4ba51d5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:36.517730 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:36.529885 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c41212-502d-4788-8ac5-de34fb2d87ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:36.530656 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c41212-502d-4788-8ac5-de34fb2d87ee admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:36.531034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c41212-502d-4788-8ac5-de34fb2d87ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:36.531411 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c41212-502d-4788-8ac5-de34fb2d87ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:36.532133 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c41212-502d-4788-8ac5-de34fb2d87ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:36.534000 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c41212-502d-4788-8ac5-de34fb2d87ee admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:36.551920 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1275/2552] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:50:36.551920 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c41212-502d-4788-8ac5-de34fb2d87ee admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:36.561041 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c41212-502d-4788-8ac5-de34fb2d87ee admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:36.561362 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1278/2553] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:50:36.565873 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfa037-4219-440c-bf09-89ae2d6997c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:36.575406 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfa037-4219-440c-bf09-89ae2d6997c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:36.575406 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfa037-4219-440c-bf09-89ae2d6997c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:36.575406 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfa037-4219-440c-bf09-89ae2d6997c9 admin admin] PATH_INFO: `/v3/projects/145c42b1a31744e898dc3c679c30164f/users/331aa49c0e374bfeafbe4bacb8c5a079/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:36.575912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adffbc5-6257-4d22-be90-38a4ba51d5cf None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:36.576307 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5adffbc5-6257-4d22-be90-38a4ba51d5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:36.586020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfa037-4219-440c-bf09-89ae2d6997c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=145c42b1a31744e898dc3c679c30164f, user_id=331aa49c0e374bfeafbe4bacb8c5a079, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:36.588739 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfa037-4219-440c-bf09-89ae2d6997c9 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:36.648678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adffbc5-6257-4d22-be90-38a4ba51d5cf None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:36.653460 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b7771-abf2-4a85-bc6e-6b7ca6941cfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:36.654165 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b7771-abf2-4a85-bc6e-6b7ca6941cfe service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:36.654440 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b7771-abf2-4a85-bc6e-6b7ca6941cfe service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:36.654784 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b7771-abf2-4a85-bc6e-6b7ca6941cfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:36.666515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b7771-abf2-4a85-bc6e-6b7ca6941cfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:36.668841 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b7771-abf2-4a85-bc6e-6b7ca6941cfe service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:36.679728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1279/2554] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:50:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:50:36.690325 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1276/2555] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:50:36 2022] PUT /identity/v3/projects/145c42b1a31744e898dc3c679c30164f/users/331aa49c0e374bfeafbe4bacb8c5a079/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:50:36.705418 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb2e45-4914-4513-9569-7ad365cec203 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:36.706004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb2e45-4914-4513-9569-7ad365cec203 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:36.707904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb2e45-4914-4513-9569-7ad365cec203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:36.734144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:36.743982 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-cfeb2e45-4914-4513-9569-7ad365cec203 None None] MFA Rules not processed for user `331aa49c0e374bfeafbe4bacb8c5a079`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:36.745437 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-cfeb2e45-4914-4513-9569-7ad365cec203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:36.820295 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1280/2556] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:50:36.825986 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfa037-4219-440c-bf09-89ae2d6997c9 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:36.898953 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfa037-4219-440c-bf09-89ae2d6997c9 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:36.904244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ffe26-038f-485f-baa3-72a6781f9e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:36.904973 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ffe26-038f-485f-baa3-72a6781f9e47 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:36.905253 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ffe26-038f-485f-baa3-72a6781f9e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:36.905530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ffe26-038f-485f-baa3-72a6781f9e47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:36.906218 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ffe26-038f-485f-baa3-72a6781f9e47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:36.908214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ffe26-038f-485f-baa3-72a6781f9e47 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:37.090607 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1277/2557] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:50:36 2022] POST /identity/v3/projects => generated 373 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:50:37.091645 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb2e45-4914-4513-9569-7ad365cec203 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:37.103960 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb2e45-4914-4513-9569-7ad365cec203 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:37.173917 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5be24-c731-4cd1-a195-70256e91997e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:37.174610 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5be24-c731-4cd1-a195-70256e91997e admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:37.174895 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5be24-c731-4cd1-a195-70256e91997e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:37.175177 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5be24-c731-4cd1-a195-70256e91997e admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:37.175860 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5be24-c731-4cd1-a195-70256e91997e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:37.178146 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5be24-c731-4cd1-a195-70256e91997e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:37.268558 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1281/2558] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:50:37 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:50:37.273897 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ffe26-038f-485f-baa3-72a6781f9e47 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:37.292027 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ffe26-038f-485f-baa3-72a6781f9e47 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:37.301517 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59b0e0-fe65-4cf3-bd40-6730e7b87492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:37.302271 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59b0e0-fe65-4cf3-bd40-6730e7b87492 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:37.302625 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59b0e0-fe65-4cf3-bd40-6730e7b87492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:37.302963 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59b0e0-fe65-4cf3-bd40-6730e7b87492 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:37.303697 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59b0e0-fe65-4cf3-bd40-6730e7b87492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:37.305410 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59b0e0-fe65-4cf3-bd40-6730e7b87492 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:37.323017 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1278/2559] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:50:37.324440 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5be24-c731-4cd1-a195-70256e91997e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:37.340493 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5be24-c731-4cd1-a195-70256e91997e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:37.345721 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ec04d-18f1-4234-97c7-cc1660cdff0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:37.346449 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ec04d-18f1-4234-97c7-cc1660cdff0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:37.346724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ec04d-18f1-4234-97c7-cc1660cdff0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:37.347019 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ec04d-18f1-4234-97c7-cc1660cdff0a admin admin] PATH_INFO: `/v3/projects/e799cf08ec7e4d23844eb29baff14d2b/users/16bcd6ad111c4a60b8697896a791b776/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:37.366546 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ec04d-18f1-4234-97c7-cc1660cdff0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e799cf08ec7e4d23844eb29baff14d2b, user_id=16bcd6ad111c4a60b8697896a791b776, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:37.371511 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ec04d-18f1-4234-97c7-cc1660cdff0a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:37.448389 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1282/2560] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:50:37 2022] PUT /identity/v3/projects/e799cf08ec7e4d23844eb29baff14d2b/users/16bcd6ad111c4a60b8697896a791b776/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:37.453502 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59b0e0-fe65-4cf3-bd40-6730e7b87492 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:37.467320 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59b0e0-fe65-4cf3-bd40-6730e7b87492 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:37.482153 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ec04d-18f1-4234-97c7-cc1660cdff0a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:37.484539 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9d0ec04d-18f1-4234-97c7-cc1660cdff0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:37.562114 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ec04d-18f1-4234-97c7-cc1660cdff0a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:37.562880 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f706bd-804d-4c65-94d7-18054b664ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:37.563489 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f706bd-804d-4c65-94d7-18054b664ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:37.563772 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f706bd-804d-4c65-94d7-18054b664ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:37.564040 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f706bd-804d-4c65-94d7-18054b664ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:37.564677 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f706bd-804d-4c65-94d7-18054b664ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:37.566328 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f706bd-804d-4c65-94d7-18054b664ec5 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:37.566964 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7c4b7-642d-49ed-8b17-c6232b792b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:37.567592 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7c4b7-642d-49ed-8b17-c6232b792b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:37.567871 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7c4b7-642d-49ed-8b17-c6232b792b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:37.568141 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7c4b7-642d-49ed-8b17-c6232b792b4f admin admin] PATH_INFO: `/v3/projects/51f6fd0364a74260bbbb5935b57a7eb8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:37.569299 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7c4b7-642d-49ed-8b17-c6232b792b4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=51f6fd0364a74260bbbb5935b57a7eb8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:37.571275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7c4b7-642d-49ed-8b17-c6232b792b4f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:37.577346 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1279/2561] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:50:37.581102 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:37.582347 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f706bd-804d-4c65-94d7-18054b664ec5 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:37.601444 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f706bd-804d-4c65-94d7-18054b664ec5 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:37.601444 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c54801-4b7f-4825-a407-5f7cc3970c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:37.601444 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c54801-4b7f-4825-a407-5f7cc3970c2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:37.601444 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c54801-4b7f-4825-a407-5f7cc3970c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:37.602058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c54801-4b7f-4825-a407-5f7cc3970c2b admin admin] PATH_INFO: `/v3/projects/e799cf08ec7e4d23844eb29baff14d2b/users/16bcd6ad111c4a60b8697896a791b776/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:37.602058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c54801-4b7f-4825-a407-5f7cc3970c2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e799cf08ec7e4d23844eb29baff14d2b, user_id=16bcd6ad111c4a60b8697896a791b776, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:37.603630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c54801-4b7f-4825-a407-5f7cc3970c2b admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:37.614709 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1280/2562] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:50:37 2022] PUT /identity/v3/projects/e799cf08ec7e4d23844eb29baff14d2b/users/16bcd6ad111c4a60b8697896a791b776/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:50:37.626534 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4d53f-7cd5-4bb7-ac14-a353e4a2de99 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:37.626813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4d53f-7cd5-4bb7-ac14-a353e4a2de99 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:37.627091 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4d53f-7cd5-4bb7-ac14-a353e4a2de99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:37.658142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-04f4d53f-7cd5-4bb7-ac14-a353e4a2de99 None None] MFA Rules not processed for user `16bcd6ad111c4a60b8697896a791b776`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:37.659371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-04f4d53f-7cd5-4bb7-ac14-a353e4a2de99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:37.671385 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:37.735018 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1281/2563] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:50:37.736862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-71c7c4b7-642d-49ed-8b17-c6232b792b4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51f6fd0364a74260bbbb5935b57a7eb8', 'request_id': 'req-71c7c4b7-642d-49ed-8b17-c6232b792b4f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:37.746910 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4d53f-7cd5-4bb7-ac14-a353e4a2de99 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:37.748303 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-04f4d53f-7cd5-4bb7-ac14-a353e4a2de99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:37.805802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4d53f-7cd5-4bb7-ac14-a353e4a2de99 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:37.853506 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24575ea9-3e64-4d94-ab8c-bc29da142f70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:37.854055 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24575ea9-3e64-4d94-ab8c-bc29da142f70 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:37.854338 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24575ea9-3e64-4d94-ab8c-bc29da142f70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:37.854606 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24575ea9-3e64-4d94-ab8c-bc29da142f70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:37.859099 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-71c7c4b7-642d-49ed-8b17-c6232b792b4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51f6fd0364a74260bbbb5935b57a7eb8', 'request_id': 'req-71c7c4b7-642d-49ed-8b17-c6232b792b4f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:37.866350 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-71c7c4b7-642d-49ed-8b17-c6232b792b4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51f6fd0364a74260bbbb5935b57a7eb8', 'request_id': 'req-71c7c4b7-642d-49ed-8b17-c6232b792b4f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:37.878328 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-71c7c4b7-642d-49ed-8b17-c6232b792b4f admin admin] The token cache is being invalidate because project 51f6fd0364a74260bbbb5935b57a7eb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:50:37.878615 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-71c7c4b7-642d-49ed-8b17-c6232b792b4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:37.879288 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-71c7c4b7-642d-49ed-8b17-c6232b792b4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:37.881057 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1283/2564] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:50:37 2022] DELETE /identity/v3/projects/51f6fd0364a74260bbbb5935b57a7eb8 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:50:37.884713 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7c4b7-642d-49ed-8b17-c6232b792b4f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:37.886851 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-71c7c4b7-642d-49ed-8b17-c6232b792b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:37.931290 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24575ea9-3e64-4d94-ab8c-bc29da142f70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:37.933932 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24575ea9-3e64-4d94-ab8c-bc29da142f70 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:37.949785 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1282/2565] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:50:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:50:37.965927 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7c4b7-642d-49ed-8b17-c6232b792b4f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:37.970690 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847cf8e-1ccb-488d-9353-aa359f0404f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:37.971493 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847cf8e-1ccb-488d-9353-aa359f0404f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:37.971772 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847cf8e-1ccb-488d-9353-aa359f0404f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:37.972045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847cf8e-1ccb-488d-9353-aa359f0404f0 admin admin] PATH_INFO: `/v3/users/080fedd4b51640579e9769ad0522048a` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:37.973207 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847cf8e-1ccb-488d-9353-aa359f0404f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=080fedd4b51640579e9769ad0522048a)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:37.975445 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847cf8e-1ccb-488d-9353-aa359f0404f0 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:38.268652 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6847cf8e-1ccb-488d-9353-aa359f0404f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '080fedd4b51640579e9769ad0522048a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:38.269336 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6847cf8e-1ccb-488d-9353-aa359f0404f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '080fedd4b51640579e9769ad0522048a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:38.269968 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6847cf8e-1ccb-488d-9353-aa359f0404f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '080fedd4b51640579e9769ad0522048a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:38.286612 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6847cf8e-1ccb-488d-9353-aa359f0404f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '080fedd4b51640579e9769ad0522048a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:38.333737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24575ea9-3e64-4d94-ab8c-bc29da142f70 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:38.343443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24575ea9-3e64-4d94-ab8c-bc29da142f70 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:38.347340 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd686d53-cc60-4ded-8235-bde07ecf8c3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:38.347941 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd686d53-cc60-4ded-8235-bde07ecf8c3d service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:38.348218 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd686d53-cc60-4ded-8235-bde07ecf8c3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:38.348742 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd686d53-cc60-4ded-8235-bde07ecf8c3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:38.350551 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-fd686d53-cc60-4ded-8235-bde07ecf8c3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:38.361895 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=100 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:38.419779 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6847cf8e-1ccb-488d-9353-aa359f0404f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '080fedd4b51640579e9769ad0522048a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:38.430863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd686d53-cc60-4ded-8235-bde07ecf8c3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:38.433992 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd686d53-cc60-4ded-8235-bde07ecf8c3d service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:38.435377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1284/2566] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:50:37 2022] DELETE /identity/v3/users/080fedd4b51640579e9769ad0522048a => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:50:38.449013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1283/2567] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:50:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:50:39.048075 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847cf8e-1ccb-488d-9353-aa359f0404f0 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:39.049739 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6847cf8e-1ccb-488d-9353-aa359f0404f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:39.084164 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:39.135942 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847cf8e-1ccb-488d-9353-aa359f0404f0 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:39.141499 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbe0dd-a824-400f-aaeb-aa4d85c478d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:39.142170 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbe0dd-a824-400f-aaeb-aa4d85c478d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:39.142449 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbe0dd-a824-400f-aaeb-aa4d85c478d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:39.142722 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbe0dd-a824-400f-aaeb-aa4d85c478d6 admin admin] PATH_INFO: `/v3/projects/fe7747579d0948249915e7dc290a3065` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:39.143963 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fbe0dd-a824-400f-aaeb-aa4d85c478d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe7747579d0948249915e7dc290a3065)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:39.145924 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fbe0dd-a824-400f-aaeb-aa4d85c478d6 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:39.305613 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e7fbe0dd-a824-400f-aaeb-aa4d85c478d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe7747579d0948249915e7dc290a3065', 'request_id': 'req-e7fbe0dd-a824-400f-aaeb-aa4d85c478d6'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:39.475870 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e7fbe0dd-a824-400f-aaeb-aa4d85c478d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe7747579d0948249915e7dc290a3065', 'request_id': 'req-e7fbe0dd-a824-400f-aaeb-aa4d85c478d6'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:39.483495 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e7fbe0dd-a824-400f-aaeb-aa4d85c478d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe7747579d0948249915e7dc290a3065', 'request_id': 'req-e7fbe0dd-a824-400f-aaeb-aa4d85c478d6'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:39.496297 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e7fbe0dd-a824-400f-aaeb-aa4d85c478d6 admin admin] The token cache is being invalidate because project fe7747579d0948249915e7dc290a3065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:50:39.496590 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e7fbe0dd-a824-400f-aaeb-aa4d85c478d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:39.497294 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e7fbe0dd-a824-400f-aaeb-aa4d85c478d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:39.498910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1285/2568] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:50:39 2022] DELETE /identity/v3/projects/fe7747579d0948249915e7dc290a3065 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:39.504785 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86845ad-78ec-4bfd-9510-051e1b23b059 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:39.505302 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86845ad-78ec-4bfd-9510-051e1b23b059 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:39.505412 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86845ad-78ec-4bfd-9510-051e1b23b059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:39.525712 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-f86845ad-78ec-4bfd-9510-051e1b23b059 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:39.527034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f86845ad-78ec-4bfd-9510-051e1b23b059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:39.586925 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1284/2569] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:50:39.595270 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca56adf-93e6-4c4e-868d-679e70f0055d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:39.595553 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca56adf-93e6-4c4e-868d-679e70f0055d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:39.595824 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca56adf-93e6-4c4e-868d-679e70f0055d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:39.617285 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-6ca56adf-93e6-4c4e-868d-679e70f0055d None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:39.618842 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6ca56adf-93e6-4c4e-868d-679e70f0055d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:39.628512 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1286/2570] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:50:39.633284 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86845ad-78ec-4bfd-9510-051e1b23b059 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:39.644381 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86845ad-78ec-4bfd-9510-051e1b23b059 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:39.649254 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebcec2-5f4e-486c-b69b-4c535238b227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:39.649916 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebcec2-5f4e-486c-b69b-4c535238b227 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:39.650220 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebcec2-5f4e-486c-b69b-4c535238b227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:39.650516 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebcec2-5f4e-486c-b69b-4c535238b227 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:39.651205 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebcec2-5f4e-486c-b69b-4c535238b227 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:50:39.651527 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebcec2-5f4e-486c-b69b-4c535238b227 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:39.653404 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebcec2-5f4e-486c-b69b-4c535238b227 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:39.666518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1285/2571] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:50:39.671732 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca56adf-93e6-4c4e-868d-679e70f0055d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:39.681971 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca56adf-93e6-4c4e-868d-679e70f0055d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:39.687381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9903e7-f20c-4676-a58d-93de3f34b00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:39.687977 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9903e7-f20c-4676-a58d-93de3f34b00b admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:39.688256 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9903e7-f20c-4676-a58d-93de3f34b00b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:39.688527 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9903e7-f20c-4676-a58d-93de3f34b00b admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:39.689154 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9903e7-f20c-4676-a58d-93de3f34b00b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:39.691143 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9903e7-f20c-4676-a58d-93de3f34b00b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:39.890960 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1287/2572] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:50:39 2022] POST /identity/v3/projects => generated 385 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:50:39.895009 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebcec2-5f4e-486c-b69b-4c535238b227 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:39.905731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebcec2-5f4e-486c-b69b-4c535238b227 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:39.966314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c1bb1-8a71-4f57-b6dd-b62476923d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:39.966948 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c1bb1-8a71-4f57-b6dd-b62476923d3c admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:39.967233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c1bb1-8a71-4f57-b6dd-b62476923d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:39.967510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c1bb1-8a71-4f57-b6dd-b62476923d3c admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:39.968195 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c1bb1-8a71-4f57-b6dd-b62476923d3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:39.970358 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c1bb1-8a71-4f57-b6dd-b62476923d3c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:40.129675 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1286/2573] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:50:39 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:50:40.134093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9903e7-f20c-4676-a58d-93de3f34b00b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:40.150055 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9903e7-f20c-4676-a58d-93de3f34b00b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:40.155030 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838f0b8-9645-4f3c-ae12-efc69603a0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:40.155629 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838f0b8-9645-4f3c-ae12-efc69603a0bc admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:40.155903 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838f0b8-9645-4f3c-ae12-efc69603a0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:40.156172 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838f0b8-9645-4f3c-ae12-efc69603a0bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:40.156816 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838f0b8-9645-4f3c-ae12-efc69603a0bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:40.158427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838f0b8-9645-4f3c-ae12-efc69603a0bc admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:40.169340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1288/2574] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:50:40.173417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c1bb1-8a71-4f57-b6dd-b62476923d3c admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:40.184307 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c1bb1-8a71-4f57-b6dd-b62476923d3c admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:40.189052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d4736-17ab-4381-879e-c0c0d182e0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:40.189655 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d4736-17ab-4381-879e-c0c0d182e0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:40.189985 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d4736-17ab-4381-879e-c0c0d182e0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:40.190264 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d4736-17ab-4381-879e-c0c0d182e0b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:40.190896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d4736-17ab-4381-879e-c0c0d182e0b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:40.192490 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d4736-17ab-4381-879e-c0c0d182e0b3 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:40.211886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1287/2575] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:50:40.212488 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838f0b8-9645-4f3c-ae12-efc69603a0bc admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:40.222809 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838f0b8-9645-4f3c-ae12-efc69603a0bc admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:40.227934 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c998e-376e-4817-bb2c-8058ae5fb05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:40.228785 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c998e-376e-4817-bb2c-8058ae5fb05b admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:40.229066 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c998e-376e-4817-bb2c-8058ae5fb05b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:40.229347 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c998e-376e-4817-bb2c-8058ae5fb05b admin admin] PATH_INFO: `/v3/projects/dedd4f97240b49a4b7ffd330923506a0/users/6bc5855d292c416caabb1ee09f1c1e2b/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:40.246376 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c998e-376e-4817-bb2c-8058ae5fb05b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dedd4f97240b49a4b7ffd330923506a0, user_id=6bc5855d292c416caabb1ee09f1c1e2b, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:40.249273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c998e-376e-4817-bb2c-8058ae5fb05b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:40.523121 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1289/2576] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:50:40 2022] PUT /identity/v3/projects/dedd4f97240b49a4b7ffd330923506a0/users/6bc5855d292c416caabb1ee09f1c1e2b/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:50:40.534269 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcd2ae-47dc-4d19-93b4-ed466ca8bebb None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:40.534894 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcd2ae-47dc-4d19-93b4-ed466ca8bebb None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:40.534894 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcd2ae-47dc-4d19-93b4-ed466ca8bebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:40.562729 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-e5fcd2ae-47dc-4d19-93b4-ed466ca8bebb None None] MFA Rules not processed for user `6bc5855d292c416caabb1ee09f1c1e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:40.563938 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e5fcd2ae-47dc-4d19-93b4-ed466ca8bebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:40.567837 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:40.629022 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1288/2577] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:50:40.633658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c998e-376e-4817-bb2c-8058ae5fb05b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:40.678452 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:40.696281 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c998e-376e-4817-bb2c-8058ae5fb05b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:40.701001 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c3498-1a1a-4a76-a77d-7084625285fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:40.701602 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c3498-1a1a-4a76-a77d-7084625285fa admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:40.701912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c3498-1a1a-4a76-a77d-7084625285fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:40.702180 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c3498-1a1a-4a76-a77d-7084625285fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:40.702792 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c3498-1a1a-4a76-a77d-7084625285fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:40.704733 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c3498-1a1a-4a76-a77d-7084625285fa admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:40.787041 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1290/2578] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:50:40 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:50:40.791407 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcd2ae-47dc-4d19-93b4-ed466ca8bebb None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:40.803453 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcd2ae-47dc-4d19-93b4-ed466ca8bebb None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:40.820259 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c3498-1a1a-4a76-a77d-7084625285fa admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:40.822219 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-955c3498-1a1a-4a76-a77d-7084625285fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:40.872963 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d843ea5-87f8-4b0f-9c95-686a14b72c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:40.873728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d843ea5-87f8-4b0f-9c95-686a14b72c43 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:40.874044 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d843ea5-87f8-4b0f-9c95-686a14b72c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:40.874316 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d843ea5-87f8-4b0f-9c95-686a14b72c43 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:40.875011 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d843ea5-87f8-4b0f-9c95-686a14b72c43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:40.877064 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d843ea5-87f8-4b0f-9c95-686a14b72c43 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:40.884426 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c3498-1a1a-4a76-a77d-7084625285fa admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:40.888566 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67cdf6-8ff7-4f98-8137-f2cfa8402e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:40.889255 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67cdf6-8ff7-4f98-8137-f2cfa8402e02 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:40.889597 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67cdf6-8ff7-4f98-8137-f2cfa8402e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:40.894800 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67cdf6-8ff7-4f98-8137-f2cfa8402e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:40.894800 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0e67cdf6-8ff7-4f98-8137-f2cfa8402e02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:40.972990 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67cdf6-8ff7-4f98-8137-f2cfa8402e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:40.974742 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67cdf6-8ff7-4f98-8137-f2cfa8402e02 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:40.993800 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1291/2579] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:50:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:50:41.014230 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1289/2580] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:50:40 2022] POST /identity/v3/users => generated 292 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:50:41.018448 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67cdf6-8ff7-4f98-8137-f2cfa8402e02 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:41.029994 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67cdf6-8ff7-4f98-8137-f2cfa8402e02 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:41.035387 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e6a1d-fc57-4c5e-936f-d66d5799d1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:41.036036 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e6a1d-fc57-4c5e-936f-d66d5799d1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:41.036303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e6a1d-fc57-4c5e-936f-d66d5799d1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:41.036578 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e6a1d-fc57-4c5e-936f-d66d5799d1d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:41.037273 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e6a1d-fc57-4c5e-936f-d66d5799d1d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:41.038970 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e6a1d-fc57-4c5e-936f-d66d5799d1d5 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:41.049720 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1292/2581] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:50:41.053828 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d843ea5-87f8-4b0f-9c95-686a14b72c43 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:41.064832 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d843ea5-87f8-4b0f-9c95-686a14b72c43 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:41.080513 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c6e9e-28ff-4ed2-86d3-a0e27fec3ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:41.080513 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c6e9e-28ff-4ed2-86d3-a0e27fec3ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:41.080513 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c6e9e-28ff-4ed2-86d3-a0e27fec3ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:41.080513 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c6e9e-28ff-4ed2-86d3-a0e27fec3ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:41.081044 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c6e9e-28ff-4ed2-86d3-a0e27fec3ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:41.081044 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c6e9e-28ff-4ed2-86d3-a0e27fec3ea6 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:41.087373 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1290/2582] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:50:41.088628 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e6a1d-fc57-4c5e-936f-d66d5799d1d5 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:41.099675 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e6a1d-fc57-4c5e-936f-d66d5799d1d5 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:41.106257 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da11e8-45a5-4446-8c9d-55bcd4e6b336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:41.107031 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da11e8-45a5-4446-8c9d-55bcd4e6b336 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:41.107460 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da11e8-45a5-4446-8c9d-55bcd4e6b336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:41.107786 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da11e8-45a5-4446-8c9d-55bcd4e6b336 admin admin] PATH_INFO: `/v3/projects/56b3b46055a44710821040ad1a8fce1a/users/426b80453e3342b7a5926d3544d87f9e/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:41.124362 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da11e8-45a5-4446-8c9d-55bcd4e6b336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56b3b46055a44710821040ad1a8fce1a, user_id=426b80453e3342b7a5926d3544d87f9e, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:41.127083 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da11e8-45a5-4446-8c9d-55bcd4e6b336 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:41.254563 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1293/2583] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:50:41 2022] PUT /identity/v3/projects/56b3b46055a44710821040ad1a8fce1a/users/426b80453e3342b7a5926d3544d87f9e/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:41.327950 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5057b-eee3-4b36-8282-723736da1bfb None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:41.328294 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5057b-eee3-4b36-8282-723736da1bfb None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:41.328581 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5057b-eee3-4b36-8282-723736da1bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:41.362946 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-44b5057b-eee3-4b36-8282-723736da1bfb None None] MFA Rules not processed for user `426b80453e3342b7a5926d3544d87f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:41.364209 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-44b5057b-eee3-4b36-8282-723736da1bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:41.462870 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1291/2584] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:50:41.467505 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da11e8-45a5-4446-8c9d-55bcd4e6b336 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:41.537250 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da11e8-45a5-4446-8c9d-55bcd4e6b336 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:41.542775 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed48e8-f714-4a54-bed3-c308a946d32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:41.543359 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed48e8-f714-4a54-bed3-c308a946d32d admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:41.543610 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed48e8-f714-4a54-bed3-c308a946d32d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:41.543876 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed48e8-f714-4a54-bed3-c308a946d32d admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:41.544520 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed48e8-f714-4a54-bed3-c308a946d32d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:41.546468 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed48e8-f714-4a54-bed3-c308a946d32d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:41.567684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:41.682254 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1294/2585] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:50:41 2022] POST /identity/v3/projects => generated 385 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:50:41.683854 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5057b-eee3-4b36-8282-723736da1bfb None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:41.695206 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5057b-eee3-4b36-8282-723736da1bfb None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:41.712144 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:41.776439 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7916f48-e219-4733-99bb-3d8cdff6f13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:41.777920 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7916f48-e219-4733-99bb-3d8cdff6f13b admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:41.778202 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7916f48-e219-4733-99bb-3d8cdff6f13b admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:41.778472 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7916f48-e219-4733-99bb-3d8cdff6f13b admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:41.779103 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7916f48-e219-4733-99bb-3d8cdff6f13b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:41.781079 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7916f48-e219-4733-99bb-3d8cdff6f13b admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:41.900020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1292/2586] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:50:41 2022] POST /identity/v3/users => generated 299 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:50:41.905854 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed48e8-f714-4a54-bed3-c308a946d32d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:41.920083 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed48e8-f714-4a54-bed3-c308a946d32d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:41.926318 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0f0b6-71fd-4f55-9739-a47e689972ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:41.927224 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0f0b6-71fd-4f55-9739-a47e689972ee admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:41.927767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0f0b6-71fd-4f55-9739-a47e689972ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:41.928382 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0f0b6-71fd-4f55-9739-a47e689972ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:41.929423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da0f0b6-71fd-4f55-9739-a47e689972ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:41.931898 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da0f0b6-71fd-4f55-9739-a47e689972ee admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:41.944527 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1295/2587] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:50:41.949278 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7916f48-e219-4733-99bb-3d8cdff6f13b admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:41.960267 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7916f48-e219-4733-99bb-3d8cdff6f13b admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:41.966153 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5e34e-b074-4555-8d89-16106f5fa73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:41.966813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5e34e-b074-4555-8d89-16106f5fa73a admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:41.967092 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5e34e-b074-4555-8d89-16106f5fa73a admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:41.967381 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5e34e-b074-4555-8d89-16106f5fa73a admin admin] PATH_INFO: `/v3/projects/bb22c092750c4c24b27ae34c5b86127e/users/c79ca75b65704cfe9d8455a64d753b5a/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:41.983535 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5e34e-b074-4555-8d89-16106f5fa73a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb22c092750c4c24b27ae34c5b86127e, user_id=c79ca75b65704cfe9d8455a64d753b5a, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:41.987131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5e34e-b074-4555-8d89-16106f5fa73a admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:42.038893 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1293/2588] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:50:41 2022] PUT /identity/v3/projects/bb22c092750c4c24b27ae34c5b86127e/users/c79ca75b65704cfe9d8455a64d753b5a/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:50:42.042980 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0f0b6-71fd-4f55-9739-a47e689972ee admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:42.054160 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0f0b6-71fd-4f55-9739-a47e689972ee admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:42.156036 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e40f0f-8dc0-45d3-97ae-08c028cb9677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:42.156586 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e40f0f-8dc0-45d3-97ae-08c028cb9677 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:42.156865 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e40f0f-8dc0-45d3-97ae-08c028cb9677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:42.157133 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e40f0f-8dc0-45d3-97ae-08c028cb9677 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:42.157807 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e40f0f-8dc0-45d3-97ae-08c028cb9677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:42.159422 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e40f0f-8dc0-45d3-97ae-08c028cb9677 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:42.171810 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1296/2589] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:50:42.175698 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5e34e-b074-4555-8d89-16106f5fa73a admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:42.188370 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5e34e-b074-4555-8d89-16106f5fa73a admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:42.193786 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb950f-f58a-4550-8a62-05037506f856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:42.194566 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb950f-f58a-4550-8a62-05037506f856 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:42.194942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb950f-f58a-4550-8a62-05037506f856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:42.195282 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb950f-f58a-4550-8a62-05037506f856 admin admin] PATH_INFO: `/v3/projects/bb22c092750c4c24b27ae34c5b86127e/users/c79ca75b65704cfe9d8455a64d753b5a/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:42.197376 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb950f-f58a-4550-8a62-05037506f856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb22c092750c4c24b27ae34c5b86127e, user_id=c79ca75b65704cfe9d8455a64d753b5a, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:42.201119 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb950f-f58a-4550-8a62-05037506f856 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:42.215589 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1294/2590] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:50:42 2022] PUT /identity/v3/projects/bb22c092750c4c24b27ae34c5b86127e/users/c79ca75b65704cfe9d8455a64d753b5a/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:42.232775 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d9dee-92e1-4d42-82ee-203cb0ffe2d7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:42.233059 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d9dee-92e1-4d42-82ee-203cb0ffe2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:42.233333 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d9dee-92e1-4d42-82ee-203cb0ffe2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:42.281483 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-186d9dee-92e1-4d42-82ee-203cb0ffe2d7 None None] MFA Rules not processed for user `c79ca75b65704cfe9d8455a64d753b5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:42.283710 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-186d9dee-92e1-4d42-82ee-203cb0ffe2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:42.400867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1297/2591] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:42 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:50:42.413429 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb950f-f58a-4550-8a62-05037506f856 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:42.415314 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-70bb950f-f58a-4550-8a62-05037506f856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:42.490813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb950f-f58a-4550-8a62-05037506f856 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:42.497446 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f440b-5bd8-45a3-8669-65550ff0879a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:42.498370 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f440b-5bd8-45a3-8669-65550ff0879a service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:42.498766 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f440b-5bd8-45a3-8669-65550ff0879a service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:42.499204 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f440b-5bd8-45a3-8669-65550ff0879a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:42.584194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f440b-5bd8-45a3-8669-65550ff0879a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:42.585734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f440b-5bd8-45a3-8669-65550ff0879a service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:42.598985 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1295/2592] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:50:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:50:45.568146 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d9dee-92e1-4d42-82ee-203cb0ffe2d7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:45.578772 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d9dee-92e1-4d42-82ee-203cb0ffe2d7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:45.582287 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f481a9f-8372-4c29-a1f4-bda150c1ac53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:45.582872 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f481a9f-8372-4c29-a1f4-bda150c1ac53 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:45.583143 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f481a9f-8372-4c29-a1f4-bda150c1ac53 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:45.583408 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f481a9f-8372-4c29-a1f4-bda150c1ac53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:45.592802 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:45.648757 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f481a9f-8372-4c29-a1f4-bda150c1ac53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:45.650240 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f481a9f-8372-4c29-a1f4-bda150c1ac53 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:45.659696 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1298/2593] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:50:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:50:49.126718 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f440b-5bd8-45a3-8669-65550ff0879a service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:49.138855 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f440b-5bd8-45a3-8669-65550ff0879a service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:49.143729 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332a14d-9bd1-42a5-809f-8a915df91fce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:49.144273 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332a14d-9bd1-42a5-809f-8a915df91fce service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:49.145004 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332a14d-9bd1-42a5-809f-8a915df91fce service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:49.145371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332a14d-9bd1-42a5-809f-8a915df91fce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:49.161916 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332a14d-9bd1-42a5-809f-8a915df91fce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:49.163475 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332a14d-9bd1-42a5-809f-8a915df91fce service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:49.176132 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1296/2594] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:50:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:50:55.288508 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f481a9f-8372-4c29-a1f4-bda150c1ac53 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:55.374233 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f481a9f-8372-4c29-a1f4-bda150c1ac53 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:55.378933 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7aaac0-6467-4e9c-9375-f3595f61953b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:55.379570 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7aaac0-6467-4e9c-9375-f3595f61953b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:55.379846 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7aaac0-6467-4e9c-9375-f3595f61953b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:55.380118 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7aaac0-6467-4e9c-9375-f3595f61953b admin admin] PATH_INFO: `/v3/users/6bc5855d292c416caabb1ee09f1c1e2b` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:55.381247 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7aaac0-6467-4e9c-9375-f3595f61953b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bc5855d292c416caabb1ee09f1c1e2b)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:55.383229 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7aaac0-6467-4e9c-9375-f3595f61953b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:55.838052 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9f7aaac0-6467-4e9c-9375-f3595f61953b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bc5855d292c416caabb1ee09f1c1e2b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:55.839662 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9f7aaac0-6467-4e9c-9375-f3595f61953b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bc5855d292c416caabb1ee09f1c1e2b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:55.840621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9f7aaac0-6467-4e9c-9375-f3595f61953b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bc5855d292c416caabb1ee09f1c1e2b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:55.859734 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9f7aaac0-6467-4e9c-9375-f3595f61953b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bc5855d292c416caabb1ee09f1c1e2b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:55.962262 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9f7aaac0-6467-4e9c-9375-f3595f61953b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bc5855d292c416caabb1ee09f1c1e2b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:55.980530 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1299/2595] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:50:55 2022] DELETE /identity/v3/users/6bc5855d292c416caabb1ee09f1c1e2b => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:55.988840 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e617668-73f7-4220-926b-823d0df645ab None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:55.989389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e617668-73f7-4220-926b-823d0df645ab None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:55.989681 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e617668-73f7-4220-926b-823d0df645ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:56.007259 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:56.014979 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-2e617668-73f7-4220-926b-823d0df645ab None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:56.019775 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2e617668-73f7-4220-926b-823d0df645ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:56.131398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1297/2596] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:50:56.147629 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7aaac0-6467-4e9c-9375-f3595f61953b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:56.149202 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9f7aaac0-6467-4e9c-9375-f3595f61953b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:56.208155 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:56.240256 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7aaac0-6467-4e9c-9375-f3595f61953b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:56.244362 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ee517-775b-47e8-bec7-6a2581878c71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:56.246005 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ee517-775b-47e8-bec7-6a2581878c71 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:56.246441 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ee517-775b-47e8-bec7-6a2581878c71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:56.246777 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ee517-775b-47e8-bec7-6a2581878c71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:56.269543 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ee517-775b-47e8-bec7-6a2581878c71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:56.272546 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ee517-775b-47e8-bec7-6a2581878c71 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:56.293033 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1300/2597] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:50:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:50:56.895050 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e617668-73f7-4220-926b-823d0df645ab None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:56.897129 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2e617668-73f7-4220-926b-823d0df645ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:56.919927 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e617668-73f7-4220-926b-823d0df645ab None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:56.927293 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13588e87-b8fa-4bf2-85d3-47d0f83300b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:56.928426 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13588e87-b8fa-4bf2-85d3-47d0f83300b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:56.928836 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13588e87-b8fa-4bf2-85d3-47d0f83300b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:56.929264 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13588e87-b8fa-4bf2-85d3-47d0f83300b4 admin admin] PATH_INFO: `/v3/projects/dedd4f97240b49a4b7ffd330923506a0` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:56.932367 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13588e87-b8fa-4bf2-85d3-47d0f83300b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dedd4f97240b49a4b7ffd330923506a0)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:56.934947 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13588e87-b8fa-4bf2-85d3-47d0f83300b4 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:57.051806 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-13588e87-b8fa-4bf2-85d3-47d0f83300b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dedd4f97240b49a4b7ffd330923506a0', 'request_id': 'req-13588e87-b8fa-4bf2-85d3-47d0f83300b4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:57.117396 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-13588e87-b8fa-4bf2-85d3-47d0f83300b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dedd4f97240b49a4b7ffd330923506a0', 'request_id': 'req-13588e87-b8fa-4bf2-85d3-47d0f83300b4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:57.124991 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-13588e87-b8fa-4bf2-85d3-47d0f83300b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dedd4f97240b49a4b7ffd330923506a0', 'request_id': 'req-13588e87-b8fa-4bf2-85d3-47d0f83300b4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:57.140463 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-13588e87-b8fa-4bf2-85d3-47d0f83300b4 admin admin] The token cache is being invalidate because project dedd4f97240b49a4b7ffd330923506a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:50:57.140658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-13588e87-b8fa-4bf2-85d3-47d0f83300b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:57.141351 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-13588e87-b8fa-4bf2-85d3-47d0f83300b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:57.142905 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1298/2598] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:50:56 2022] DELETE /identity/v3/projects/dedd4f97240b49a4b7ffd330923506a0 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:57.147145 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ee517-775b-47e8-bec7-6a2581878c71 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:57.159685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ee517-775b-47e8-bec7-6a2581878c71 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:57.217674 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035db0b-c0e5-4e26-9447-59420a58332b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:57.218326 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035db0b-c0e5-4e26-9447-59420a58332b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:57.218601 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035db0b-c0e5-4e26-9447-59420a58332b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:57.218872 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035db0b-c0e5-4e26-9447-59420a58332b admin admin] PATH_INFO: `/v3/users/426b80453e3342b7a5926d3544d87f9e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:57.219996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035db0b-c0e5-4e26-9447-59420a58332b admin admin] RBAC: Authorizing `identity:delete_user(user_id=426b80453e3342b7a5926d3544d87f9e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:57.221934 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035db0b-c0e5-4e26-9447-59420a58332b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:57.478195 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8035db0b-c0e5-4e26-9447-59420a58332b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '426b80453e3342b7a5926d3544d87f9e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:57.480776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8035db0b-c0e5-4e26-9447-59420a58332b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '426b80453e3342b7a5926d3544d87f9e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:57.481665 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8035db0b-c0e5-4e26-9447-59420a58332b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '426b80453e3342b7a5926d3544d87f9e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:57.498908 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8035db0b-c0e5-4e26-9447-59420a58332b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '426b80453e3342b7a5926d3544d87f9e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:57.578932 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8035db0b-c0e5-4e26-9447-59420a58332b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '426b80453e3342b7a5926d3544d87f9e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:57.604908 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1301/2599] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:50:57 2022] DELETE /identity/v3/users/426b80453e3342b7a5926d3544d87f9e => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:58.203917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13588e87-b8fa-4bf2-85d3-47d0f83300b4 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:58.203917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-13588e87-b8fa-4bf2-85d3-47d0f83300b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:58.213105 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13588e87-b8fa-4bf2-85d3-47d0f83300b4 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:58.305035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6995ce2-f136-4144-a411-d4d92961f555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:58.305788 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6995ce2-f136-4144-a411-d4d92961f555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:58.306080 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6995ce2-f136-4144-a411-d4d92961f555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:58.306434 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6995ce2-f136-4144-a411-d4d92961f555 admin admin] PATH_INFO: `/v3/projects/56b3b46055a44710821040ad1a8fce1a` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:58.308495 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6995ce2-f136-4144-a411-d4d92961f555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56b3b46055a44710821040ad1a8fce1a)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:58.310682 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6995ce2-f136-4144-a411-d4d92961f555 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:58.460580 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:58.477784 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a6995ce2-f136-4144-a411-d4d92961f555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56b3b46055a44710821040ad1a8fce1a', 'request_id': 'req-a6995ce2-f136-4144-a411-d4d92961f555'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:58.550770 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a6995ce2-f136-4144-a411-d4d92961f555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56b3b46055a44710821040ad1a8fce1a', 'request_id': 'req-a6995ce2-f136-4144-a411-d4d92961f555'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:58.562362 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a6995ce2-f136-4144-a411-d4d92961f555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56b3b46055a44710821040ad1a8fce1a', 'request_id': 'req-a6995ce2-f136-4144-a411-d4d92961f555'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:58.581230 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a6995ce2-f136-4144-a411-d4d92961f555 admin admin] The token cache is being invalidate because project 56b3b46055a44710821040ad1a8fce1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:50:58.581778 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a6995ce2-f136-4144-a411-d4d92961f555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:58.582856 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a6995ce2-f136-4144-a411-d4d92961f555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:58.585376 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1299/2600] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:50:58 2022] DELETE /identity/v3/projects/56b3b46055a44710821040ad1a8fce1a => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:58.590648 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035db0b-c0e5-4e26-9447-59420a58332b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:58.592457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8035db0b-c0e5-4e26-9447-59420a58332b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:58.612275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035db0b-c0e5-4e26-9447-59420a58332b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:58.689466 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:58.700754 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506b799-7933-4986-a28c-a8aa16b0fc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:58.701396 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506b799-7933-4986-a28c-a8aa16b0fc1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:58.701671 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506b799-7933-4986-a28c-a8aa16b0fc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:58.701975 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506b799-7933-4986-a28c-a8aa16b0fc1b admin admin] PATH_INFO: `/v3/users/c79ca75b65704cfe9d8455a64d753b5a` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:58.703132 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506b799-7933-4986-a28c-a8aa16b0fc1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c79ca75b65704cfe9d8455a64d753b5a)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:58.705076 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506b799-7933-4986-a28c-a8aa16b0fc1b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:58.968645 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c506b799-7933-4986-a28c-a8aa16b0fc1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c79ca75b65704cfe9d8455a64d753b5a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:58.968645 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c506b799-7933-4986-a28c-a8aa16b0fc1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c79ca75b65704cfe9d8455a64d753b5a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:58.968645 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c506b799-7933-4986-a28c-a8aa16b0fc1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c79ca75b65704cfe9d8455a64d753b5a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:58.988072 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c506b799-7933-4986-a28c-a8aa16b0fc1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c79ca75b65704cfe9d8455a64d753b5a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:59.100127 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c506b799-7933-4986-a28c-a8aa16b0fc1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c79ca75b65704cfe9d8455a64d753b5a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:50:59.118298 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1302/2601] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:50:58 2022] DELETE /identity/v3/users/c79ca75b65704cfe9d8455a64d753b5a => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:50:59.747965 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6995ce2-f136-4144-a411-d4d92961f555 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:59.754963 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a6995ce2-f136-4144-a411-d4d92961f555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:59.769180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6995ce2-f136-4144-a411-d4d92961f555 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:59.833432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb2f31-57fa-4809-aad8-e39ddc28aaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:59.834212 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb2f31-57fa-4809-aad8-e39ddc28aaa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:59.834493 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb2f31-57fa-4809-aad8-e39ddc28aaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:59.834769 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb2f31-57fa-4809-aad8-e39ddc28aaa7 admin admin] PATH_INFO: `/v3/projects/bb22c092750c4c24b27ae34c5b86127e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:59.836000 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb2f31-57fa-4809-aad8-e39ddc28aaa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb22c092750c4c24b27ae34c5b86127e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:59.837972 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb2f31-57fa-4809-aad8-e39ddc28aaa7 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:59.959454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b4fb2f31-57fa-4809-aad8-e39ddc28aaa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb22c092750c4c24b27ae34c5b86127e', 'request_id': 'req-b4fb2f31-57fa-4809-aad8-e39ddc28aaa7'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:00.081611 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b4fb2f31-57fa-4809-aad8-e39ddc28aaa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb22c092750c4c24b27ae34c5b86127e', 'request_id': 'req-b4fb2f31-57fa-4809-aad8-e39ddc28aaa7'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:00.088400 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b4fb2f31-57fa-4809-aad8-e39ddc28aaa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb22c092750c4c24b27ae34c5b86127e', 'request_id': 'req-b4fb2f31-57fa-4809-aad8-e39ddc28aaa7'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:00.105376 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b4fb2f31-57fa-4809-aad8-e39ddc28aaa7 admin admin] The token cache is being invalidate because project bb22c092750c4c24b27ae34c5b86127e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:51:00.105839 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b4fb2f31-57fa-4809-aad8-e39ddc28aaa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:00.106536 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b4fb2f31-57fa-4809-aad8-e39ddc28aaa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:00.108146 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1300/2602] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:50:59 2022] DELETE /identity/v3/projects/bb22c092750c4c24b27ae34c5b86127e => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:51:00.113336 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ddcae-5891-4714-9a34-828e767441c5 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:00.113866 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ddcae-5891-4714-9a34-828e767441c5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:00.114080 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ddcae-5891-4714-9a34-828e767441c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:00.136905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b90ddcae-5891-4714-9a34-828e767441c5 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:51:00.138160 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b90ddcae-5891-4714-9a34-828e767441c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:00.201055 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1303/2603] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:51:00.210424 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca136e2-7d94-4222-b5a0-173ae3a8f55c None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:00.210703 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca136e2-7d94-4222-b5a0-173ae3a8f55c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:00.211145 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca136e2-7d94-4222-b5a0-173ae3a8f55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:00.232725 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-9ca136e2-7d94-4222-b5a0-173ae3a8f55c None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:51:00.241132 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9ca136e2-7d94-4222-b5a0-173ae3a8f55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:00.245716 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1301/2604] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:51:00.249799 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ddcae-5891-4714-9a34-828e767441c5 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:00.262360 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ddcae-5891-4714-9a34-828e767441c5 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:00.267617 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453ce69-9a57-4622-ad94-1498bb04743c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:00.268332 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453ce69-9a57-4622-ad94-1498bb04743c admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:00.268634 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453ce69-9a57-4622-ad94-1498bb04743c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:00.268964 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453ce69-9a57-4622-ad94-1498bb04743c admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:00.269672 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453ce69-9a57-4622-ad94-1498bb04743c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:51:00.270060 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453ce69-9a57-4622-ad94-1498bb04743c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:00.271662 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453ce69-9a57-4622-ad94-1498bb04743c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:00.291825 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1304/2605] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:51:00.298592 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca136e2-7d94-4222-b5a0-173ae3a8f55c None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:00.304098 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca136e2-7d94-4222-b5a0-173ae3a8f55c None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:00.309541 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431b522-6d3c-447d-b546-ecd5092278e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:00.310297 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431b522-6d3c-447d-b546-ecd5092278e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:00.310602 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431b522-6d3c-447d-b546-ecd5092278e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:00.310914 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431b522-6d3c-447d-b546-ecd5092278e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:00.311598 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431b522-6d3c-447d-b546-ecd5092278e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:00.313598 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431b522-6d3c-447d-b546-ecd5092278e5 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:00.420514 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1302/2606] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:51:00 2022] POST /identity/v3/projects => generated 389 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:51:00.421678 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453ce69-9a57-4622-ad94-1498bb04743c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:00.433581 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453ce69-9a57-4622-ad94-1498bb04743c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:00.522566 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a5146-516a-4391-87b5-04a75af8c14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:00.523414 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a5146-516a-4391-87b5-04a75af8c14f admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:00.523758 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a5146-516a-4391-87b5-04a75af8c14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:00.524196 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a5146-516a-4391-87b5-04a75af8c14f admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:00.525138 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a5146-516a-4391-87b5-04a75af8c14f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:00.527318 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a5146-516a-4391-87b5-04a75af8c14f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:00.535912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:00.660467 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1305/2607] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:51:00 2022] POST /identity/v3/users => generated 295 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:51:00.665212 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431b522-6d3c-447d-b546-ecd5092278e5 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:00.676473 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431b522-6d3c-447d-b546-ecd5092278e5 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:00.682636 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97681e7-ed6b-4ce5-9593-aa24e2138b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:00.682894 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97681e7-ed6b-4ce5-9593-aa24e2138b88 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:00.683023 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97681e7-ed6b-4ce5-9593-aa24e2138b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:00.683252 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97681e7-ed6b-4ce5-9593-aa24e2138b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:00.683844 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97681e7-ed6b-4ce5-9593-aa24e2138b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:00.685824 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97681e7-ed6b-4ce5-9593-aa24e2138b88 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:00.697384 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1303/2608] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:51:00.701952 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a5146-516a-4391-87b5-04a75af8c14f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:00.712744 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a5146-516a-4391-87b5-04a75af8c14f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:00.718210 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee413c-bc2d-4be8-8f87-5915efe45c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:00.718880 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee413c-bc2d-4be8-8f87-5915efe45c79 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:00.719165 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee413c-bc2d-4be8-8f87-5915efe45c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:00.719431 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee413c-bc2d-4be8-8f87-5915efe45c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:00.720160 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee413c-bc2d-4be8-8f87-5915efe45c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:00.722297 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee413c-bc2d-4be8-8f87-5915efe45c79 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:00.736348 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1306/2609] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:51:00.740622 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97681e7-ed6b-4ce5-9593-aa24e2138b88 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:00.751867 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97681e7-ed6b-4ce5-9593-aa24e2138b88 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:00.759357 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40611e3-2fb6-4bf6-ad52-a4880db4ac06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:00.760525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40611e3-2fb6-4bf6-ad52-a4880db4ac06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:00.760837 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40611e3-2fb6-4bf6-ad52-a4880db4ac06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:00.761301 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40611e3-2fb6-4bf6-ad52-a4880db4ac06 admin admin] PATH_INFO: `/v3/projects/fb7c48e92c454743a87ec047b43e515d/users/3ea672cd61cf49c788485c0a2bb0f9e5/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:00.771136 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:00.779596 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40611e3-2fb6-4bf6-ad52-a4880db4ac06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb7c48e92c454743a87ec047b43e515d, user_id=3ea672cd61cf49c788485c0a2bb0f9e5, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:00.782583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40611e3-2fb6-4bf6-ad52-a4880db4ac06 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:00.901413 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1304/2610] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:51:00 2022] PUT /identity/v3/projects/fb7c48e92c454743a87ec047b43e515d/users/3ea672cd61cf49c788485c0a2bb0f9e5/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:51:00.912078 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3212c-17b3-4d8d-83c3-7f33f12b4f00 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:00.912399 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3212c-17b3-4d8d-83c3-7f33f12b4f00 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:00.912712 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3212c-17b3-4d8d-83c3-7f33f12b4f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:00.951239 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-5ec3212c-17b3-4d8d-83c3-7f33f12b4f00 None None] MFA Rules not processed for user `3ea672cd61cf49c788485c0a2bb0f9e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:51:00.952712 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5ec3212c-17b3-4d8d-83c3-7f33f12b4f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:01.027726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1307/2611] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:51:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:51:01.038846 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40611e3-2fb6-4bf6-ad52-a4880db4ac06 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:01.040613 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d40611e3-2fb6-4bf6-ad52-a4880db4ac06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:01.112055 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40611e3-2fb6-4bf6-ad52-a4880db4ac06 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:01.117616 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e2885-1ecb-48b4-a45e-6946de587515 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:01.118261 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e2885-1ecb-48b4-a45e-6946de587515 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:01.118545 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e2885-1ecb-48b4-a45e-6946de587515 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:01.118822 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e2885-1ecb-48b4-a45e-6946de587515 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:01.129271 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e2885-1ecb-48b4-a45e-6946de587515 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:01.130791 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e2885-1ecb-48b4-a45e-6946de587515 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:01.140618 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1305/2612] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:51:01 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:51:02.433820 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3212c-17b3-4d8d-83c3-7f33f12b4f00 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:02.435489 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5ec3212c-17b3-4d8d-83c3-7f33f12b4f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:02.498097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3212c-17b3-4d8d-83c3-7f33f12b4f00 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:02.502280 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec804f3-a456-474d-a340-42626c4a2a03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:02.502925 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec804f3-a456-474d-a340-42626c4a2a03 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:02.503205 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec804f3-a456-474d-a340-42626c4a2a03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:02.503482 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec804f3-a456-474d-a340-42626c4a2a03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:02.505308 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2ec804f3-a456-474d-a340-42626c4a2a03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:02.570174 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec804f3-a456-474d-a340-42626c4a2a03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:02.571616 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec804f3-a456-474d-a340-42626c4a2a03 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:02.584058 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1308/2613] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:51:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:51:11.373141 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=31,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:12.577939 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:INSERT=3,keystone:SELECT=89 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:12.768026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e2885-1ecb-48b4-a45e-6946de587515 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:12.769521 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-665e2885-1ecb-48b4-a45e-6946de587515 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:12.792338 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e2885-1ecb-48b4-a45e-6946de587515 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:12.799516 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abfbcd-bf7f-4817-a189-c6f18d367579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:12.800515 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abfbcd-bf7f-4817-a189-c6f18d367579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:12.800988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abfbcd-bf7f-4817-a189-c6f18d367579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:12.801457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abfbcd-bf7f-4817-a189-c6f18d367579 admin admin] PATH_INFO: `/v3/users/3b7c54ebd95f4b3eb396982d75615f23` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:12.803546 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abfbcd-bf7f-4817-a189-c6f18d367579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b7c54ebd95f4b3eb396982d75615f23)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:12.806435 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abfbcd-bf7f-4817-a189-c6f18d367579 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:13.084502 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a8abfbcd-bf7f-4817-a189-c6f18d367579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b7c54ebd95f4b3eb396982d75615f23'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:13.086192 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a8abfbcd-bf7f-4817-a189-c6f18d367579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b7c54ebd95f4b3eb396982d75615f23'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:13.105814 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a8abfbcd-bf7f-4817-a189-c6f18d367579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b7c54ebd95f4b3eb396982d75615f23'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:13.106561 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a8abfbcd-bf7f-4817-a189-c6f18d367579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b7c54ebd95f4b3eb396982d75615f23'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:13.172889 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a8abfbcd-bf7f-4817-a189-c6f18d367579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b7c54ebd95f4b3eb396982d75615f23'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:13.188757 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1306/2614] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:51:12 2022] DELETE /identity/v3/users/3b7c54ebd95f4b3eb396982d75615f23 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:51:13.518106 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec804f3-a456-474d-a340-42626c4a2a03 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:13.530712 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec804f3-a456-474d-a340-42626c4a2a03 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:13.593653 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc3f60-ae7c-411a-b2f3-6dd280cb8d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:13.594489 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc3f60-ae7c-411a-b2f3-6dd280cb8d09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:13.594813 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc3f60-ae7c-411a-b2f3-6dd280cb8d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:13.595093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc3f60-ae7c-411a-b2f3-6dd280cb8d09 admin admin] PATH_INFO: `/v3/projects/f22a1cf1a07c47a29772e70e4586a77b` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:13.596505 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc3f60-ae7c-411a-b2f3-6dd280cb8d09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f22a1cf1a07c47a29772e70e4586a77b)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:13.599888 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc3f60-ae7c-411a-b2f3-6dd280cb8d09 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:13.779860 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d1fc3f60-ae7c-411a-b2f3-6dd280cb8d09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f22a1cf1a07c47a29772e70e4586a77b', 'request_id': 'req-d1fc3f60-ae7c-411a-b2f3-6dd280cb8d09'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:13.938131 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d1fc3f60-ae7c-411a-b2f3-6dd280cb8d09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f22a1cf1a07c47a29772e70e4586a77b', 'request_id': 'req-d1fc3f60-ae7c-411a-b2f3-6dd280cb8d09'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:13.945068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d1fc3f60-ae7c-411a-b2f3-6dd280cb8d09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f22a1cf1a07c47a29772e70e4586a77b', 'request_id': 'req-d1fc3f60-ae7c-411a-b2f3-6dd280cb8d09'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:13.956800 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d1fc3f60-ae7c-411a-b2f3-6dd280cb8d09 admin admin] The token cache is being invalidate because project f22a1cf1a07c47a29772e70e4586a77b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:51:13.957092 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d1fc3f60-ae7c-411a-b2f3-6dd280cb8d09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:13.957774 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d1fc3f60-ae7c-411a-b2f3-6dd280cb8d09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:13.960690 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1309/2615] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:51:13 2022] DELETE /identity/v3/projects/f22a1cf1a07c47a29772e70e4586a77b => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:51:13.963832 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abfbcd-bf7f-4817-a189-c6f18d367579 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:13.965287 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a8abfbcd-bf7f-4817-a189-c6f18d367579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:13.979290 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abfbcd-bf7f-4817-a189-c6f18d367579 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:14.044590 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3e610-ec2a-45be-b87a-2431d56d2476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:14.045222 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3e610-ec2a-45be-b87a-2431d56d2476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:14.045495 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3e610-ec2a-45be-b87a-2431d56d2476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:14.045790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3e610-ec2a-45be-b87a-2431d56d2476 admin admin] PATH_INFO: `/v3/users/855a435a052640e2a214436653585d88` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:14.060836 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3e610-ec2a-45be-b87a-2431d56d2476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=855a435a052640e2a214436653585d88)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:14.062851 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3e610-ec2a-45be-b87a-2431d56d2476 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:14.331571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-82d3e610-ec2a-45be-b87a-2431d56d2476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '855a435a052640e2a214436653585d88'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:14.332289 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-82d3e610-ec2a-45be-b87a-2431d56d2476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '855a435a052640e2a214436653585d88'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:14.345446 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:14.346820 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-82d3e610-ec2a-45be-b87a-2431d56d2476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '855a435a052640e2a214436653585d88'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:14.347770 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-82d3e610-ec2a-45be-b87a-2431d56d2476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '855a435a052640e2a214436653585d88'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:14.504599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-82d3e610-ec2a-45be-b87a-2431d56d2476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '855a435a052640e2a214436653585d88'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:14.518881 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1307/2616] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:51:13 2022] DELETE /identity/v3/users/855a435a052640e2a214436653585d88 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:51:14.815416 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc3f60-ae7c-411a-b2f3-6dd280cb8d09 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:14.817425 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d1fc3f60-ae7c-411a-b2f3-6dd280cb8d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:14.857408 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc3f60-ae7c-411a-b2f3-6dd280cb8d09 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:14.945045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a9d0a6-b8a1-475d-a0df-6213479972ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:14.945773 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9d0a6-b8a1-475d-a0df-6213479972ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:14.946185 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9d0a6-b8a1-475d-a0df-6213479972ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:14.946533 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9d0a6-b8a1-475d-a0df-6213479972ec admin admin] PATH_INFO: `/v3/projects/7aa03566adff425a83a825ee12839c58` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:14.966972 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a9d0a6-b8a1-475d-a0df-6213479972ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aa03566adff425a83a825ee12839c58)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:14.968961 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a9d0a6-b8a1-475d-a0df-6213479972ec admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:15.001771 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:15.241161 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e3a9d0a6-b8a1-475d-a0df-6213479972ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aa03566adff425a83a825ee12839c58', 'request_id': 'req-e3a9d0a6-b8a1-475d-a0df-6213479972ec'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:15.344650 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e3a9d0a6-b8a1-475d-a0df-6213479972ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aa03566adff425a83a825ee12839c58', 'request_id': 'req-e3a9d0a6-b8a1-475d-a0df-6213479972ec'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:15.352450 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e3a9d0a6-b8a1-475d-a0df-6213479972ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aa03566adff425a83a825ee12839c58', 'request_id': 'req-e3a9d0a6-b8a1-475d-a0df-6213479972ec'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:15.365116 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e3a9d0a6-b8a1-475d-a0df-6213479972ec admin admin] The token cache is being invalidate because project 7aa03566adff425a83a825ee12839c58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:51:15.365401 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e3a9d0a6-b8a1-475d-a0df-6213479972ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:15.366302 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e3a9d0a6-b8a1-475d-a0df-6213479972ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:15.367890 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1310/2617] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:51:14 2022] DELETE /identity/v3/projects/7aa03566adff425a83a825ee12839c58 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:51:20.042112 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3e610-ec2a-45be-b87a-2431d56d2476 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:20.043612 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-82d3e610-ec2a-45be-b87a-2431d56d2476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:20.130781 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3e610-ec2a-45be-b87a-2431d56d2476 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:20.200822 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16268f15-a78d-4eb8-8989-03557596d556 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63253cd786c04d6a9d099773198aee36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:20.201780 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16268f15-a78d-4eb8-8989-03557596d556 service placement] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:20.202199 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16268f15-a78d-4eb8-8989-03557596d556 service placement] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:20.202584 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16268f15-a78d-4eb8-8989-03557596d556 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:20.204917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-16268f15-a78d-4eb8-8989-03557596d556 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:20.218135 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16268f15-a78d-4eb8-8989-03557596d556 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:20.219790 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16268f15-a78d-4eb8-8989-03557596d556 service placement] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:20.232038 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1308/2618] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:51:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:51:25.647046 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=15,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:30.226340 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=65,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:34.979498 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a9d0a6-b8a1-475d-a0df-6213479972ec admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:34.981406 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e3a9d0a6-b8a1-475d-a0df-6213479972ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:35.004538 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16268f15-a78d-4eb8-8989-03557596d556 service placement] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:35.006799 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-16268f15-a78d-4eb8-8989-03557596d556 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:35.059405 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a9d0a6-b8a1-475d-a0df-6213479972ec admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:35.065131 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466ff75-2fee-433e-aaf8-5f5b14df6dce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:35.065899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466ff75-2fee-433e-aaf8-5f5b14df6dce service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:35.066178 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466ff75-2fee-433e-aaf8-5f5b14df6dce service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:35.066454 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466ff75-2fee-433e-aaf8-5f5b14df6dce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:35.068241 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8466ff75-2fee-433e-aaf8-5f5b14df6dce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:35.074524 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16268f15-a78d-4eb8-8989-03557596d556 service placement] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:35.079327 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635910f-a5f7-42f2-b97c-3398d16c001e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:35.079956 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635910f-a5f7-42f2-b97c-3398d16c001e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:35.080300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635910f-a5f7-42f2-b97c-3398d16c001e admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:35.080604 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635910f-a5f7-42f2-b97c-3398d16c001e admin admin] PATH_INFO: `/v3/users/3ea672cd61cf49c788485c0a2bb0f9e5` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:35.081735 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635910f-a5f7-42f2-b97c-3398d16c001e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ea672cd61cf49c788485c0a2bb0f9e5)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:35.083684 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635910f-a5f7-42f2-b97c-3398d16c001e admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:35.131503 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466ff75-2fee-433e-aaf8-5f5b14df6dce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:35.133081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466ff75-2fee-433e-aaf8-5f5b14df6dce service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:35.143101 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1311/2619] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:51:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:51:35.424361 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-3635910f-a5f7-42f2-b97c-3398d16c001e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ea672cd61cf49c788485c0a2bb0f9e5'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:35.432829 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-3635910f-a5f7-42f2-b97c-3398d16c001e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ea672cd61cf49c788485c0a2bb0f9e5'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:35.438719 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-3635910f-a5f7-42f2-b97c-3398d16c001e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ea672cd61cf49c788485c0a2bb0f9e5'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:35.439518 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-3635910f-a5f7-42f2-b97c-3398d16c001e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ea672cd61cf49c788485c0a2bb0f9e5'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:35.583714 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-3635910f-a5f7-42f2-b97c-3398d16c001e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ea672cd61cf49c788485c0a2bb0f9e5'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:35.598052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1309/2620] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:51:35 2022] DELETE /identity/v3/users/3ea672cd61cf49c788485c0a2bb0f9e5 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:51:35.602775 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955fd01-4bc8-4344-9bc5-419560d998ae None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:35.603058 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955fd01-4bc8-4344-9bc5-419560d998ae None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:35.604135 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955fd01-4bc8-4344-9bc5-419560d998ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:35.625992 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-9955fd01-4bc8-4344-9bc5-419560d998ae None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:51:35.627250 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9955fd01-4bc8-4344-9bc5-419560d998ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:35.690105 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1312/2621] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:51:35.700312 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635910f-a5f7-42f2-b97c-3398d16c001e admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:35.701731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3635910f-a5f7-42f2-b97c-3398d16c001e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:35.763590 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635910f-a5f7-42f2-b97c-3398d16c001e admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:35.767068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da44de5-f5f9-4beb-a29c-40a8d49b7dd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:35.767682 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da44de5-f5f9-4beb-a29c-40a8d49b7dd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:35.767956 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da44de5-f5f9-4beb-a29c-40a8d49b7dd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:35.768225 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da44de5-f5f9-4beb-a29c-40a8d49b7dd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:35.778852 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da44de5-f5f9-4beb-a29c-40a8d49b7dd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:35.780276 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da44de5-f5f9-4beb-a29c-40a8d49b7dd0 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:35.790285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1310/2622] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:51:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:51:36.311041 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955fd01-4bc8-4344-9bc5-419560d998ae None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:36.318320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9955fd01-4bc8-4344-9bc5-419560d998ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:36.325617 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955fd01-4bc8-4344-9bc5-419560d998ae None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:36.330626 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7082c-6672-4500-b32a-380aad4a8533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:36.331560 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7082c-6672-4500-b32a-380aad4a8533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:36.331818 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7082c-6672-4500-b32a-380aad4a8533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:36.332069 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7082c-6672-4500-b32a-380aad4a8533 admin admin] PATH_INFO: `/v3/projects/fb7c48e92c454743a87ec047b43e515d` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:36.333491 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7082c-6672-4500-b32a-380aad4a8533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb7c48e92c454743a87ec047b43e515d)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:36.335650 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7082c-6672-4500-b32a-380aad4a8533 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:36.512349 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:36.524667 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-24c7082c-6672-4500-b32a-380aad4a8533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb7c48e92c454743a87ec047b43e515d', 'request_id': 'req-24c7082c-6672-4500-b32a-380aad4a8533'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:36.630137 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-24c7082c-6672-4500-b32a-380aad4a8533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb7c48e92c454743a87ec047b43e515d', 'request_id': 'req-24c7082c-6672-4500-b32a-380aad4a8533'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:36.638012 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-24c7082c-6672-4500-b32a-380aad4a8533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb7c48e92c454743a87ec047b43e515d', 'request_id': 'req-24c7082c-6672-4500-b32a-380aad4a8533'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:36.651994 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-24c7082c-6672-4500-b32a-380aad4a8533 admin admin] The token cache is being invalidate because project fb7c48e92c454743a87ec047b43e515d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:51:36.652287 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-24c7082c-6672-4500-b32a-380aad4a8533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:36.652961 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-24c7082c-6672-4500-b32a-380aad4a8533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:36.654554 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1313/2623] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:51:36 2022] DELETE /identity/v3/projects/fb7c48e92c454743a87ec047b43e515d => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:51:39.590578 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f7b26-9b40-40c5-8557-134c320a9a41 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:39.591047 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f7b26-9b40-40c5-8557-134c320a9a41 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:39.591166 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f7b26-9b40-40c5-8557-134c320a9a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:39.612728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-f53f7b26-9b40-40c5-8557-134c320a9a41 None None] MFA Rules not processed for user `477ab357d285415e8c0c82d414d242ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:51:39.613962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f53f7b26-9b40-40c5-8557-134c320a9a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:39.634065 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:39.676717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1311/2624] 10.222.0.65 () {58 vars in 967 bytes} [Wed Aug 24 14:51:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:51:39.876213 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7082c-6672-4500-b32a-380aad4a8533 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:39.876213 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-24c7082c-6672-4500-b32a-380aad4a8533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:39.968991 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7082c-6672-4500-b32a-380aad4a8533 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:39.975120 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f80a3d-3298-4218-8c3f-bcec2ddb5d51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b3c32ecfdcf40629f09a7f52b2b5fa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:39.975738 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f80a3d-3298-4218-8c3f-bcec2ddb5d51 service swift] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:39.976012 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f80a3d-3298-4218-8c3f-bcec2ddb5d51 service swift] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:39.976281 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f80a3d-3298-4218-8c3f-bcec2ddb5d51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:39.985443 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f80a3d-3298-4218-8c3f-bcec2ddb5d51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:39.987079 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f80a3d-3298-4218-8c3f-bcec2ddb5d51 service swift] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:39.996112 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1314/2625] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 14:51:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 14:51:41.327516 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f7b26-9b40-40c5-8557-134c320a9a41 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:41.329594 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f53f7b26-9b40-40c5-8557-134c320a9a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:41.394012 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f7b26-9b40-40c5-8557-134c320a9a41 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:41.397966 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c3152-a72b-4b5e-97c3-037b1ffc8f37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:41.398583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c3152-a72b-4b5e-97c3-037b1ffc8f37 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:41.398854 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c3152-a72b-4b5e-97c3-037b1ffc8f37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:41.399211 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c3152-a72b-4b5e-97c3-037b1ffc8f37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:41.401603 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-789c3152-a72b-4b5e-97c3-037b1ffc8f37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:41.469149 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c3152-a72b-4b5e-97c3-037b1ffc8f37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:41.470822 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c3152-a72b-4b5e-97c3-037b1ffc8f37 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:41.481609 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1312/2626] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:51:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:51:44.327226 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc876486-1035-474d-bce1-f14dad4c6469 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:44.327824 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc876486-1035-474d-bce1-f14dad4c6469 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:44.327824 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc876486-1035-474d-bce1-f14dad4c6469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:44.350525 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-bc876486-1035-474d-bce1-f14dad4c6469 None None] MFA Rules not processed for user `f88f7857e1d24bb0b038b7f6e98a6f34`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:51:44.351786 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-bc876486-1035-474d-bce1-f14dad4c6469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:44.424923 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1315/2627] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:51:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:51:44.765649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c3152-a72b-4b5e-97c3-037b1ffc8f37 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:44.767317 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-789c3152-a72b-4b5e-97c3-037b1ffc8f37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:44.780440 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c3152-a72b-4b5e-97c3-037b1ffc8f37 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:44.785889 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415ec71-616e-4954-a0c7-e5bee9a37359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:44.786887 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415ec71-616e-4954-a0c7-e5bee9a37359 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:44.787832 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415ec71-616e-4954-a0c7-e5bee9a37359 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:44.788111 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415ec71-616e-4954-a0c7-e5bee9a37359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:44.791177 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f415ec71-616e-4954-a0c7-e5bee9a37359 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:44.802863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415ec71-616e-4954-a0c7-e5bee9a37359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:44.804522 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415ec71-616e-4954-a0c7-e5bee9a37359 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:44.815139 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1313/2628] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:51:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:51:45.676206 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc876486-1035-474d-bce1-f14dad4c6469 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:45.679244 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-bc876486-1035-474d-bce1-f14dad4c6469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:45.733335 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:45.757167 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc876486-1035-474d-bce1-f14dad4c6469 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:45.762489 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412d7b5-833c-438a-8ca3-3c36b1ab3b47 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63253cd786c04d6a9d099773198aee36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:45.763142 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412d7b5-833c-438a-8ca3-3c36b1ab3b47 service placement] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:45.763421 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412d7b5-833c-438a-8ca3-3c36b1ab3b47 service placement] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:45.763696 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412d7b5-833c-438a-8ca3-3c36b1ab3b47 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:45.765506 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1412d7b5-833c-438a-8ca3-3c36b1ab3b47 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:45.778894 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1412d7b5-833c-438a-8ca3-3c36b1ab3b47 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:45.780521 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1412d7b5-833c-438a-8ca3-3c36b1ab3b47 service placement] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:45.792477 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1316/2629] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:51:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:51:50.698113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415ec71-616e-4954-a0c7-e5bee9a37359 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:50.700826 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f415ec71-616e-4954-a0c7-e5bee9a37359 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:50.723833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415ec71-616e-4954-a0c7-e5bee9a37359 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:50.730328 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943b1dd-2b7a-475c-91d2-22c48304073c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:50.731051 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943b1dd-2b7a-475c-91d2-22c48304073c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:50.731339 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943b1dd-2b7a-475c-91d2-22c48304073c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:50.731628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943b1dd-2b7a-475c-91d2-22c48304073c admin admin] PATH_INFO: `/v3/users/331aa49c0e374bfeafbe4bacb8c5a079` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:50.732860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943b1dd-2b7a-475c-91d2-22c48304073c admin admin] RBAC: Authorizing `identity:delete_user(user_id=331aa49c0e374bfeafbe4bacb8c5a079)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:50.734935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943b1dd-2b7a-475c-91d2-22c48304073c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:50.753501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412d7b5-833c-438a-8ca3-3c36b1ab3b47 service placement] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:50.755293 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1412d7b5-833c-438a-8ca3-3c36b1ab3b47 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:50.771715 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412d7b5-833c-438a-8ca3-3c36b1ab3b47 service placement] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:50.776618 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc788b-6303-4d49-afbd-551983acc851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:50.777269 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc788b-6303-4d49-afbd-551983acc851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:50.781883 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc788b-6303-4d49-afbd-551983acc851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:50.781883 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc788b-6303-4d49-afbd-551983acc851 admin admin] PATH_INFO: `/v3/users/cde1ea819e2d47e8b1a8ef5247bc61e0` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:50.781883 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc788b-6303-4d49-afbd-551983acc851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cde1ea819e2d47e8b1a8ef5247bc61e0)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:50.781883 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc788b-6303-4d49-afbd-551983acc851 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:51.054963 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9943b1dd-2b7a-475c-91d2-22c48304073c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '331aa49c0e374bfeafbe4bacb8c5a079'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:51.056477 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9943b1dd-2b7a-475c-91d2-22c48304073c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '331aa49c0e374bfeafbe4bacb8c5a079'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:51.060713 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-07fc788b-6303-4d49-afbd-551983acc851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cde1ea819e2d47e8b1a8ef5247bc61e0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:51.062644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-07fc788b-6303-4d49-afbd-551983acc851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cde1ea819e2d47e8b1a8ef5247bc61e0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:51.063797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-07fc788b-6303-4d49-afbd-551983acc851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cde1ea819e2d47e8b1a8ef5247bc61e0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:51.068709 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:51.074469 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9943b1dd-2b7a-475c-91d2-22c48304073c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '331aa49c0e374bfeafbe4bacb8c5a079'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:51.075208 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9943b1dd-2b7a-475c-91d2-22c48304073c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '331aa49c0e374bfeafbe4bacb8c5a079'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:51.081447 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-07fc788b-6303-4d49-afbd-551983acc851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cde1ea819e2d47e8b1a8ef5247bc61e0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:51.155326 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-9943b1dd-2b7a-475c-91d2-22c48304073c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '331aa49c0e374bfeafbe4bacb8c5a079'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:51.173290 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1314/2630] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:51:50 2022] DELETE /identity/v3/users/331aa49c0e374bfeafbe4bacb8c5a079 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:51:51.177793 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190b9ab-34fe-4312-968e-c0941dba8207 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:51.178087 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190b9ab-34fe-4312-968e-c0941dba8207 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:51.178368 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190b9ab-34fe-4312-968e-c0941dba8207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:51.204017 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-f190b9ab-34fe-4312-968e-c0941dba8207 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:51:51.205253 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f190b9ab-34fe-4312-968e-c0941dba8207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:51.227779 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-07fc788b-6303-4d49-afbd-551983acc851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cde1ea819e2d47e8b1a8ef5247bc61e0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:51.250400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1317/2631] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:51:50 2022] DELETE /identity/v3/users/cde1ea819e2d47e8b1a8ef5247bc61e0 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:51:51.289832 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1315/2632] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:51:51.300637 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc788b-6303-4d49-afbd-551983acc851 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:51.302726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-07fc788b-6303-4d49-afbd-551983acc851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:51.384790 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc788b-6303-4d49-afbd-551983acc851 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:51.390323 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130a7c2-1313-4ffd-9fb8-60c31ffa8936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:51.391067 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130a7c2-1313-4ffd-9fb8-60c31ffa8936 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:51.391901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130a7c2-1313-4ffd-9fb8-60c31ffa8936 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:51.392445 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130a7c2-1313-4ffd-9fb8-60c31ffa8936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:51.478393 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:51.484279 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130a7c2-1313-4ffd-9fb8-60c31ffa8936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:51.486758 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130a7c2-1313-4ffd-9fb8-60c31ffa8936 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:51.507111 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1318/2633] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:51:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:51:51.815808 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190b9ab-34fe-4312-968e-c0941dba8207 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:51.817329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f190b9ab-34fe-4312-968e-c0941dba8207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:51.834628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190b9ab-34fe-4312-968e-c0941dba8207 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:51.840109 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9decfc3-037a-4a26-a217-c51f43a4d735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:51.840882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9decfc3-037a-4a26-a217-c51f43a4d735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:51.841260 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9decfc3-037a-4a26-a217-c51f43a4d735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:51.841733 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9decfc3-037a-4a26-a217-c51f43a4d735 admin admin] PATH_INFO: `/v3/projects/1a8ff5bc8c6d4adaac8b73d5dfadfc31` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:51.846654 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9decfc3-037a-4a26-a217-c51f43a4d735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a8ff5bc8c6d4adaac8b73d5dfadfc31)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:51.848883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9decfc3-037a-4a26-a217-c51f43a4d735 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:52.108180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e9decfc3-037a-4a26-a217-c51f43a4d735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'request_id': 'req-e9decfc3-037a-4a26-a217-c51f43a4d735'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:52.230234 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e9decfc3-037a-4a26-a217-c51f43a4d735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'request_id': 'req-e9decfc3-037a-4a26-a217-c51f43a4d735'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:52.238331 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e9decfc3-037a-4a26-a217-c51f43a4d735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'request_id': 'req-e9decfc3-037a-4a26-a217-c51f43a4d735'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:52.250470 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e9decfc3-037a-4a26-a217-c51f43a4d735 admin admin] The token cache is being invalidate because project 1a8ff5bc8c6d4adaac8b73d5dfadfc31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:51:52.250773 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e9decfc3-037a-4a26-a217-c51f43a4d735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:52.251640 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-e9decfc3-037a-4a26-a217-c51f43a4d735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:52.253408 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1316/2634] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:51:51 2022] DELETE /identity/v3/projects/1a8ff5bc8c6d4adaac8b73d5dfadfc31 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:51:52.257619 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130a7c2-1313-4ffd-9fb8-60c31ffa8936 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:52.269230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130a7c2-1313-4ffd-9fb8-60c31ffa8936 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:52.342770 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe12cc-2d7a-4ba3-986a-c1eaad44fbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:52.343326 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe12cc-2d7a-4ba3-986a-c1eaad44fbf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:52.343605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe12cc-2d7a-4ba3-986a-c1eaad44fbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:52.343872 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe12cc-2d7a-4ba3-986a-c1eaad44fbf7 admin admin] PATH_INFO: `/v3/users/bf5cb506dd97465b9ac9b4765d663a04` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:52.345026 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe12cc-2d7a-4ba3-986a-c1eaad44fbf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf5cb506dd97465b9ac9b4765d663a04)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:52.347305 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe12cc-2d7a-4ba3-986a-c1eaad44fbf7 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:52.443683 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9decfc3-037a-4a26-a217-c51f43a4d735 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:52.445201 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e9decfc3-037a-4a26-a217-c51f43a4d735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:52.459401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9decfc3-037a-4a26-a217-c51f43a4d735 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:52.473124 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7afe80-e056-43b9-bdf2-494bee0391e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:52.473124 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7afe80-e056-43b9-bdf2-494bee0391e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:52.473124 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7afe80-e056-43b9-bdf2-494bee0391e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:52.473124 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7afe80-e056-43b9-bdf2-494bee0391e4 admin admin] PATH_INFO: `/v3/projects/145c42b1a31744e898dc3c679c30164f` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:52.473886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7afe80-e056-43b9-bdf2-494bee0391e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=145c42b1a31744e898dc3c679c30164f)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:52.473886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7afe80-e056-43b9-bdf2-494bee0391e4 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:52.658151 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-50fe12cc-2d7a-4ba3-986a-c1eaad44fbf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf5cb506dd97465b9ac9b4765d663a04'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:52.658461 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-fa7afe80-e056-43b9-bdf2-494bee0391e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '145c42b1a31744e898dc3c679c30164f', 'request_id': 'req-fa7afe80-e056-43b9-bdf2-494bee0391e4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:52.658806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-50fe12cc-2d7a-4ba3-986a-c1eaad44fbf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf5cb506dd97465b9ac9b4765d663a04'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:52.659484 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-50fe12cc-2d7a-4ba3-986a-c1eaad44fbf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf5cb506dd97465b9ac9b4765d663a04'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:52.662497 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:52.672631 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-50fe12cc-2d7a-4ba3-986a-c1eaad44fbf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf5cb506dd97465b9ac9b4765d663a04'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:52.777981 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-fa7afe80-e056-43b9-bdf2-494bee0391e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '145c42b1a31744e898dc3c679c30164f', 'request_id': 'req-fa7afe80-e056-43b9-bdf2-494bee0391e4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:52.786020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-fa7afe80-e056-43b9-bdf2-494bee0391e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '145c42b1a31744e898dc3c679c30164f', 'request_id': 'req-fa7afe80-e056-43b9-bdf2-494bee0391e4'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:52.797611 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-fa7afe80-e056-43b9-bdf2-494bee0391e4 admin admin] The token cache is being invalidate because project 145c42b1a31744e898dc3c679c30164f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:51:52.797951 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-fa7afe80-e056-43b9-bdf2-494bee0391e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:52.798681 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-fa7afe80-e056-43b9-bdf2-494bee0391e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:52.800418 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1317/2635] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:51:52 2022] DELETE /identity/v3/projects/145c42b1a31744e898dc3c679c30164f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:51:52.804572 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7afe80-e056-43b9-bdf2-494bee0391e4 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:52.805957 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-fa7afe80-e056-43b9-bdf2-494bee0391e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:52.835618 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-50fe12cc-2d7a-4ba3-986a-c1eaad44fbf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf5cb506dd97465b9ac9b4765d663a04'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:52.862080 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1319/2636] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:51:52 2022] DELETE /identity/v3/users/bf5cb506dd97465b9ac9b4765d663a04 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:51:52.893205 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7afe80-e056-43b9-bdf2-494bee0391e4 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:52.969578 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f5914-8251-4d62-81ce-74c1cde901c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:52.970271 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f5914-8251-4d62-81ce-74c1cde901c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:52.970553 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f5914-8251-4d62-81ce-74c1cde901c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:52.970826 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f5914-8251-4d62-81ce-74c1cde901c7 admin admin] PATH_INFO: `/v3/users/16bcd6ad111c4a60b8697896a791b776` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:52.973037 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f5914-8251-4d62-81ce-74c1cde901c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16bcd6ad111c4a60b8697896a791b776)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:52.975273 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f5914-8251-4d62-81ce-74c1cde901c7 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:53.140718 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe12cc-2d7a-4ba3-986a-c1eaad44fbf7 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:53.142258 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-50fe12cc-2d7a-4ba3-986a-c1eaad44fbf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:53.158361 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe12cc-2d7a-4ba3-986a-c1eaad44fbf7 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:53.164067 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba1dba-9d13-4964-aeb6-d079507cfb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:53.165037 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba1dba-9d13-4964-aeb6-d079507cfb8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:53.165416 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba1dba-9d13-4964-aeb6-d079507cfb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:53.165699 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba1dba-9d13-4964-aeb6-d079507cfb8b admin admin] PATH_INFO: `/v3/projects/cff7650e371a42179e8256fb88d3529f` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:53.167536 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba1dba-9d13-4964-aeb6-d079507cfb8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cff7650e371a42179e8256fb88d3529f)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:53.169583 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba1dba-9d13-4964-aeb6-d079507cfb8b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:53.186846 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-397f5914-8251-4d62-81ce-74c1cde901c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16bcd6ad111c4a60b8697896a791b776'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:53.187512 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-397f5914-8251-4d62-81ce-74c1cde901c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16bcd6ad111c4a60b8697896a791b776'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:53.206467 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-397f5914-8251-4d62-81ce-74c1cde901c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16bcd6ad111c4a60b8697896a791b776'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:53.207212 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-397f5914-8251-4d62-81ce-74c1cde901c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16bcd6ad111c4a60b8697896a791b776'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:53.298644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-aeba1dba-9d13-4964-aeb6-d079507cfb8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cff7650e371a42179e8256fb88d3529f', 'request_id': 'req-aeba1dba-9d13-4964-aeb6-d079507cfb8b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:53.309707 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-397f5914-8251-4d62-81ce-74c1cde901c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16bcd6ad111c4a60b8697896a791b776'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:53.326228 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1318/2637] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:51:52 2022] DELETE /identity/v3/users/16bcd6ad111c4a60b8697896a791b776 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:51:53.429526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-aeba1dba-9d13-4964-aeb6-d079507cfb8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cff7650e371a42179e8256fb88d3529f', 'request_id': 'req-aeba1dba-9d13-4964-aeb6-d079507cfb8b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:53.437444 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-aeba1dba-9d13-4964-aeb6-d079507cfb8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cff7650e371a42179e8256fb88d3529f', 'request_id': 'req-aeba1dba-9d13-4964-aeb6-d079507cfb8b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:53.444266 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:53.449123 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-aeba1dba-9d13-4964-aeb6-d079507cfb8b admin admin] The token cache is being invalidate because project cff7650e371a42179e8256fb88d3529f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:51:53.449409 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-aeba1dba-9d13-4964-aeb6-d079507cfb8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:53.450271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-aeba1dba-9d13-4964-aeb6-d079507cfb8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:53.451773 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1320/2638] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:51:53 2022] DELETE /identity/v3/projects/cff7650e371a42179e8256fb88d3529f => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:51:53.907515 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f5914-8251-4d62-81ce-74c1cde901c7 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:53.909193 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-397f5914-8251-4d62-81ce-74c1cde901c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:53.922014 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:53.993217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f5914-8251-4d62-81ce-74c1cde901c7 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:54.000040 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2e95e-568d-4e2b-9af5-fa57482f883c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:54.000733 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2e95e-568d-4e2b-9af5-fa57482f883c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:54.001065 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2e95e-568d-4e2b-9af5-fa57482f883c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:54.001403 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2e95e-568d-4e2b-9af5-fa57482f883c admin admin] PATH_INFO: `/v3/projects/e799cf08ec7e4d23844eb29baff14d2b` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:54.003211 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2e95e-568d-4e2b-9af5-fa57482f883c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e799cf08ec7e4d23844eb29baff14d2b)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:54.006496 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2e95e-568d-4e2b-9af5-fa57482f883c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:54.191113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-82b2e95e-568d-4e2b-9af5-fa57482f883c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e799cf08ec7e4d23844eb29baff14d2b', 'request_id': 'req-82b2e95e-568d-4e2b-9af5-fa57482f883c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:54.298236 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-82b2e95e-568d-4e2b-9af5-fa57482f883c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e799cf08ec7e4d23844eb29baff14d2b', 'request_id': 'req-82b2e95e-568d-4e2b-9af5-fa57482f883c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:54.305148 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-82b2e95e-568d-4e2b-9af5-fa57482f883c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e799cf08ec7e4d23844eb29baff14d2b', 'request_id': 'req-82b2e95e-568d-4e2b-9af5-fa57482f883c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:54.317309 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-82b2e95e-568d-4e2b-9af5-fa57482f883c admin admin] The token cache is being invalidate because project e799cf08ec7e4d23844eb29baff14d2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:51:54.317589 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-82b2e95e-568d-4e2b-9af5-fa57482f883c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:54.318243 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-82b2e95e-568d-4e2b-9af5-fa57482f883c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:51:54.319799 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1319/2639] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:51:53 2022] DELETE /identity/v3/projects/e799cf08ec7e4d23844eb29baff14d2b => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:51:54.325856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8037a-950c-4d4c-aaa3-309ab07dc806 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:54.326375 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8037a-950c-4d4c-aaa3-309ab07dc806 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:54.326375 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8037a-950c-4d4c-aaa3-309ab07dc806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:54.346550 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-54a8037a-950c-4d4c-aaa3-309ab07dc806 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:51:54.348968 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-54a8037a-950c-4d4c-aaa3-309ab07dc806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:54.408860 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1321/2640] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:51:54.417056 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983b92c-f9d9-4fc3-8450-245230b0254d None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:54.417357 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983b92c-f9d9-4fc3-8450-245230b0254d None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:54.417700 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983b92c-f9d9-4fc3-8450-245230b0254d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:54.438812 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-0983b92c-f9d9-4fc3-8450-245230b0254d None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:51:54.440062 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0983b92c-f9d9-4fc3-8450-245230b0254d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:54.449353 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1320/2641] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:51:54.453671 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8037a-950c-4d4c-aaa3-309ab07dc806 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:54.464300 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8037a-950c-4d4c-aaa3-309ab07dc806 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:54.468929 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da77fed-d70b-4318-8cac-be0b2d4e4ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:54.469527 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da77fed-d70b-4318-8cac-be0b2d4e4ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:54.469841 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da77fed-d70b-4318-8cac-be0b2d4e4ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:54.470175 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da77fed-d70b-4318-8cac-be0b2d4e4ca0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:54.470777 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da77fed-d70b-4318-8cac-be0b2d4e4ca0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:51:54.471075 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da77fed-d70b-4318-8cac-be0b2d4e4ca0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:54.472913 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da77fed-d70b-4318-8cac-be0b2d4e4ca0 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:54.485211 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1322/2642] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:51:54.489333 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983b92c-f9d9-4fc3-8450-245230b0254d None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:54.499396 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983b92c-f9d9-4fc3-8450-245230b0254d None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:54.504193 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba13aa-85fb-454b-94c5-ba0f851b70dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:54.505854 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba13aa-85fb-454b-94c5-ba0f851b70dc admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:54.505854 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba13aa-85fb-454b-94c5-ba0f851b70dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:54.505854 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba13aa-85fb-454b-94c5-ba0f851b70dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:54.506150 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba13aa-85fb-454b-94c5-ba0f851b70dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:54.507842 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba13aa-85fb-454b-94c5-ba0f851b70dc admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:54.649724 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1321/2643] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:51:54 2022] POST /identity/v3/projects => generated 363 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:51:54.651629 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da77fed-d70b-4318-8cac-be0b2d4e4ca0 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:54.662126 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da77fed-d70b-4318-8cac-be0b2d4e4ca0 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:54.722288 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3639b97-3dc1-4916-9622-301b4d54eb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:54.722802 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3639b97-3dc1-4916-9622-301b4d54eb55 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:54.723076 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3639b97-3dc1-4916-9622-301b4d54eb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:54.723340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3639b97-3dc1-4916-9622-301b4d54eb55 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:54.723949 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3639b97-3dc1-4916-9622-301b4d54eb55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:54.726002 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3639b97-3dc1-4916-9622-301b4d54eb55 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:54.817876 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1323/2644] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:51:54 2022] POST /identity/v3/users => generated 282 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:51:54.822179 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba13aa-85fb-454b-94c5-ba0f851b70dc admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:54.833480 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba13aa-85fb-454b-94c5-ba0f851b70dc admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:54.838870 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78ba04-92da-4a6f-a612-dd8c4a8def58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:54.839875 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78ba04-92da-4a6f-a612-dd8c4a8def58 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:54.840389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78ba04-92da-4a6f-a612-dd8c4a8def58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:54.840789 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78ba04-92da-4a6f-a612-dd8c4a8def58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:54.841442 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de78ba04-92da-4a6f-a612-dd8c4a8def58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:54.843053 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de78ba04-92da-4a6f-a612-dd8c4a8def58 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:54.854425 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1322/2645] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:51:54.858564 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3639b97-3dc1-4916-9622-301b4d54eb55 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:54.869007 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3639b97-3dc1-4916-9622-301b4d54eb55 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:54.873829 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f39a81-edb0-4440-b39e-28e5e75fe2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:54.874431 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f39a81-edb0-4440-b39e-28e5e75fe2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:54.874711 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f39a81-edb0-4440-b39e-28e5e75fe2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:54.875006 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f39a81-edb0-4440-b39e-28e5e75fe2f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:54.875669 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f39a81-edb0-4440-b39e-28e5e75fe2f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:54.877251 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f39a81-edb0-4440-b39e-28e5e75fe2f1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:54.888919 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1324/2646] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:51:54.893401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78ba04-92da-4a6f-a612-dd8c4a8def58 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:54.904668 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78ba04-92da-4a6f-a612-dd8c4a8def58 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:54.909429 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24b410-3963-4f3a-9d36-1694012fac4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:54.910105 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24b410-3963-4f3a-9d36-1694012fac4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:54.910387 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24b410-3963-4f3a-9d36-1694012fac4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:54.910669 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24b410-3963-4f3a-9d36-1694012fac4f admin admin] PATH_INFO: `/v3/projects/20daef34507746a594d4d75424fb6c32/users/8986a581c193423790d9559306872219/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:54.925694 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24b410-3963-4f3a-9d36-1694012fac4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=20daef34507746a594d4d75424fb6c32, user_id=8986a581c193423790d9559306872219, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:54.928390 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24b410-3963-4f3a-9d36-1694012fac4f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:55.026374 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1323/2647] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:51:54 2022] PUT /identity/v3/projects/20daef34507746a594d4d75424fb6c32/users/8986a581c193423790d9559306872219/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:51:55.036770 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a73227-c2a3-4821-b3d2-5f2ecbb112cb None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:55.037050 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a73227-c2a3-4821-b3d2-5f2ecbb112cb None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:55.037315 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a73227-c2a3-4821-b3d2-5f2ecbb112cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:55.066268 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d0a73227-c2a3-4821-b3d2-5f2ecbb112cb None None] MFA Rules not processed for user `8986a581c193423790d9559306872219`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:51:55.074812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d0a73227-c2a3-4821-b3d2-5f2ecbb112cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:55.128370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:55.139072 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1325/2648] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:51:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:51:55.143973 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24b410-3963-4f3a-9d36-1694012fac4f admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:55.183646 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:55.207180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24b410-3963-4f3a-9d36-1694012fac4f admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:55.211982 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c22586-2eaf-43bc-b071-2c650e800a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:55.212583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c22586-2eaf-43bc-b071-2c650e800a45 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:55.212896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c22586-2eaf-43bc-b071-2c650e800a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:55.213297 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c22586-2eaf-43bc-b071-2c650e800a45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:55.213944 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c22586-2eaf-43bc-b071-2c650e800a45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:55.220550 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c22586-2eaf-43bc-b071-2c650e800a45 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:55.346971 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1324/2649] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:51:55 2022] POST /identity/v3/projects => generated 363 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:51:55.350482 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a73227-c2a3-4821-b3d2-5f2ecbb112cb None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:55.362039 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a73227-c2a3-4821-b3d2-5f2ecbb112cb None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:55.430055 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3e3cd-a870-468d-98da-40164356e43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:55.430657 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3e3cd-a870-468d-98da-40164356e43d admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:55.430936 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3e3cd-a870-468d-98da-40164356e43d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:55.431204 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3e3cd-a870-468d-98da-40164356e43d admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:55.432622 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef3e3cd-a870-468d-98da-40164356e43d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:55.435195 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef3e3cd-a870-468d-98da-40164356e43d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:55.561884 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1326/2650] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:51:55 2022] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:51:55.565859 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c22586-2eaf-43bc-b071-2c650e800a45 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:55.576816 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c22586-2eaf-43bc-b071-2c650e800a45 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:55.581353 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420f600-3857-45b8-80a7-74c55f662ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:55.581990 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420f600-3857-45b8-80a7-74c55f662ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:55.581990 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420f600-3857-45b8-80a7-74c55f662ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:55.582792 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420f600-3857-45b8-80a7-74c55f662ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:55.583154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f420f600-3857-45b8-80a7-74c55f662ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:55.584738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f420f600-3857-45b8-80a7-74c55f662ed1 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:55.595365 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1325/2651] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:51:55.600034 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3e3cd-a870-468d-98da-40164356e43d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:55.610683 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3e3cd-a870-468d-98da-40164356e43d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:55.615680 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37648c91-6ebd-49c9-80bf-e5e861968342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:55.616533 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37648c91-6ebd-49c9-80bf-e5e861968342 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:55.616660 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37648c91-6ebd-49c9-80bf-e5e861968342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:55.617270 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37648c91-6ebd-49c9-80bf-e5e861968342 admin admin] PATH_INFO: `/v3/projects/88347d6b603b4658b9e480e3bb7c15d4/users/4e1e9f5984a948e38a281deb57bad29a/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:55.633064 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37648c91-6ebd-49c9-80bf-e5e861968342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88347d6b603b4658b9e480e3bb7c15d4, user_id=4e1e9f5984a948e38a281deb57bad29a, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:55.636831 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37648c91-6ebd-49c9-80bf-e5e861968342 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:55.709598 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1327/2652] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:51:55 2022] PUT /identity/v3/projects/88347d6b603b4658b9e480e3bb7c15d4/users/4e1e9f5984a948e38a281deb57bad29a/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:51:55.714606 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420f600-3857-45b8-80a7-74c55f662ed1 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:55.725937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420f600-3857-45b8-80a7-74c55f662ed1 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:55.785388 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5ac62-7bdc-4040-912d-b5107b6509e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:55.786098 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5ac62-7bdc-4040-912d-b5107b6509e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:55.786408 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5ac62-7bdc-4040-912d-b5107b6509e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:55.786679 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5ac62-7bdc-4040-912d-b5107b6509e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:55.787358 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5ac62-7bdc-4040-912d-b5107b6509e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:55.788976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5ac62-7bdc-4040-912d-b5107b6509e4 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:55.799833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1326/2653] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:51:55.805502 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37648c91-6ebd-49c9-80bf-e5e861968342 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:55.816945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37648c91-6ebd-49c9-80bf-e5e861968342 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:55.821665 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21db74-bf05-4bfc-894c-3b226c701d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:55.823122 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21db74-bf05-4bfc-894c-3b226c701d3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:55.823532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21db74-bf05-4bfc-894c-3b226c701d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:55.823817 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21db74-bf05-4bfc-894c-3b226c701d3d admin admin] PATH_INFO: `/v3/projects/88347d6b603b4658b9e480e3bb7c15d4/users/4e1e9f5984a948e38a281deb57bad29a/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:55.825830 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21db74-bf05-4bfc-894c-3b226c701d3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=88347d6b603b4658b9e480e3bb7c15d4, user_id=4e1e9f5984a948e38a281deb57bad29a, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:55.831955 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21db74-bf05-4bfc-894c-3b226c701d3d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:55.841094 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1328/2654] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:51:55 2022] PUT /identity/v3/projects/88347d6b603b4658b9e480e3bb7c15d4/users/4e1e9f5984a948e38a281deb57bad29a/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:51:55.854264 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfa914-c2b4-4c10-bcc3-eace33c11321 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:55.854552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfa914-c2b4-4c10-bcc3-eace33c11321 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:55.854828 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfa914-c2b4-4c10-bcc3-eace33c11321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:55.884716 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-57dfa914-c2b4-4c10-bcc3-eace33c11321 None None] MFA Rules not processed for user `4e1e9f5984a948e38a281deb57bad29a`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:51:55.886570 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-57dfa914-c2b4-4c10-bcc3-eace33c11321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:55.966404 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1327/2655] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:51:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:51:55.980199 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21db74-bf05-4bfc-894c-3b226c701d3d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:55.982191 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0e21db74-bf05-4bfc-894c-3b226c701d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:56.052318 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21db74-bf05-4bfc-894c-3b226c701d3d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:56.056193 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc5af1-fb4b-4987-a424-941ce96b1462 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:56.057529 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc5af1-fb4b-4987-a424-941ce96b1462 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:56.057837 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc5af1-fb4b-4987-a424-941ce96b1462 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:56.063696 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc5af1-fb4b-4987-a424-941ce96b1462 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:56.069116 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc5af1-fb4b-4987-a424-941ce96b1462 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:56.070517 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc5af1-fb4b-4987-a424-941ce96b1462 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:56.082132 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1329/2656] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:51:55 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:51:56.348304 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfa914-c2b4-4c10-bcc3-eace33c11321 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:56.359093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfa914-c2b4-4c10-bcc3-eace33c11321 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:56.362871 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72226b8-359d-4216-ba6f-07c362a4ae6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:56.363482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72226b8-359d-4216-ba6f-07c362a4ae6c service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:56.363757 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72226b8-359d-4216-ba6f-07c362a4ae6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:56.364025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72226b8-359d-4216-ba6f-07c362a4ae6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:56.403670 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:56.434495 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72226b8-359d-4216-ba6f-07c362a4ae6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:56.436012 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72226b8-359d-4216-ba6f-07c362a4ae6c service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:56.445729 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1328/2657] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:51:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:51:58.204011 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc5af1-fb4b-4987-a424-941ce96b1462 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:58.205610 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e5dc5af1-fb4b-4987-a424-941ce96b1462 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:58.283070 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:58.312604 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc5af1-fb4b-4987-a424-941ce96b1462 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:58.320640 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba3c26-6dce-4128-8e6c-b455db0cb61f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:58.321353 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba3c26-6dce-4128-8e6c-b455db0cb61f service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:58.321723 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba3c26-6dce-4128-8e6c-b455db0cb61f service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:58.322093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba3c26-6dce-4128-8e6c-b455db0cb61f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:58.325730 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b0ba3c26-6dce-4128-8e6c-b455db0cb61f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:58.348760 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba3c26-6dce-4128-8e6c-b455db0cb61f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:58.350416 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba3c26-6dce-4128-8e6c-b455db0cb61f service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:58.362672 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1330/2658] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:51:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:52:00.256540 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72226b8-359d-4216-ba6f-07c362a4ae6c service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:00.323154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72226b8-359d-4216-ba6f-07c362a4ae6c service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:00.327876 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e438e3d-ab3d-4d74-ad5b-4f2f5d9e4790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:00.328497 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e438e3d-ab3d-4d74-ad5b-4f2f5d9e4790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:00.328779 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e438e3d-ab3d-4d74-ad5b-4f2f5d9e4790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:00.329056 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e438e3d-ab3d-4d74-ad5b-4f2f5d9e4790 admin admin] PATH_INFO: `/v3/users/8986a581c193423790d9559306872219` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:00.330212 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e438e3d-ab3d-4d74-ad5b-4f2f5d9e4790 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8986a581c193423790d9559306872219)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:00.332258 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e438e3d-ab3d-4d74-ad5b-4f2f5d9e4790 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:00.604250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-4e438e3d-ab3d-4d74-ad5b-4f2f5d9e4790 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8986a581c193423790d9559306872219'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:00.605186 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-4e438e3d-ab3d-4d74-ad5b-4f2f5d9e4790 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8986a581c193423790d9559306872219'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:00.618824 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-4e438e3d-ab3d-4d74-ad5b-4f2f5d9e4790 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8986a581c193423790d9559306872219'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:00.620191 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-4e438e3d-ab3d-4d74-ad5b-4f2f5d9e4790 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8986a581c193423790d9559306872219'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:00.737914 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-4e438e3d-ab3d-4d74-ad5b-4f2f5d9e4790 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8986a581c193423790d9559306872219'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:00.752351 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1329/2659] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:52:00 2022] DELETE /identity/v3/users/8986a581c193423790d9559306872219 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:52:00.757043 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c6b9e-17e6-4686-b0f2-45d9f182a8e6 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:00.757564 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c6b9e-17e6-4686-b0f2-45d9f182a8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:00.757662 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c6b9e-17e6-4686-b0f2-45d9f182a8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:00.777323 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d54c6b9e-17e6-4686-b0f2-45d9f182a8e6 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:52:00.778576 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d54c6b9e-17e6-4686-b0f2-45d9f182a8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:00.838157 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1331/2660] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:52:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:52:00.848457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e438e3d-ab3d-4d74-ad5b-4f2f5d9e4790 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:00.849880 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4e438e3d-ab3d-4d74-ad5b-4f2f5d9e4790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:00.906161 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:00.909928 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e438e3d-ab3d-4d74-ad5b-4f2f5d9e4790 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:00.913603 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78befd-326f-4843-8efc-603c132f5401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:00.914274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78befd-326f-4843-8efc-603c132f5401 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:00.914560 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78befd-326f-4843-8efc-603c132f5401 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:00.914834 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78befd-326f-4843-8efc-603c132f5401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:00.925167 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78befd-326f-4843-8efc-603c132f5401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:00.926647 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78befd-326f-4843-8efc-603c132f5401 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:00.937064 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1330/2661] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:52:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:52:01.420034 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c6b9e-17e6-4686-b0f2-45d9f182a8e6 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:01.421628 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d54c6b9e-17e6-4686-b0f2-45d9f182a8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:01.440500 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c6b9e-17e6-4686-b0f2-45d9f182a8e6 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:01.445385 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d057a98-2a74-4af9-9268-a600df78d246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:01.446172 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d057a98-2a74-4af9-9268-a600df78d246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:01.446522 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d057a98-2a74-4af9-9268-a600df78d246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:01.446865 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d057a98-2a74-4af9-9268-a600df78d246 admin admin] PATH_INFO: `/v3/projects/20daef34507746a594d4d75424fb6c32` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:01.448897 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d057a98-2a74-4af9-9268-a600df78d246 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20daef34507746a594d4d75424fb6c32)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:01.451769 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d057a98-2a74-4af9-9268-a600df78d246 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:01.562900 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7d057a98-2a74-4af9-9268-a600df78d246 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20daef34507746a594d4d75424fb6c32', 'request_id': 'req-7d057a98-2a74-4af9-9268-a600df78d246'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:01.640574 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7d057a98-2a74-4af9-9268-a600df78d246 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20daef34507746a594d4d75424fb6c32', 'request_id': 'req-7d057a98-2a74-4af9-9268-a600df78d246'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:01.647513 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7d057a98-2a74-4af9-9268-a600df78d246 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20daef34507746a594d4d75424fb6c32', 'request_id': 'req-7d057a98-2a74-4af9-9268-a600df78d246'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:01.659375 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7d057a98-2a74-4af9-9268-a600df78d246 admin admin] The token cache is being invalidate because project 20daef34507746a594d4d75424fb6c32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:52:01.659704 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7d057a98-2a74-4af9-9268-a600df78d246 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:01.660402 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7d057a98-2a74-4af9-9268-a600df78d246 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:01.661987 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1332/2662] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:52:01 2022] DELETE /identity/v3/projects/20daef34507746a594d4d75424fb6c32 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:52:01.666516 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78befd-326f-4843-8efc-603c132f5401 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:01.676725 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78befd-326f-4843-8efc-603c132f5401 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:01.738398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc740e-5b93-4403-a959-1a3d48af18fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:01.739028 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc740e-5b93-4403-a959-1a3d48af18fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:01.739564 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc740e-5b93-4403-a959-1a3d48af18fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:01.739564 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc740e-5b93-4403-a959-1a3d48af18fc admin admin] PATH_INFO: `/v3/users/4e1e9f5984a948e38a281deb57bad29a` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:01.740731 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc740e-5b93-4403-a959-1a3d48af18fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e1e9f5984a948e38a281deb57bad29a)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:01.743115 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc740e-5b93-4403-a959-1a3d48af18fc admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:02.025012 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f5fc740e-5b93-4403-a959-1a3d48af18fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e1e9f5984a948e38a281deb57bad29a'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:02.026428 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f5fc740e-5b93-4403-a959-1a3d48af18fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e1e9f5984a948e38a281deb57bad29a'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:02.038726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f5fc740e-5b93-4403-a959-1a3d48af18fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e1e9f5984a948e38a281deb57bad29a'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:02.039512 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f5fc740e-5b93-4403-a959-1a3d48af18fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e1e9f5984a948e38a281deb57bad29a'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:02.137887 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-f5fc740e-5b93-4403-a959-1a3d48af18fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e1e9f5984a948e38a281deb57bad29a'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:02.152336 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1331/2663] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:52:01 2022] DELETE /identity/v3/users/4e1e9f5984a948e38a281deb57bad29a => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:52:02.598453 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d057a98-2a74-4af9-9268-a600df78d246 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:02.600528 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7d057a98-2a74-4af9-9268-a600df78d246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:02.614645 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d057a98-2a74-4af9-9268-a600df78d246 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:02.687666 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:02.693974 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e8157-256d-4107-87be-7d1f7de270b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:02.700028 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e8157-256d-4107-87be-7d1f7de270b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:02.700028 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e8157-256d-4107-87be-7d1f7de270b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:02.700028 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e8157-256d-4107-87be-7d1f7de270b9 admin admin] PATH_INFO: `/v3/projects/88347d6b603b4658b9e480e3bb7c15d4` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:02.700028 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e8157-256d-4107-87be-7d1f7de270b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88347d6b603b4658b9e480e3bb7c15d4)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:02.700747 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e8157-256d-4107-87be-7d1f7de270b9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:02.842436 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d90e8157-256d-4107-87be-7d1f7de270b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88347d6b603b4658b9e480e3bb7c15d4', 'request_id': 'req-d90e8157-256d-4107-87be-7d1f7de270b9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:02.920878 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d90e8157-256d-4107-87be-7d1f7de270b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88347d6b603b4658b9e480e3bb7c15d4', 'request_id': 'req-d90e8157-256d-4107-87be-7d1f7de270b9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:02.930953 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d90e8157-256d-4107-87be-7d1f7de270b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88347d6b603b4658b9e480e3bb7c15d4', 'request_id': 'req-d90e8157-256d-4107-87be-7d1f7de270b9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:02.945743 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d90e8157-256d-4107-87be-7d1f7de270b9 admin admin] The token cache is being invalidate because project 88347d6b603b4658b9e480e3bb7c15d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:52:02.946143 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d90e8157-256d-4107-87be-7d1f7de270b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:02.946899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d90e8157-256d-4107-87be-7d1f7de270b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:02.948481 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1333/2664] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:52:02 2022] DELETE /identity/v3/projects/88347d6b603b4658b9e480e3bb7c15d4 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:52:02.954552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56755610-484a-481b-b55b-9deb9ffa2b53 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:02.955100 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56755610-484a-481b-b55b-9deb9ffa2b53 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:02.955273 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56755610-484a-481b-b55b-9deb9ffa2b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:02.983506 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-56755610-484a-481b-b55b-9deb9ffa2b53 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:52:02.984755 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-56755610-484a-481b-b55b-9deb9ffa2b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:03.058752 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1332/2665] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:52:03.067035 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527ac6b-3f02-4185-8c15-357411112b8f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:03.067352 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527ac6b-3f02-4185-8c15-357411112b8f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:03.067651 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527ac6b-3f02-4185-8c15-357411112b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:03.090630 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a527ac6b-3f02-4185-8c15-357411112b8f None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:52:03.094013 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a527ac6b-3f02-4185-8c15-357411112b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:03.100489 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1334/2666] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:52:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:52:03.105713 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56755610-484a-481b-b55b-9deb9ffa2b53 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:03.118512 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56755610-484a-481b-b55b-9deb9ffa2b53 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:03.124621 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc22f55-d493-4458-91d2-da3407e5ae5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:03.134364 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc22f55-d493-4458-91d2-da3407e5ae5a admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:03.134364 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc22f55-d493-4458-91d2-da3407e5ae5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:03.134364 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc22f55-d493-4458-91d2-da3407e5ae5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:03.134364 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc22f55-d493-4458-91d2-da3407e5ae5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:52:03.134364 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc22f55-d493-4458-91d2-da3407e5ae5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:03.134364 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc22f55-d493-4458-91d2-da3407e5ae5a admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:03.137556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:03.150193 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1333/2667] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:52:03.151731 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527ac6b-3f02-4185-8c15-357411112b8f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:03.162104 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527ac6b-3f02-4185-8c15-357411112b8f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:03.167675 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf781d-634d-4429-88eb-a792c9cf15a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:03.168292 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf781d-634d-4429-88eb-a792c9cf15a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:03.168571 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf781d-634d-4429-88eb-a792c9cf15a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:03.168843 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf781d-634d-4429-88eb-a792c9cf15a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:03.169481 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf781d-634d-4429-88eb-a792c9cf15a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:03.171422 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf781d-634d-4429-88eb-a792c9cf15a9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:03.304857 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1335/2668] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:52:03 2022] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:52:03.309680 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc22f55-d493-4458-91d2-da3407e5ae5a admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:03.320048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc22f55-d493-4458-91d2-da3407e5ae5a admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:03.386001 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cd4e5-e8f0-4524-a840-55b3822cdf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:03.386613 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cd4e5-e8f0-4524-a840-55b3822cdf59 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:03.386890 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cd4e5-e8f0-4524-a840-55b3822cdf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:03.387162 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cd4e5-e8f0-4524-a840-55b3822cdf59 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:03.387986 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534cd4e5-e8f0-4524-a840-55b3822cdf59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:03.389942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534cd4e5-e8f0-4524-a840-55b3822cdf59 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:03.504416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1334/2669] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:52:03 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:52:03.508835 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf781d-634d-4429-88eb-a792c9cf15a9 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:03.521188 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf781d-634d-4429-88eb-a792c9cf15a9 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:03.526288 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad7979-96ea-4644-8e19-c93ed6cf7dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:03.526902 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad7979-96ea-4644-8e19-c93ed6cf7dcc admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:03.527307 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad7979-96ea-4644-8e19-c93ed6cf7dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:03.527723 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad7979-96ea-4644-8e19-c93ed6cf7dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:03.528382 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad7979-96ea-4644-8e19-c93ed6cf7dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:03.530039 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad7979-96ea-4644-8e19-c93ed6cf7dcc admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:03.542595 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1336/2670] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:52:03.547263 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cd4e5-e8f0-4524-a840-55b3822cdf59 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:03.559754 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cd4e5-e8f0-4524-a840-55b3822cdf59 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:03.565647 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa0494-22f7-4d18-8a07-abf7ad085c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:03.567322 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa0494-22f7-4d18-8a07-abf7ad085c4e admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:03.567322 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa0494-22f7-4d18-8a07-abf7ad085c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:03.567322 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa0494-22f7-4d18-8a07-abf7ad085c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:03.567605 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa0494-22f7-4d18-8a07-abf7ad085c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:03.569139 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa0494-22f7-4d18-8a07-abf7ad085c4e admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:03.581902 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1335/2671] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:52:03.586496 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad7979-96ea-4644-8e19-c93ed6cf7dcc admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:03.598143 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad7979-96ea-4644-8e19-c93ed6cf7dcc admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:03.603257 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e29d5-d5ef-46c8-a706-b62ca7b557f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:03.604093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e29d5-d5ef-46c8-a706-b62ca7b557f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:03.604374 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e29d5-d5ef-46c8-a706-b62ca7b557f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:03.604670 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e29d5-d5ef-46c8-a706-b62ca7b557f5 admin admin] PATH_INFO: `/v3/projects/29e3b7d9042a43b298d9ced39419133d/users/08d30521ff1542daa1e97d100b99256d/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:03.621792 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e29d5-d5ef-46c8-a706-b62ca7b557f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e3b7d9042a43b298d9ced39419133d, user_id=08d30521ff1542daa1e97d100b99256d, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:03.624760 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e29d5-d5ef-46c8-a706-b62ca7b557f5 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:03.711089 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1337/2672] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:52:03 2022] PUT /identity/v3/projects/29e3b7d9042a43b298d9ced39419133d/users/08d30521ff1542daa1e97d100b99256d/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:52:03.722628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676fa3f5-6886-4686-84cc-5cfc454b2248 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:03.722950 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676fa3f5-6886-4686-84cc-5cfc454b2248 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:03.723199 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676fa3f5-6886-4686-84cc-5cfc454b2248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:03.753353 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-676fa3f5-6886-4686-84cc-5cfc454b2248 None None] MFA Rules not processed for user `08d30521ff1542daa1e97d100b99256d`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:52:03.754639 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-676fa3f5-6886-4686-84cc-5cfc454b2248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:03.824548 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1336/2673] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:52:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:52:03.829166 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e29d5-d5ef-46c8-a706-b62ca7b557f5 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:03.899775 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e29d5-d5ef-46c8-a706-b62ca7b557f5 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:03.905474 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb72c85-6af8-45bd-973e-f99089987d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:03.906034 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb72c85-6af8-45bd-973e-f99089987d30 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:03.906452 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb72c85-6af8-45bd-973e-f99089987d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:03.906570 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb72c85-6af8-45bd-973e-f99089987d30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:03.907181 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb72c85-6af8-45bd-973e-f99089987d30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:03.909092 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb72c85-6af8-45bd-973e-f99089987d30 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:04.025805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1338/2674] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:52:03 2022] POST /identity/v3/projects => generated 375 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:52:04.030034 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676fa3f5-6886-4686-84cc-5cfc454b2248 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:04.042160 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676fa3f5-6886-4686-84cc-5cfc454b2248 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:04.100109 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b8e23-51bb-44e6-96ee-41fe11891851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:04.100719 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b8e23-51bb-44e6-96ee-41fe11891851 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:04.100992 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b8e23-51bb-44e6-96ee-41fe11891851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:04.101259 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b8e23-51bb-44e6-96ee-41fe11891851 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:04.101904 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b8e23-51bb-44e6-96ee-41fe11891851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:04.104213 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b8e23-51bb-44e6-96ee-41fe11891851 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:04.115226 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:04.258091 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1337/2675] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:52:04 2022] POST /identity/v3/users => generated 294 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:52:04.263062 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb72c85-6af8-45bd-973e-f99089987d30 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:04.273772 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb72c85-6af8-45bd-973e-f99089987d30 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:04.278740 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535e07b-fb20-497d-b0f3-0bc66719d1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:04.279381 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535e07b-fb20-497d-b0f3-0bc66719d1ee admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:04.279658 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535e07b-fb20-497d-b0f3-0bc66719d1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:04.279930 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535e07b-fb20-497d-b0f3-0bc66719d1ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:04.280582 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535e07b-fb20-497d-b0f3-0bc66719d1ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:04.282225 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535e07b-fb20-497d-b0f3-0bc66719d1ee admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:04.284501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:04.293402 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1339/2676] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:52:04.299366 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b8e23-51bb-44e6-96ee-41fe11891851 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:04.310762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b8e23-51bb-44e6-96ee-41fe11891851 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:04.315468 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59951f64-5277-443d-9167-bf620df2343c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:04.316105 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59951f64-5277-443d-9167-bf620df2343c admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:04.316381 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59951f64-5277-443d-9167-bf620df2343c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:04.316651 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59951f64-5277-443d-9167-bf620df2343c admin admin] PATH_INFO: `/v3/projects/75ff479abfab41579efa9bb199f3615f/users/2f6e31e66e724f01bac379287fb6396c/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:04.332732 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59951f64-5277-443d-9167-bf620df2343c admin admin] RBAC: Authorizing `identity:create_grant(project_id=75ff479abfab41579efa9bb199f3615f, user_id=2f6e31e66e724f01bac379287fb6396c, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:04.335442 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59951f64-5277-443d-9167-bf620df2343c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:04.493379 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1338/2677] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:52:04 2022] PUT /identity/v3/projects/75ff479abfab41579efa9bb199f3615f/users/2f6e31e66e724f01bac379287fb6396c/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:52:04.498076 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535e07b-fb20-497d-b0f3-0bc66719d1ee admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:04.508245 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535e07b-fb20-497d-b0f3-0bc66719d1ee admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:04.565456 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a87f52-868a-43cb-be84-df42f5b5f267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:04.566100 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a87f52-868a-43cb-be84-df42f5b5f267 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:04.566374 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a87f52-868a-43cb-be84-df42f5b5f267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:04.566643 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a87f52-868a-43cb-be84-df42f5b5f267 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:04.567288 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a87f52-868a-43cb-be84-df42f5b5f267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:04.568862 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a87f52-868a-43cb-be84-df42f5b5f267 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:04.579325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1340/2678] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:52:04.583648 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59951f64-5277-443d-9167-bf620df2343c admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:04.594303 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59951f64-5277-443d-9167-bf620df2343c admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:04.599192 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99197a90-70ba-44d4-9917-7a8e341ff214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:04.599846 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99197a90-70ba-44d4-9917-7a8e341ff214 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:04.600126 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99197a90-70ba-44d4-9917-7a8e341ff214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:04.600401 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99197a90-70ba-44d4-9917-7a8e341ff214 admin admin] PATH_INFO: `/v3/projects/75ff479abfab41579efa9bb199f3615f/users/2f6e31e66e724f01bac379287fb6396c/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:04.602402 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99197a90-70ba-44d4-9917-7a8e341ff214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75ff479abfab41579efa9bb199f3615f, user_id=2f6e31e66e724f01bac379287fb6396c, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:04.605550 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99197a90-70ba-44d4-9917-7a8e341ff214 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:04.616074 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1339/2679] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:52:04 2022] PUT /identity/v3/projects/75ff479abfab41579efa9bb199f3615f/users/2f6e31e66e724f01bac379287fb6396c/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:52:04.628226 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce4cce-a843-4f8f-829a-584105796709 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:04.628783 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce4cce-a843-4f8f-829a-584105796709 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:04.628783 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce4cce-a843-4f8f-829a-584105796709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:04.657598 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a8ce4cce-a843-4f8f-829a-584105796709 None None] MFA Rules not processed for user `2f6e31e66e724f01bac379287fb6396c`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:52:04.658885 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a8ce4cce-a843-4f8f-829a-584105796709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:04.728180 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1341/2680] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:52:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:52:04.739505 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99197a90-70ba-44d4-9917-7a8e341ff214 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:04.741247 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-99197a90-70ba-44d4-9917-7a8e341ff214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:04.801095 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99197a90-70ba-44d4-9917-7a8e341ff214 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:04.805009 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d91abb-f0da-4d09-bc7c-8c061d31e4c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:04.805622 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d91abb-f0da-4d09-bc7c-8c061d31e4c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:04.805936 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d91abb-f0da-4d09-bc7c-8c061d31e4c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:04.806210 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d91abb-f0da-4d09-bc7c-8c061d31e4c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:04.864708 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d91abb-f0da-4d09-bc7c-8c061d31e4c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:04.866262 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d91abb-f0da-4d09-bc7c-8c061d31e4c0 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:04.875473 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1340/2681] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:52:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:52:12.547391 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce4cce-a843-4f8f-829a-584105796709 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:12.558226 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce4cce-a843-4f8f-829a-584105796709 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:12.562144 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9697493-5b1b-441d-938c-b3d4df2b5f49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:12.562739 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9697493-5b1b-441d-938c-b3d4df2b5f49 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:12.563014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9697493-5b1b-441d-938c-b3d4df2b5f49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:12.563280 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9697493-5b1b-441d-938c-b3d4df2b5f49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:12.574172 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9697493-5b1b-441d-938c-b3d4df2b5f49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:12.575761 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9697493-5b1b-441d-938c-b3d4df2b5f49 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:12.585889 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1342/2682] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:52:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:52:14.871250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=65,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:22.581283 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=70 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:44.335505 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d91abb-f0da-4d09-bc7c-8c061d31e4c0 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:44.407058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d91abb-f0da-4d09-bc7c-8c061d31e4c0 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:44.411559 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba8d02-bc71-46fb-985d-76436442aeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:44.412229 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba8d02-bc71-46fb-985d-76436442aeb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:44.412512 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba8d02-bc71-46fb-985d-76436442aeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:44.412786 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba8d02-bc71-46fb-985d-76436442aeb9 admin admin] PATH_INFO: `/v3/users/08d30521ff1542daa1e97d100b99256d` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:44.413946 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba8d02-bc71-46fb-985d-76436442aeb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08d30521ff1542daa1e97d100b99256d)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:44.415876 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba8d02-bc71-46fb-985d-76436442aeb9 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:44.592464 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-acba8d02-bc71-46fb-985d-76436442aeb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08d30521ff1542daa1e97d100b99256d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:44.593127 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-acba8d02-bc71-46fb-985d-76436442aeb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08d30521ff1542daa1e97d100b99256d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:44.605284 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-acba8d02-bc71-46fb-985d-76436442aeb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08d30521ff1542daa1e97d100b99256d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:44.605950 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-acba8d02-bc71-46fb-985d-76436442aeb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08d30521ff1542daa1e97d100b99256d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:44.656987 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-acba8d02-bc71-46fb-985d-76436442aeb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08d30521ff1542daa1e97d100b99256d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:44.670129 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1341/2683] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:52:44 2022] DELETE /identity/v3/users/08d30521ff1542daa1e97d100b99256d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:52:44.675822 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f4c89-2451-459c-8cb6-04892e6c2556 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:44.675822 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f4c89-2451-459c-8cb6-04892e6c2556 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:44.675822 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f4c89-2451-459c-8cb6-04892e6c2556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:44.695641 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d15f4c89-2451-459c-8cb6-04892e6c2556 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:52:44.698792 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d15f4c89-2451-459c-8cb6-04892e6c2556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:44.756095 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1343/2684] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:52:44.766554 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba8d02-bc71-46fb-985d-76436442aeb9 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:44.768011 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-acba8d02-bc71-46fb-985d-76436442aeb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:44.824743 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba8d02-bc71-46fb-985d-76436442aeb9 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:44.828485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50254a9-94b3-4dab-ab9d-97c2a58c8788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:44.829089 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50254a9-94b3-4dab-ab9d-97c2a58c8788 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:44.829362 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50254a9-94b3-4dab-ab9d-97c2a58c8788 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:44.829629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50254a9-94b3-4dab-ab9d-97c2a58c8788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:44.838634 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50254a9-94b3-4dab-ab9d-97c2a58c8788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:44.840053 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50254a9-94b3-4dab-ab9d-97c2a58c8788 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:44.850149 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1342/2685] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:52:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:52:45.280973 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f4c89-2451-459c-8cb6-04892e6c2556 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:45.282857 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d15f4c89-2451-459c-8cb6-04892e6c2556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:45.295784 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f4c89-2451-459c-8cb6-04892e6c2556 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:45.301034 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5247dd1-ec1f-48c4-a2cc-eb60f91a5af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:45.301681 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5247dd1-ec1f-48c4-a2cc-eb60f91a5af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:45.301996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5247dd1-ec1f-48c4-a2cc-eb60f91a5af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:45.302269 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5247dd1-ec1f-48c4-a2cc-eb60f91a5af2 admin admin] PATH_INFO: `/v3/projects/29e3b7d9042a43b298d9ced39419133d` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:45.303432 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5247dd1-ec1f-48c4-a2cc-eb60f91a5af2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29e3b7d9042a43b298d9ced39419133d)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:45.305500 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5247dd1-ec1f-48c4-a2cc-eb60f91a5af2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:45.440879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c5247dd1-ec1f-48c4-a2cc-eb60f91a5af2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29e3b7d9042a43b298d9ced39419133d', 'request_id': 'req-c5247dd1-ec1f-48c4-a2cc-eb60f91a5af2'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:45.514454 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c5247dd1-ec1f-48c4-a2cc-eb60f91a5af2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29e3b7d9042a43b298d9ced39419133d', 'request_id': 'req-c5247dd1-ec1f-48c4-a2cc-eb60f91a5af2'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:45.521421 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c5247dd1-ec1f-48c4-a2cc-eb60f91a5af2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29e3b7d9042a43b298d9ced39419133d', 'request_id': 'req-c5247dd1-ec1f-48c4-a2cc-eb60f91a5af2'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:45.532855 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c5247dd1-ec1f-48c4-a2cc-eb60f91a5af2 admin admin] The token cache is being invalidate because project 29e3b7d9042a43b298d9ced39419133d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:52:45.533140 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c5247dd1-ec1f-48c4-a2cc-eb60f91a5af2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:45.533834 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c5247dd1-ec1f-48c4-a2cc-eb60f91a5af2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:45.535372 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1344/2686] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:52:45 2022] DELETE /identity/v3/projects/29e3b7d9042a43b298d9ced39419133d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:52:45.541305 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50254a9-94b3-4dab-ab9d-97c2a58c8788 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:45.551923 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50254a9-94b3-4dab-ab9d-97c2a58c8788 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:45.570216 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:45.611910 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eac1b5-f8ea-4a41-a794-d9c7d1fd05f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:45.612462 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eac1b5-f8ea-4a41-a794-d9c7d1fd05f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:45.612740 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eac1b5-f8ea-4a41-a794-d9c7d1fd05f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:45.613012 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eac1b5-f8ea-4a41-a794-d9c7d1fd05f8 admin admin] PATH_INFO: `/v3/users/2f6e31e66e724f01bac379287fb6396c` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:45.614257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eac1b5-f8ea-4a41-a794-d9c7d1fd05f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f6e31e66e724f01bac379287fb6396c)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:45.616209 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eac1b5-f8ea-4a41-a794-d9c7d1fd05f8 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:45.807005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-75eac1b5-f8ea-4a41-a794-d9c7d1fd05f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f6e31e66e724f01bac379287fb6396c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:45.807663 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-75eac1b5-f8ea-4a41-a794-d9c7d1fd05f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f6e31e66e724f01bac379287fb6396c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:45.820689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-75eac1b5-f8ea-4a41-a794-d9c7d1fd05f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f6e31e66e724f01bac379287fb6396c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:45.821372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-75eac1b5-f8ea-4a41-a794-d9c7d1fd05f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f6e31e66e724f01bac379287fb6396c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:45.896907 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-75eac1b5-f8ea-4a41-a794-d9c7d1fd05f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f6e31e66e724f01bac379287fb6396c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:45.911602 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1343/2687] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:52:45 2022] DELETE /identity/v3/users/2f6e31e66e724f01bac379287fb6396c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:52:46.283027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5247dd1-ec1f-48c4-a2cc-eb60f91a5af2 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:46.284840 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c5247dd1-ec1f-48c4-a2cc-eb60f91a5af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:46.309532 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5247dd1-ec1f-48c4-a2cc-eb60f91a5af2 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:46.370970 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a58e95-1e3e-453c-9629-e4c190f934ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:46.371595 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a58e95-1e3e-453c-9629-e4c190f934ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:46.371874 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a58e95-1e3e-453c-9629-e4c190f934ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:46.372797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a58e95-1e3e-453c-9629-e4c190f934ac admin admin] PATH_INFO: `/v3/projects/75ff479abfab41579efa9bb199f3615f` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:46.373969 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a58e95-1e3e-453c-9629-e4c190f934ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=75ff479abfab41579efa9bb199f3615f)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:46.375879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a58e95-1e3e-453c-9629-e4c190f934ac admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:46.475790 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:46.492782 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-79a58e95-1e3e-453c-9629-e4c190f934ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75ff479abfab41579efa9bb199f3615f', 'request_id': 'req-79a58e95-1e3e-453c-9629-e4c190f934ac'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:46.560668 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-79a58e95-1e3e-453c-9629-e4c190f934ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75ff479abfab41579efa9bb199f3615f', 'request_id': 'req-79a58e95-1e3e-453c-9629-e4c190f934ac'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:46.567840 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-79a58e95-1e3e-453c-9629-e4c190f934ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75ff479abfab41579efa9bb199f3615f', 'request_id': 'req-79a58e95-1e3e-453c-9629-e4c190f934ac'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:46.579918 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-79a58e95-1e3e-453c-9629-e4c190f934ac admin admin] The token cache is being invalidate because project 75ff479abfab41579efa9bb199f3615f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:52:46.580212 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-79a58e95-1e3e-453c-9629-e4c190f934ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:46.580910 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-79a58e95-1e3e-453c-9629-e4c190f934ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:46.582616 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1345/2688] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:52:46 2022] DELETE /identity/v3/projects/75ff479abfab41579efa9bb199f3615f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:52:46.587576 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf663b-c058-4361-983d-b9df2f0c4349 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:46.588181 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf663b-c058-4361-983d-b9df2f0c4349 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:46.588181 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf663b-c058-4361-983d-b9df2f0c4349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:46.611875 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-9faf663b-c058-4361-983d-b9df2f0c4349 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:52:46.613107 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9faf663b-c058-4361-983d-b9df2f0c4349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:46.676321 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1344/2689] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:52:46.684180 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6de8b2-7b87-4a10-8b25-0cbac794d002 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:46.684468 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6de8b2-7b87-4a10-8b25-0cbac794d002 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:46.685324 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6de8b2-7b87-4a10-8b25-0cbac794d002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:46.704809 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ad6de8b2-7b87-4a10-8b25-0cbac794d002 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:52:46.706058 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ad6de8b2-7b87-4a10-8b25-0cbac794d002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:46.713962 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1346/2690] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:52:46.718868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf663b-c058-4361-983d-b9df2f0c4349 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:46.729065 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf663b-c058-4361-983d-b9df2f0c4349 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:46.734760 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3949e-2b66-4fbf-8f95-10fdda6fbce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:46.735368 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3949e-2b66-4fbf-8f95-10fdda6fbce9 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:46.735650 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3949e-2b66-4fbf-8f95-10fdda6fbce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:46.735925 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3949e-2b66-4fbf-8f95-10fdda6fbce9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:46.736607 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3949e-2b66-4fbf-8f95-10fdda6fbce9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:52:46.736912 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3949e-2b66-4fbf-8f95-10fdda6fbce9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:46.738549 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3949e-2b66-4fbf-8f95-10fdda6fbce9 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:46.750736 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1345/2691] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:52:46.755982 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6de8b2-7b87-4a10-8b25-0cbac794d002 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:46.765787 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6de8b2-7b87-4a10-8b25-0cbac794d002 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:46.770416 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3607a0-b016-465d-8c6c-1d7e5923d442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:46.771018 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3607a0-b016-465d-8c6c-1d7e5923d442 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:46.771286 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3607a0-b016-465d-8c6c-1d7e5923d442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:46.771552 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3607a0-b016-465d-8c6c-1d7e5923d442 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:46.772187 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3607a0-b016-465d-8c6c-1d7e5923d442 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:46.774098 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3607a0-b016-465d-8c6c-1d7e5923d442 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:46.870020 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1347/2692] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:52:46 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:52:46.874342 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3949e-2b66-4fbf-8f95-10fdda6fbce9 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:46.884489 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3949e-2b66-4fbf-8f95-10fdda6fbce9 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:46.911621 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:46.943714 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe8685-f607-4bf2-aab2-16e23429ce86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:46.944323 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe8685-f607-4bf2-aab2-16e23429ce86 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:46.944602 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe8685-f607-4bf2-aab2-16e23429ce86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:46.944976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe8685-f607-4bf2-aab2-16e23429ce86 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:46.945525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe8685-f607-4bf2-aab2-16e23429ce86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:46.948070 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe8685-f607-4bf2-aab2-16e23429ce86 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:47.068829 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1346/2693] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:52:46 2022] POST /identity/v3/users => generated 291 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:52:47.073076 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3607a0-b016-465d-8c6c-1d7e5923d442 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:47.084433 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3607a0-b016-465d-8c6c-1d7e5923d442 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:47.088923 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2a941-a607-4839-801f-fd35d2205662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:47.089515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2a941-a607-4839-801f-fd35d2205662 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:47.089870 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2a941-a607-4839-801f-fd35d2205662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:47.090149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2a941-a607-4839-801f-fd35d2205662 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:47.091457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2a941-a607-4839-801f-fd35d2205662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:47.093553 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2a941-a607-4839-801f-fd35d2205662 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:47.103925 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1348/2694] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:52:47.108005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe8685-f607-4bf2-aab2-16e23429ce86 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:47.118141 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe8685-f607-4bf2-aab2-16e23429ce86 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:47.122805 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f5c49-8781-4816-b7b3-139688939228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:47.123385 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f5c49-8781-4816-b7b3-139688939228 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:47.123665 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f5c49-8781-4816-b7b3-139688939228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:47.123939 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f5c49-8781-4816-b7b3-139688939228 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:47.124575 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f5c49-8781-4816-b7b3-139688939228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:47.126201 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f5c49-8781-4816-b7b3-139688939228 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:47.136791 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1347/2695] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:52:47.141491 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2a941-a607-4839-801f-fd35d2205662 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:47.152023 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2a941-a607-4839-801f-fd35d2205662 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:47.157301 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75c0f1-0c18-47c1-ad68-ab9d98c08d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:47.158010 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75c0f1-0c18-47c1-ad68-ab9d98c08d89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:47.158294 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75c0f1-0c18-47c1-ad68-ab9d98c08d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:47.158570 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75c0f1-0c18-47c1-ad68-ab9d98c08d89 admin admin] PATH_INFO: `/v3/projects/3bf031df76cd438f94ad84c2d6dbdb99/users/144be64342324d128892b2cb029c12ac/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:47.174744 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75c0f1-0c18-47c1-ad68-ab9d98c08d89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf031df76cd438f94ad84c2d6dbdb99, user_id=144be64342324d128892b2cb029c12ac, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:47.177396 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75c0f1-0c18-47c1-ad68-ab9d98c08d89 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:47.235208 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1349/2696] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:52:47 2022] PUT /identity/v3/projects/3bf031df76cd438f94ad84c2d6dbdb99/users/144be64342324d128892b2cb029c12ac/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:52:47.246842 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da254f58-d80e-40e7-b549-a6b3d01f2dbe None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:47.247142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da254f58-d80e-40e7-b549-a6b3d01f2dbe None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:47.247591 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da254f58-d80e-40e7-b549-a6b3d01f2dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:47.278087 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-da254f58-d80e-40e7-b549-a6b3d01f2dbe None None] MFA Rules not processed for user `144be64342324d128892b2cb029c12ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:52:47.279877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-da254f58-d80e-40e7-b549-a6b3d01f2dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:47.347720 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1348/2697] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:52:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:52:47.352274 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75c0f1-0c18-47c1-ad68-ab9d98c08d89 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:47.420797 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75c0f1-0c18-47c1-ad68-ab9d98c08d89 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:47.426353 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f6ae6-a8f0-4923-9df4-816f6ec4df63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:47.427135 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f6ae6-a8f0-4923-9df4-816f6ec4df63 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:47.427325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f6ae6-a8f0-4923-9df4-816f6ec4df63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:47.427641 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f6ae6-a8f0-4923-9df4-816f6ec4df63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:47.428305 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f6ae6-a8f0-4923-9df4-816f6ec4df63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:47.430426 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f6ae6-a8f0-4923-9df4-816f6ec4df63 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:47.500768 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1350/2698] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:52:47 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:52:47.504931 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da254f58-d80e-40e7-b549-a6b3d01f2dbe None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:47.517089 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da254f58-d80e-40e7-b549-a6b3d01f2dbe None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:47.575008 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db706f1-e6e3-4fb4-b401-70325cab440d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:47.576296 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db706f1-e6e3-4fb4-b401-70325cab440d admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:47.576576 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db706f1-e6e3-4fb4-b401-70325cab440d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:47.576848 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db706f1-e6e3-4fb4-b401-70325cab440d admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:47.577463 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db706f1-e6e3-4fb4-b401-70325cab440d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:47.579410 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db706f1-e6e3-4fb4-b401-70325cab440d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:47.674674 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1349/2699] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:52:47 2022] POST /identity/v3/users => generated 296 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:52:47.678644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f6ae6-a8f0-4923-9df4-816f6ec4df63 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:47.690008 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f6ae6-a8f0-4923-9df4-816f6ec4df63 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:47.694706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd314c-8961-4c7e-8a0e-6c85e1549059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:47.698098 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd314c-8961-4c7e-8a0e-6c85e1549059 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:47.698098 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd314c-8961-4c7e-8a0e-6c85e1549059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:47.698098 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd314c-8961-4c7e-8a0e-6c85e1549059 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:47.698098 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd314c-8961-4c7e-8a0e-6c85e1549059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:47.698098 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd314c-8961-4c7e-8a0e-6c85e1549059 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:47.710120 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1351/2700] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:52:47.714336 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db706f1-e6e3-4fb4-b401-70325cab440d admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:47.725193 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db706f1-e6e3-4fb4-b401-70325cab440d admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:47.729928 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82763013-97ec-439a-ad8d-22f311478093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:47.730633 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82763013-97ec-439a-ad8d-22f311478093 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:47.730915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82763013-97ec-439a-ad8d-22f311478093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:47.731209 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82763013-97ec-439a-ad8d-22f311478093 admin admin] PATH_INFO: `/v3/projects/e600b15e665a4ef2954cb063b554fdd6/users/e2c86bcbd4e14f2dbea9b5473933fd8d/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:47.746880 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82763013-97ec-439a-ad8d-22f311478093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e600b15e665a4ef2954cb063b554fdd6, user_id=e2c86bcbd4e14f2dbea9b5473933fd8d, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:47.750083 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82763013-97ec-439a-ad8d-22f311478093 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:47.805478 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1350/2701] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:52:47 2022] PUT /identity/v3/projects/e600b15e665a4ef2954cb063b554fdd6/users/e2c86bcbd4e14f2dbea9b5473933fd8d/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:52:47.810125 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd314c-8961-4c7e-8a0e-6c85e1549059 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:47.820450 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd314c-8961-4c7e-8a0e-6c85e1549059 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:47.840451 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:47.895331 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9112441-3ba7-4409-88b0-9a90ae85d9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:47.895942 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9112441-3ba7-4409-88b0-9a90ae85d9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:47.896223 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9112441-3ba7-4409-88b0-9a90ae85d9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:47.896503 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9112441-3ba7-4409-88b0-9a90ae85d9c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:47.897176 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9112441-3ba7-4409-88b0-9a90ae85d9c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:47.898819 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9112441-3ba7-4409-88b0-9a90ae85d9c2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:47.909181 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1352/2702] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:52:47.913357 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82763013-97ec-439a-ad8d-22f311478093 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:47.919417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:47.925515 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82763013-97ec-439a-ad8d-22f311478093 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:47.930255 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157bfff-e2ee-488c-acf9-ea51f24e9ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:47.936798 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157bfff-e2ee-488c-acf9-ea51f24e9ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:47.936798 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157bfff-e2ee-488c-acf9-ea51f24e9ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:47.936798 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157bfff-e2ee-488c-acf9-ea51f24e9ecd admin admin] PATH_INFO: `/v3/projects/e600b15e665a4ef2954cb063b554fdd6/users/e2c86bcbd4e14f2dbea9b5473933fd8d/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:47.936798 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157bfff-e2ee-488c-acf9-ea51f24e9ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e600b15e665a4ef2954cb063b554fdd6, user_id=e2c86bcbd4e14f2dbea9b5473933fd8d, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:47.937203 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157bfff-e2ee-488c-acf9-ea51f24e9ecd admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:47.947310 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1351/2703] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:52:47 2022] PUT /identity/v3/projects/e600b15e665a4ef2954cb063b554fdd6/users/e2c86bcbd4e14f2dbea9b5473933fd8d/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:52:47.957931 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265dd19-b9c6-4422-8c0a-22a55687b3d4 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:47.958214 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265dd19-b9c6-4422-8c0a-22a55687b3d4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:47.958539 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265dd19-b9c6-4422-8c0a-22a55687b3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:47.986921 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-6265dd19-b9c6-4422-8c0a-22a55687b3d4 None None] MFA Rules not processed for user `e2c86bcbd4e14f2dbea9b5473933fd8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:52:47.988121 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6265dd19-b9c6-4422-8c0a-22a55687b3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:48.057527 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1353/2704] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:52:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:52:48.070988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157bfff-e2ee-488c-acf9-ea51f24e9ecd admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:48.072715 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2157bfff-e2ee-488c-acf9-ea51f24e9ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:48.131783 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157bfff-e2ee-488c-acf9-ea51f24e9ecd admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:48.135499 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510e485-3beb-4a50-9482-29aeb5a20171 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:48.136104 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510e485-3beb-4a50-9482-29aeb5a20171 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:48.136386 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510e485-3beb-4a50-9482-29aeb5a20171 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:48.136661 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510e485-3beb-4a50-9482-29aeb5a20171 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:48.146068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510e485-3beb-4a50-9482-29aeb5a20171 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:48.147491 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510e485-3beb-4a50-9482-29aeb5a20171 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:48.157377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1352/2705] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:52:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:52:49.061282 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265dd19-b9c6-4422-8c0a-22a55687b3d4 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:49.070621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265dd19-b9c6-4422-8c0a-22a55687b3d4 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:49.075879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2deca-8b21-4b8c-8bfe-e57efae21e2c tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2c86bcbd4e14f2dbea9b5473933fd8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e600b15e665a4ef2954cb063b554fdd6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:49.076480 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2deca-8b21-4b8c-8bfe-e57efae21e2c tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:49.076759 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2deca-8b21-4b8c-8bfe-e57efae21e2c tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:49.077029 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2deca-8b21-4b8c-8bfe-e57efae21e2c tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:49.078020 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2deca-8b21-4b8c-8bfe-e57efae21e2c tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:52:49.078538 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2deca-8b21-4b8c-8bfe-e57efae21e2c tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:49.081514 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2deca-8b21-4b8c-8bfe-e57efae21e2c tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:49.094353 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1354/2706] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:52:49.099523 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510e485-3beb-4a50-9482-29aeb5a20171 service cinder] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:49.108865 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510e485-3beb-4a50-9482-29aeb5a20171 service cinder] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:49.113526 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4adc157-17da-49e4-9e2f-195a85df0910 tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2c86bcbd4e14f2dbea9b5473933fd8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e600b15e665a4ef2954cb063b554fdd6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:49.114152 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adc157-17da-49e4-9e2f-195a85df0910 tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:49.114442 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adc157-17da-49e4-9e2f-195a85df0910 tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:49.114716 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adc157-17da-49e4-9e2f-195a85df0910 tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:49.115331 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4adc157-17da-49e4-9e2f-195a85df0910 tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:49.117256 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4adc157-17da-49e4-9e2f-195a85df0910 tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:49.199350 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1353/2707] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:52:49 2022] POST /identity/v3/projects => generated 354 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:52:49.208591 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2deca-8b21-4b8c-8bfe-e57efae21e2c tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:49.218919 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2deca-8b21-4b8c-8bfe-e57efae21e2c tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:49.277703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614d217-a107-44cf-9e1a-a331b7347730 tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2c86bcbd4e14f2dbea9b5473933fd8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e600b15e665a4ef2954cb063b554fdd6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:49.278337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614d217-a107-44cf-9e1a-a331b7347730 tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:49.278692 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614d217-a107-44cf-9e1a-a331b7347730 tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:49.279042 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614d217-a107-44cf-9e1a-a331b7347730 tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:49.279620 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614d217-a107-44cf-9e1a-a331b7347730 tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:52:49.279925 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614d217-a107-44cf-9e1a-a331b7347730 tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:49.281652 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614d217-a107-44cf-9e1a-a331b7347730 tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:49.294713 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1355/2708] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:52:49.336984 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4adc157-17da-49e4-9e2f-195a85df0910 tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:49.348413 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4adc157-17da-49e4-9e2f-195a85df0910 tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:49.352975 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb87a5b-45d6-4183-a37b-f91ef54187ae tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2c86bcbd4e14f2dbea9b5473933fd8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e600b15e665a4ef2954cb063b554fdd6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:49.353603 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb87a5b-45d6-4183-a37b-f91ef54187ae tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:49.353917 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb87a5b-45d6-4183-a37b-f91ef54187ae tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:49.354190 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb87a5b-45d6-4183-a37b-f91ef54187ae tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] PATH_INFO: `/v3/projects/a6b35b9c214841cf9c616932810179c2` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:49.355371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb87a5b-45d6-4183-a37b-f91ef54187ae tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a6b35b9c214841cf9c616932810179c2)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:49.358247 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb87a5b-45d6-4183-a37b-f91ef54187ae tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:49.503726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dbb87a5b-45d6-4183-a37b-f91ef54187ae tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6b35b9c214841cf9c616932810179c2', 'request_id': 'req-dbb87a5b-45d6-4183-a37b-f91ef54187ae'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:49.587172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dbb87a5b-45d6-4183-a37b-f91ef54187ae tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6b35b9c214841cf9c616932810179c2', 'request_id': 'req-dbb87a5b-45d6-4183-a37b-f91ef54187ae'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:49.596321 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dbb87a5b-45d6-4183-a37b-f91ef54187ae tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6b35b9c214841cf9c616932810179c2', 'request_id': 'req-dbb87a5b-45d6-4183-a37b-f91ef54187ae'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:49.607361 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dbb87a5b-45d6-4183-a37b-f91ef54187ae tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] The token cache is being invalidate because project a6b35b9c214841cf9c616932810179c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:52:49.607646 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dbb87a5b-45d6-4183-a37b-f91ef54187ae tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:49.608576 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-dbb87a5b-45d6-4183-a37b-f91ef54187ae tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:49.609902 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1354/2709] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:52:49 2022] DELETE /identity/v3/projects/a6b35b9c214841cf9c616932810179c2 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:52:50.221214 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614d217-a107-44cf-9e1a-a331b7347730 tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:50.223449 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3614d217-a107-44cf-9e1a-a331b7347730 tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:50.256560 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:50.291188 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614d217-a107-44cf-9e1a-a331b7347730 tempest-VolumeQuotaClassesTest-298702173 tempest-VolumeQuotaClassesTest-298702173-project-admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:50.350488 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63173440-82a5-4ffc-b870-afd3b9aa5854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:50.351037 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63173440-82a5-4ffc-b870-afd3b9aa5854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:50.351319 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63173440-82a5-4ffc-b870-afd3b9aa5854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:50.351595 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63173440-82a5-4ffc-b870-afd3b9aa5854 admin admin] PATH_INFO: `/v3/users/144be64342324d128892b2cb029c12ac` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:50.352759 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63173440-82a5-4ffc-b870-afd3b9aa5854 admin admin] RBAC: Authorizing `identity:delete_user(user_id=144be64342324d128892b2cb029c12ac)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:50.354732 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63173440-82a5-4ffc-b870-afd3b9aa5854 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:50.551327 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-63173440-82a5-4ffc-b870-afd3b9aa5854 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '144be64342324d128892b2cb029c12ac'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:50.552035 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-63173440-82a5-4ffc-b870-afd3b9aa5854 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '144be64342324d128892b2cb029c12ac'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:50.554891 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-63173440-82a5-4ffc-b870-afd3b9aa5854 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '144be64342324d128892b2cb029c12ac'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:50.569348 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-63173440-82a5-4ffc-b870-afd3b9aa5854 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '144be64342324d128892b2cb029c12ac'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:50.656917 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-63173440-82a5-4ffc-b870-afd3b9aa5854 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '144be64342324d128892b2cb029c12ac'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:50.671324 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1356/2710] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:52:50 2022] DELETE /identity/v3/users/144be64342324d128892b2cb029c12ac => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:52:50.676674 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98be40a-9566-4d2c-8120-10c8f1791d6d None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:50.676674 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98be40a-9566-4d2c-8120-10c8f1791d6d None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:50.676674 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98be40a-9566-4d2c-8120-10c8f1791d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:50.696918 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-d98be40a-9566-4d2c-8120-10c8f1791d6d None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:52:50.698182 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d98be40a-9566-4d2c-8120-10c8f1791d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:50.747127 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:50.759571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1355/2711] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:52:50.769873 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63173440-82a5-4ffc-b870-afd3b9aa5854 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:50.771305 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-63173440-82a5-4ffc-b870-afd3b9aa5854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:50.832874 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63173440-82a5-4ffc-b870-afd3b9aa5854 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:50.836716 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fd33d-5df2-4eeb-b389-bba36dd6cabc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:50.837399 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fd33d-5df2-4eeb-b389-bba36dd6cabc service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:50.837614 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fd33d-5df2-4eeb-b389-bba36dd6cabc service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:50.837929 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fd33d-5df2-4eeb-b389-bba36dd6cabc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:50.846377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:50.848653 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688fd33d-5df2-4eeb-b389-bba36dd6cabc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:50.850252 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688fd33d-5df2-4eeb-b389-bba36dd6cabc service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:50.860762 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1357/2712] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:52:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:52:51.282174 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98be40a-9566-4d2c-8120-10c8f1791d6d None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:51.283638 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d98be40a-9566-4d2c-8120-10c8f1791d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:51.296866 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98be40a-9566-4d2c-8120-10c8f1791d6d None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:51.301571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb53d4-5b02-4805-a9f8-847a98a95654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:51.302229 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb53d4-5b02-4805-a9f8-847a98a95654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:51.302506 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb53d4-5b02-4805-a9f8-847a98a95654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:51.302777 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb53d4-5b02-4805-a9f8-847a98a95654 admin admin] PATH_INFO: `/v3/projects/3bf031df76cd438f94ad84c2d6dbdb99` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:51.303924 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb53d4-5b02-4805-a9f8-847a98a95654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bf031df76cd438f94ad84c2d6dbdb99)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:51.305881 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb53d4-5b02-4805-a9f8-847a98a95654 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:51.421945 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-16fb53d4-5b02-4805-a9f8-847a98a95654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bf031df76cd438f94ad84c2d6dbdb99', 'request_id': 'req-16fb53d4-5b02-4805-a9f8-847a98a95654'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:51.515088 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-16fb53d4-5b02-4805-a9f8-847a98a95654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bf031df76cd438f94ad84c2d6dbdb99', 'request_id': 'req-16fb53d4-5b02-4805-a9f8-847a98a95654'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:51.522045 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-16fb53d4-5b02-4805-a9f8-847a98a95654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bf031df76cd438f94ad84c2d6dbdb99', 'request_id': 'req-16fb53d4-5b02-4805-a9f8-847a98a95654'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:51.532640 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-16fb53d4-5b02-4805-a9f8-847a98a95654 admin admin] The token cache is being invalidate because project 3bf031df76cd438f94ad84c2d6dbdb99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:52:51.532926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-16fb53d4-5b02-4805-a9f8-847a98a95654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:51.533572 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-16fb53d4-5b02-4805-a9f8-847a98a95654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:51.535093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1356/2713] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:52:51 2022] DELETE /identity/v3/projects/3bf031df76cd438f94ad84c2d6dbdb99 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:52:51.539320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fd33d-5df2-4eeb-b389-bba36dd6cabc service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:51.549979 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fd33d-5df2-4eeb-b389-bba36dd6cabc service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:51.606990 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d22f9-fb39-4711-9492-e6a5226dd1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:51.607677 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d22f9-fb39-4711-9492-e6a5226dd1ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:51.607954 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d22f9-fb39-4711-9492-e6a5226dd1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:51.608226 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d22f9-fb39-4711-9492-e6a5226dd1ac admin admin] PATH_INFO: `/v3/users/e2c86bcbd4e14f2dbea9b5473933fd8d` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:51.609445 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d22f9-fb39-4711-9492-e6a5226dd1ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2c86bcbd4e14f2dbea9b5473933fd8d)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:51.611737 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d22f9-fb39-4711-9492-e6a5226dd1ac admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:51.828932 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-140d22f9-fb39-4711-9492-e6a5226dd1ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2c86bcbd4e14f2dbea9b5473933fd8d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:51.829631 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-140d22f9-fb39-4711-9492-e6a5226dd1ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2c86bcbd4e14f2dbea9b5473933fd8d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:51.830331 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-140d22f9-fb39-4711-9492-e6a5226dd1ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2c86bcbd4e14f2dbea9b5473933fd8d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:51.843596 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-140d22f9-fb39-4711-9492-e6a5226dd1ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2c86bcbd4e14f2dbea9b5473933fd8d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:51.891772 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-140d22f9-fb39-4711-9492-e6a5226dd1ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2c86bcbd4e14f2dbea9b5473933fd8d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:51.904686 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1358/2714] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:52:51 2022] DELETE /identity/v3/users/e2c86bcbd4e14f2dbea9b5473933fd8d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:52:52.585398 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb53d4-5b02-4805-a9f8-847a98a95654 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:52.590440 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-16fb53d4-5b02-4805-a9f8-847a98a95654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:52.610347 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb53d4-5b02-4805-a9f8-847a98a95654 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:52.690655 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2df73-f8a1-491e-86d9-54f567de6490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:52.691377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2df73-f8a1-491e-86d9-54f567de6490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:52.691662 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2df73-f8a1-491e-86d9-54f567de6490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:52.691962 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2df73-f8a1-491e-86d9-54f567de6490 admin admin] PATH_INFO: `/v3/projects/e600b15e665a4ef2954cb063b554fdd6` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:52.693131 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2df73-f8a1-491e-86d9-54f567de6490 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e600b15e665a4ef2954cb063b554fdd6)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:52.695146 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2df73-f8a1-491e-86d9-54f567de6490 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:52.815341 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-cbc2df73-f8a1-491e-86d9-54f567de6490 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e600b15e665a4ef2954cb063b554fdd6', 'request_id': 'req-cbc2df73-f8a1-491e-86d9-54f567de6490'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:52.891373 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-cbc2df73-f8a1-491e-86d9-54f567de6490 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e600b15e665a4ef2954cb063b554fdd6', 'request_id': 'req-cbc2df73-f8a1-491e-86d9-54f567de6490'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:52.900375 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-cbc2df73-f8a1-491e-86d9-54f567de6490 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e600b15e665a4ef2954cb063b554fdd6', 'request_id': 'req-cbc2df73-f8a1-491e-86d9-54f567de6490'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:52.911669 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-cbc2df73-f8a1-491e-86d9-54f567de6490 admin admin] The token cache is being invalidate because project e600b15e665a4ef2954cb063b554fdd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:52:52.911960 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-cbc2df73-f8a1-491e-86d9-54f567de6490 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:52.912786 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-cbc2df73-f8a1-491e-86d9-54f567de6490 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:52.914344 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1357/2715] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:52:52 2022] DELETE /identity/v3/projects/e600b15e665a4ef2954cb063b554fdd6 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:52:52.919342 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0cd2a-8a14-4844-964c-804cf761efae None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:52.919872 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0cd2a-8a14-4844-964c-804cf761efae None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:52.919995 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0cd2a-8a14-4844-964c-804cf761efae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:52.945236 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-1ca0cd2a-8a14-4844-964c-804cf761efae None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:52:52.946706 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1ca0cd2a-8a14-4844-964c-804cf761efae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:53.013470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1359/2716] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:52:53.023301 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5feb4c-04db-4e40-9833-ee7a9024e2fd None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:53.023597 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5feb4c-04db-4e40-9833-ee7a9024e2fd None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:53.023879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5feb4c-04db-4e40-9833-ee7a9024e2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:53.039582 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:53.045986 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-ca5feb4c-04db-4e40-9833-ee7a9024e2fd None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:52:53.050026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ca5feb4c-04db-4e40-9833-ee7a9024e2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:53.056545 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1358/2717] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:52:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:52:53.123193 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0cd2a-8a14-4844-964c-804cf761efae None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:53.133534 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0cd2a-8a14-4844-964c-804cf761efae None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:53.138843 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27ec09-012b-4670-bd5a-5015d4990866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:53.139448 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27ec09-012b-4670-bd5a-5015d4990866 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:53.139722 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27ec09-012b-4670-bd5a-5015d4990866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:53.139989 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27ec09-012b-4670-bd5a-5015d4990866 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:53.140639 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27ec09-012b-4670-bd5a-5015d4990866 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:52:53.140935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27ec09-012b-4670-bd5a-5015d4990866 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:53.143099 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27ec09-012b-4670-bd5a-5015d4990866 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:53.155616 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1360/2718] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:52:53.160335 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5feb4c-04db-4e40-9833-ee7a9024e2fd None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:53.170817 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5feb4c-04db-4e40-9833-ee7a9024e2fd None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:53.175628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b61045-c0d4-4c50-b35a-8db831599407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:53.176236 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b61045-c0d4-4c50-b35a-8db831599407 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:53.176517 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b61045-c0d4-4c50-b35a-8db831599407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:53.176789 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b61045-c0d4-4c50-b35a-8db831599407 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:53.177414 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b61045-c0d4-4c50-b35a-8db831599407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:53.179359 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b61045-c0d4-4c50-b35a-8db831599407 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:53.272091 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1359/2719] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:52:53 2022] POST /identity/v3/projects => generated 407 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:52:53.276325 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27ec09-012b-4670-bd5a-5015d4990866 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:53.282951 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:53.288367 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27ec09-012b-4670-bd5a-5015d4990866 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:53.353654 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93336b93-d2b8-4dcc-9459-edae6c147702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:53.354292 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93336b93-d2b8-4dcc-9459-edae6c147702 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:53.354572 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93336b93-d2b8-4dcc-9459-edae6c147702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:53.354843 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93336b93-d2b8-4dcc-9459-edae6c147702 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:53.355476 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93336b93-d2b8-4dcc-9459-edae6c147702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:53.358048 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93336b93-d2b8-4dcc-9459-edae6c147702 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:53.503654 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1361/2720] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:52:53 2022] POST /identity/v3/users => generated 304 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:52:53.508068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b61045-c0d4-4c50-b35a-8db831599407 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:53.518785 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b61045-c0d4-4c50-b35a-8db831599407 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:53.523762 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45485d50-2925-4ad4-9bf9-2532ae9023fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:53.524356 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45485d50-2925-4ad4-9bf9-2532ae9023fd admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:53.524634 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45485d50-2925-4ad4-9bf9-2532ae9023fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:53.524908 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45485d50-2925-4ad4-9bf9-2532ae9023fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:53.525580 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45485d50-2925-4ad4-9bf9-2532ae9023fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:53.527200 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45485d50-2925-4ad4-9bf9-2532ae9023fd admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:53.538407 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1360/2721] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:52:53.542476 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93336b93-d2b8-4dcc-9459-edae6c147702 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:53.553303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93336b93-d2b8-4dcc-9459-edae6c147702 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:53.557935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef2b3d-47a1-4719-a4f5-d9e7814410cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:53.558615 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef2b3d-47a1-4719-a4f5-d9e7814410cd admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:53.558854 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef2b3d-47a1-4719-a4f5-d9e7814410cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:53.559068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef2b3d-47a1-4719-a4f5-d9e7814410cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:53.559899 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef2b3d-47a1-4719-a4f5-d9e7814410cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:53.561602 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef2b3d-47a1-4719-a4f5-d9e7814410cd admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:53.571998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1362/2722] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:52:53.577172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45485d50-2925-4ad4-9bf9-2532ae9023fd admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:53.587267 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45485d50-2925-4ad4-9bf9-2532ae9023fd admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:53.592667 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dad9e0-9180-4ee6-90ea-f2bbb6518e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:53.593310 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dad9e0-9180-4ee6-90ea-f2bbb6518e96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:53.593586 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dad9e0-9180-4ee6-90ea-f2bbb6518e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:53.593891 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dad9e0-9180-4ee6-90ea-f2bbb6518e96 admin admin] PATH_INFO: `/v3/projects/3d1674f834054bb6a7cbd1eb61eebe12/users/32272198a7df4a3f94bb774f64ba5e81/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:53.609377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dad9e0-9180-4ee6-90ea-f2bbb6518e96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d1674f834054bb6a7cbd1eb61eebe12, user_id=32272198a7df4a3f94bb774f64ba5e81, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:53.612057 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dad9e0-9180-4ee6-90ea-f2bbb6518e96 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:53.685914 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1361/2723] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:52:53 2022] PUT /identity/v3/projects/3d1674f834054bb6a7cbd1eb61eebe12/users/32272198a7df4a3f94bb774f64ba5e81/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:52:53.695911 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e757de-f9c4-4c99-a744-46f22269b22d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:53.696196 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e757de-f9c4-4c99-a744-46f22269b22d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:53.696468 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e757de-f9c4-4c99-a744-46f22269b22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:53.724822 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e1e757de-f9c4-4c99-a744-46f22269b22d None None] MFA Rules not processed for user `32272198a7df4a3f94bb774f64ba5e81`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:52:53.726067 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e1e757de-f9c4-4c99-a744-46f22269b22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:53.791491 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1363/2724] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:52:53 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:52:53.796729 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dad9e0-9180-4ee6-90ea-f2bbb6518e96 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:53.860832 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dad9e0-9180-4ee6-90ea-f2bbb6518e96 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:53.865534 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a1cdb-9012-4e02-af40-dfe41eaef875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:53.866171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a1cdb-9012-4e02-af40-dfe41eaef875 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:53.866453 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a1cdb-9012-4e02-af40-dfe41eaef875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:53.866725 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a1cdb-9012-4e02-af40-dfe41eaef875 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:53.867345 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a1cdb-9012-4e02-af40-dfe41eaef875 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:53.869239 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a1cdb-9012-4e02-af40-dfe41eaef875 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:53.990680 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1362/2725] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:52:53 2022] POST /identity/v3/projects => generated 407 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:52:53.994727 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e757de-f9c4-4c99-a744-46f22269b22d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:54.006270 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e757de-f9c4-4c99-a744-46f22269b22d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:54.062546 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71324ef9-f598-403f-ab94-9e93774c0e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:54.063083 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71324ef9-f598-403f-ab94-9e93774c0e1c admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:54.063340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71324ef9-f598-403f-ab94-9e93774c0e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:54.063625 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71324ef9-f598-403f-ab94-9e93774c0e1c admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:54.064264 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71324ef9-f598-403f-ab94-9e93774c0e1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:54.066206 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71324ef9-f598-403f-ab94-9e93774c0e1c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:54.189521 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:54.194785 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1364/2726] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:52:53 2022] POST /identity/v3/users => generated 310 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:52:54.198844 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a1cdb-9012-4e02-af40-dfe41eaef875 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:54.210193 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a1cdb-9012-4e02-af40-dfe41eaef875 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:54.214950 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e476c9-7909-45bf-9482-44cc266b6260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:54.215562 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e476c9-7909-45bf-9482-44cc266b6260 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:54.215840 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e476c9-7909-45bf-9482-44cc266b6260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:54.216137 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e476c9-7909-45bf-9482-44cc266b6260 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:54.217170 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e476c9-7909-45bf-9482-44cc266b6260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:54.218992 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e476c9-7909-45bf-9482-44cc266b6260 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:54.230323 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1363/2727] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:52:54.234943 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71324ef9-f598-403f-ab94-9e93774c0e1c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:54.245103 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71324ef9-f598-403f-ab94-9e93774c0e1c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:54.250941 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73973f6a-2182-4347-9c36-1ed7f138fa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:54.251596 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73973f6a-2182-4347-9c36-1ed7f138fa7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:54.251898 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73973f6a-2182-4347-9c36-1ed7f138fa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:54.257879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73973f6a-2182-4347-9c36-1ed7f138fa7d admin admin] PATH_INFO: `/v3/projects/1eb3ac00c01043d5ba80ac8e5037c6ae/users/60c596e53f5b4e81b14810a3baac9576/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:54.268218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73973f6a-2182-4347-9c36-1ed7f138fa7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb3ac00c01043d5ba80ac8e5037c6ae, user_id=60c596e53f5b4e81b14810a3baac9576, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:54.270922 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73973f6a-2182-4347-9c36-1ed7f138fa7d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:54.359942 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1365/2728] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:52:54 2022] PUT /identity/v3/projects/1eb3ac00c01043d5ba80ac8e5037c6ae/users/60c596e53f5b4e81b14810a3baac9576/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:52:54.363496 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e476c9-7909-45bf-9482-44cc266b6260 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:54.374737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e476c9-7909-45bf-9482-44cc266b6260 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:54.430500 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ab890-cc69-40b0-8f58-9236ff464e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:54.431100 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ab890-cc69-40b0-8f58-9236ff464e2a admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:54.431376 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ab890-cc69-40b0-8f58-9236ff464e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:54.431647 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ab890-cc69-40b0-8f58-9236ff464e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:54.432305 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ab890-cc69-40b0-8f58-9236ff464e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:54.433926 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ab890-cc69-40b0-8f58-9236ff464e2a admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:54.444323 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1364/2729] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:52:54.448945 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73973f6a-2182-4347-9c36-1ed7f138fa7d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:54.459990 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73973f6a-2182-4347-9c36-1ed7f138fa7d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:54.464587 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12519bf-5b3f-4dec-9987-2bc7b461a2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:54.465239 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12519bf-5b3f-4dec-9987-2bc7b461a2f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:54.465513 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12519bf-5b3f-4dec-9987-2bc7b461a2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:54.465805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12519bf-5b3f-4dec-9987-2bc7b461a2f8 admin admin] PATH_INFO: `/v3/projects/1eb3ac00c01043d5ba80ac8e5037c6ae/users/60c596e53f5b4e81b14810a3baac9576/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:54.468090 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12519bf-5b3f-4dec-9987-2bc7b461a2f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb3ac00c01043d5ba80ac8e5037c6ae, user_id=60c596e53f5b4e81b14810a3baac9576, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:54.471034 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12519bf-5b3f-4dec-9987-2bc7b461a2f8 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:54.481398 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1366/2730] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:52:54 2022] PUT /identity/v3/projects/1eb3ac00c01043d5ba80ac8e5037c6ae/users/60c596e53f5b4e81b14810a3baac9576/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:52:54.492020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9f21b-a97c-45d5-b941-9b481e199f66 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:54.492326 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9f21b-a97c-45d5-b941-9b481e199f66 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:54.492606 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9f21b-a97c-45d5-b941-9b481e199f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:54.520874 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:54.526871 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-54d9f21b-a97c-45d5-b941-9b481e199f66 None None] MFA Rules not processed for user `60c596e53f5b4e81b14810a3baac9576`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:52:54.526871 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-54d9f21b-a97c-45d5-b941-9b481e199f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:54.597391 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1365/2731] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:52:54 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:52:54.609338 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12519bf-5b3f-4dec-9987-2bc7b461a2f8 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:54.611171 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c12519bf-5b3f-4dec-9987-2bc7b461a2f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:54.668296 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12519bf-5b3f-4dec-9987-2bc7b461a2f8 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:54.672645 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5720d7d-4cb3-4785-8a23-a4085f8ea862 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:54.673239 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5720d7d-4cb3-4785-8a23-a4085f8ea862 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:54.673515 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5720d7d-4cb3-4785-8a23-a4085f8ea862 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:54.673810 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5720d7d-4cb3-4785-8a23-a4085f8ea862 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:54.682995 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5720d7d-4cb3-4785-8a23-a4085f8ea862 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:54.684453 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5720d7d-4cb3-4785-8a23-a4085f8ea862 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:54.694623 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1367/2732] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:52:54 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:52:55.135774 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9f21b-a97c-45d5-b941-9b481e199f66 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:55.146033 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9f21b-a97c-45d5-b941-9b481e199f66 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:55.149553 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa469b-af7f-44d5-b8a6-4e97d151323c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:55.150183 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa469b-af7f-44d5-b8a6-4e97d151323c service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:55.150463 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa469b-af7f-44d5-b8a6-4e97d151323c service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:55.150734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa469b-af7f-44d5-b8a6-4e97d151323c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:55.209076 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa469b-af7f-44d5-b8a6-4e97d151323c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:55.210682 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa469b-af7f-44d5-b8a6-4e97d151323c service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:55.221642 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1366/2733] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:52:55 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:53:04.690378 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=41,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:53:05.215687 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=56 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:53:05.278021 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5720d7d-4cb3-4785-8a23-a4085f8ea862 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:05.342563 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5720d7d-4cb3-4785-8a23-a4085f8ea862 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:05.347664 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f62d1-9e80-44ea-bf0e-c3e7060e79b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:05.348122 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f62d1-9e80-44ea-bf0e-c3e7060e79b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:05.348403 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f62d1-9e80-44ea-bf0e-c3e7060e79b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:05.348674 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f62d1-9e80-44ea-bf0e-c3e7060e79b3 admin admin] PATH_INFO: `/v3/users/32272198a7df4a3f94bb774f64ba5e81` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:05.349890 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f62d1-9e80-44ea-bf0e-c3e7060e79b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32272198a7df4a3f94bb774f64ba5e81)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:05.351813 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f62d1-9e80-44ea-bf0e-c3e7060e79b3 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:05.538846 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-565f62d1-9e80-44ea-bf0e-c3e7060e79b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32272198a7df4a3f94bb774f64ba5e81'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:05.539504 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-565f62d1-9e80-44ea-bf0e-c3e7060e79b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32272198a7df4a3f94bb774f64ba5e81'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:05.540114 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-565f62d1-9e80-44ea-bf0e-c3e7060e79b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32272198a7df4a3f94bb774f64ba5e81'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:05.552151 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-565f62d1-9e80-44ea-bf0e-c3e7060e79b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32272198a7df4a3f94bb774f64ba5e81'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:05.656702 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-565f62d1-9e80-44ea-bf0e-c3e7060e79b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32272198a7df4a3f94bb774f64ba5e81'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:05.676808 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1368/2734] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:53:05 2022] DELETE /identity/v3/users/32272198a7df4a3f94bb774f64ba5e81 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:53:05.681247 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c99bc8-75ee-4acf-8be2-d5fed47b1646 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:05.681547 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c99bc8-75ee-4acf-8be2-d5fed47b1646 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:05.682738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c99bc8-75ee-4acf-8be2-d5fed47b1646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:05.701833 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-19c99bc8-75ee-4acf-8be2-d5fed47b1646 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:53:05.703074 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-19c99bc8-75ee-4acf-8be2-d5fed47b1646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:53:05.764416 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1367/2735] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:53:05.774251 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f62d1-9e80-44ea-bf0e-c3e7060e79b3 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:05.775692 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-565f62d1-9e80-44ea-bf0e-c3e7060e79b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:53:05.832028 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f62d1-9e80-44ea-bf0e-c3e7060e79b3 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:05.835608 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf4d67-9cc9-4918-b2cb-451af617ff7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:05.836197 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf4d67-9cc9-4918-b2cb-451af617ff7e service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:05.836470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf4d67-9cc9-4918-b2cb-451af617ff7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:05.836737 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf4d67-9cc9-4918-b2cb-451af617ff7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:05.845941 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf4d67-9cc9-4918-b2cb-451af617ff7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:05.847398 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf4d67-9cc9-4918-b2cb-451af617ff7e service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:05.856855 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1369/2736] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:53:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:53:06.259910 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c99bc8-75ee-4acf-8be2-d5fed47b1646 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:06.261590 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-19c99bc8-75ee-4acf-8be2-d5fed47b1646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:53:06.275605 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c99bc8-75ee-4acf-8be2-d5fed47b1646 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:06.280485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840477c-8426-4377-a08b-504113c33e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:06.281127 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840477c-8426-4377-a08b-504113c33e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:06.281408 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840477c-8426-4377-a08b-504113c33e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:06.281680 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840477c-8426-4377-a08b-504113c33e7d admin admin] PATH_INFO: `/v3/projects/3d1674f834054bb6a7cbd1eb61eebe12` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:06.282858 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840477c-8426-4377-a08b-504113c33e7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d1674f834054bb6a7cbd1eb61eebe12)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:06.286120 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840477c-8426-4377-a08b-504113c33e7d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:06.412423 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b840477c-8426-4377-a08b-504113c33e7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d1674f834054bb6a7cbd1eb61eebe12', 'request_id': 'req-b840477c-8426-4377-a08b-504113c33e7d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:06.491101 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b840477c-8426-4377-a08b-504113c33e7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d1674f834054bb6a7cbd1eb61eebe12', 'request_id': 'req-b840477c-8426-4377-a08b-504113c33e7d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:06.497961 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b840477c-8426-4377-a08b-504113c33e7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d1674f834054bb6a7cbd1eb61eebe12', 'request_id': 'req-b840477c-8426-4377-a08b-504113c33e7d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:06.508681 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b840477c-8426-4377-a08b-504113c33e7d admin admin] The token cache is being invalidate because project 3d1674f834054bb6a7cbd1eb61eebe12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:53:06.508968 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b840477c-8426-4377-a08b-504113c33e7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:06.509684 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-b840477c-8426-4377-a08b-504113c33e7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:06.511410 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1368/2737] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:53:06 2022] DELETE /identity/v3/projects/3d1674f834054bb6a7cbd1eb61eebe12 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:53:06.515520 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf4d67-9cc9-4918-b2cb-451af617ff7e service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:06.526278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf4d67-9cc9-4918-b2cb-451af617ff7e service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:06.546071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:53:06.584453 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7206d-418a-44ab-bd73-94e05119c0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:06.585075 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7206d-418a-44ab-bd73-94e05119c0a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:06.585379 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7206d-418a-44ab-bd73-94e05119c0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:06.585653 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7206d-418a-44ab-bd73-94e05119c0a8 admin admin] PATH_INFO: `/v3/users/60c596e53f5b4e81b14810a3baac9576` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:06.586840 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7206d-418a-44ab-bd73-94e05119c0a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60c596e53f5b4e81b14810a3baac9576)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:06.588761 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7206d-418a-44ab-bd73-94e05119c0a8 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:06.759839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d3c7206d-418a-44ab-bd73-94e05119c0a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60c596e53f5b4e81b14810a3baac9576'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:06.760445 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d3c7206d-418a-44ab-bd73-94e05119c0a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60c596e53f5b4e81b14810a3baac9576'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:06.761054 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d3c7206d-418a-44ab-bd73-94e05119c0a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60c596e53f5b4e81b14810a3baac9576'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:06.775334 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d3c7206d-418a-44ab-bd73-94e05119c0a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60c596e53f5b4e81b14810a3baac9576'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:06.845901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d3c7206d-418a-44ab-bd73-94e05119c0a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60c596e53f5b4e81b14810a3baac9576'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:06.859328 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1370/2738] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:53:06 2022] DELETE /identity/v3/users/60c596e53f5b4e81b14810a3baac9576 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:53:07.274142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840477c-8426-4377-a08b-504113c33e7d admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:07.274142 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-b840477c-8426-4377-a08b-504113c33e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:53:07.286038 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840477c-8426-4377-a08b-504113c33e7d admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:07.351933 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8f87c-7c7b-4f06-af01-ace8c11ea59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:07.352585 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8f87c-7c7b-4f06-af01-ace8c11ea59d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:07.352864 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8f87c-7c7b-4f06-af01-ace8c11ea59d admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:07.353141 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8f87c-7c7b-4f06-af01-ace8c11ea59d admin admin] PATH_INFO: `/v3/projects/1eb3ac00c01043d5ba80ac8e5037c6ae` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:07.354354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8f87c-7c7b-4f06-af01-ace8c11ea59d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eb3ac00c01043d5ba80ac8e5037c6ae)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:07.356265 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8f87c-7c7b-4f06-af01-ace8c11ea59d admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:07.435892 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:53:07.453659 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-67d8f87c-7c7b-4f06-af01-ace8c11ea59d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eb3ac00c01043d5ba80ac8e5037c6ae', 'request_id': 'req-67d8f87c-7c7b-4f06-af01-ace8c11ea59d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:07.490996 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-67d8f87c-7c7b-4f06-af01-ace8c11ea59d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eb3ac00c01043d5ba80ac8e5037c6ae', 'request_id': 'req-67d8f87c-7c7b-4f06-af01-ace8c11ea59d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:07.498088 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-67d8f87c-7c7b-4f06-af01-ace8c11ea59d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eb3ac00c01043d5ba80ac8e5037c6ae', 'request_id': 'req-67d8f87c-7c7b-4f06-af01-ace8c11ea59d'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:07.509591 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-67d8f87c-7c7b-4f06-af01-ace8c11ea59d admin admin] The token cache is being invalidate because project 1eb3ac00c01043d5ba80ac8e5037c6ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:53:07.514658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-67d8f87c-7c7b-4f06-af01-ace8c11ea59d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:07.514658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-67d8f87c-7c7b-4f06-af01-ace8c11ea59d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:07.514658 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1369/2739] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:53:07 2022] DELETE /identity/v3/projects/1eb3ac00c01043d5ba80ac8e5037c6ae => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:53:07.516972 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1780f-966c-42f7-9931-4644c573b4b4 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:07.517393 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1780f-966c-42f7-9931-4644c573b4b4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:07.517680 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1780f-966c-42f7-9931-4644c573b4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:07.537962 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-7bb1780f-966c-42f7-9931-4644c573b4b4 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:53:07.539191 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7bb1780f-966c-42f7-9931-4644c573b4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:53:07.601897 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1371/2740] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:53:07.611044 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad49b5-0d60-466b-8901-2e49a4005d4d None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:07.611934 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad49b5-0d60-466b-8901-2e49a4005d4d None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:07.612238 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad49b5-0d60-466b-8901-2e49a4005d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:07.632285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-98ad49b5-0d60-466b-8901-2e49a4005d4d None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:53:07.633511 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-98ad49b5-0d60-466b-8901-2e49a4005d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:53:07.641916 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1370/2741] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:53:07.646265 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1780f-966c-42f7-9931-4644c573b4b4 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:07.656747 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1780f-966c-42f7-9931-4644c573b4b4 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:07.662117 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b6321-7333-4813-bf12-e77f19a11937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:07.662744 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b6321-7333-4813-bf12-e77f19a11937 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:07.663027 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b6321-7333-4813-bf12-e77f19a11937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:07.663306 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b6321-7333-4813-bf12-e77f19a11937 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:07.663969 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b6321-7333-4813-bf12-e77f19a11937 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:53:07.664275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b6321-7333-4813-bf12-e77f19a11937 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:07.665915 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b6321-7333-4813-bf12-e77f19a11937 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:07.679193 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1372/2742] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:53:07.683934 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad49b5-0d60-466b-8901-2e49a4005d4d None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:07.693793 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad49b5-0d60-466b-8901-2e49a4005d4d None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:07.698709 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14c156-8a72-4b30-923b-aae861bb8e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:07.699329 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14c156-8a72-4b30-923b-aae861bb8e39 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:07.699611 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14c156-8a72-4b30-923b-aae861bb8e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:07.699891 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14c156-8a72-4b30-923b-aae861bb8e39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:07.700577 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14c156-8a72-4b30-923b-aae861bb8e39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:07.702544 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14c156-8a72-4b30-923b-aae861bb8e39 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:07.784507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1371/2743] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:53:07 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:53:07.790374 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b6321-7333-4813-bf12-e77f19a11937 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:07.802879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b6321-7333-4813-bf12-e77f19a11937 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:07.831485 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:53:07.869990 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096e1a3-3b9e-4609-871a-dadd8d49ffc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:07.870527 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096e1a3-3b9e-4609-871a-dadd8d49ffc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:07.870793 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096e1a3-3b9e-4609-871a-dadd8d49ffc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:07.871059 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096e1a3-3b9e-4609-871a-dadd8d49ffc6 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:07.871700 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096e1a3-3b9e-4609-871a-dadd8d49ffc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:07.873668 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096e1a3-3b9e-4609-871a-dadd8d49ffc6 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:07.988605 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1373/2744] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:53:07 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:53:07.993180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14c156-8a72-4b30-923b-aae861bb8e39 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:08.003922 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14c156-8a72-4b30-923b-aae861bb8e39 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:08.008632 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdae94b-faea-4bdb-abb7-4fa4ce383ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:08.009259 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdae94b-faea-4bdb-abb7-4fa4ce383ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:08.009537 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdae94b-faea-4bdb-abb7-4fa4ce383ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:08.009836 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdae94b-faea-4bdb-abb7-4fa4ce383ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:08.010474 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdae94b-faea-4bdb-abb7-4fa4ce383ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:08.012070 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdae94b-faea-4bdb-abb7-4fa4ce383ae0 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:08.023042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1372/2745] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:53:08.027732 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096e1a3-3b9e-4609-871a-dadd8d49ffc6 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:08.039615 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096e1a3-3b9e-4609-871a-dadd8d49ffc6 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:08.044360 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5da37-8a22-45a5-904f-a68b2194f8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:08.044954 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5da37-8a22-45a5-904f-a68b2194f8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:08.045232 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5da37-8a22-45a5-904f-a68b2194f8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:08.045529 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5da37-8a22-45a5-904f-a68b2194f8e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:08.046198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5da37-8a22-45a5-904f-a68b2194f8e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:08.047765 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5da37-8a22-45a5-904f-a68b2194f8e2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:08.057833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1374/2746] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:53:08.062300 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdae94b-faea-4bdb-abb7-4fa4ce383ae0 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:08.072571 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdae94b-faea-4bdb-abb7-4fa4ce383ae0 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:08.078063 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0406a-ce92-403a-b9cd-dd41946d71eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:08.078722 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0406a-ce92-403a-b9cd-dd41946d71eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:08.078999 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0406a-ce92-403a-b9cd-dd41946d71eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:08.079274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0406a-ce92-403a-b9cd-dd41946d71eb admin admin] PATH_INFO: `/v3/projects/08bb70a5df9545f68dfaeb3daacbe091/users/83bb2ddbeea74b0194798def6afe16cd/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:08.096497 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0406a-ce92-403a-b9cd-dd41946d71eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=08bb70a5df9545f68dfaeb3daacbe091, user_id=83bb2ddbeea74b0194798def6afe16cd, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:08.099122 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0406a-ce92-403a-b9cd-dd41946d71eb admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:08.171955 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1373/2747] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:53:08 2022] PUT /identity/v3/projects/08bb70a5df9545f68dfaeb3daacbe091/users/83bb2ddbeea74b0194798def6afe16cd/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:53:08.185455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a610d-1e9c-43dd-8a8c-0be85b10c66b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:08.185781 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a610d-1e9c-43dd-8a8c-0be85b10c66b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:08.186055 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a610d-1e9c-43dd-8a8c-0be85b10c66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:08.214850 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-820a610d-1e9c-43dd-8a8c-0be85b10c66b None None] MFA Rules not processed for user `83bb2ddbeea74b0194798def6afe16cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:53:08.216078 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-820a610d-1e9c-43dd-8a8c-0be85b10c66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:53:08.284947 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1375/2748] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:53:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:53:08.296465 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0406a-ce92-403a-b9cd-dd41946d71eb admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:08.298364 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-eaa0406a-ce92-403a-b9cd-dd41946d71eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:53:08.358154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0406a-ce92-403a-b9cd-dd41946d71eb admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:08.362320 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd319755-e8c2-45f9-96bd-04045ead685a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:08.362937 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd319755-e8c2-45f9-96bd-04045ead685a service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:08.363221 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd319755-e8c2-45f9-96bd-04045ead685a service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:08.363496 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd319755-e8c2-45f9-96bd-04045ead685a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:08.372925 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd319755-e8c2-45f9-96bd-04045ead685a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:08.374424 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd319755-e8c2-45f9-96bd-04045ead685a service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:08.385137 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1374/2749] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:53:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:53:12.523843 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a610d-1e9c-43dd-8a8c-0be85b10c66b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:12.589372 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a610d-1e9c-43dd-8a8c-0be85b10c66b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:12.594032 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c20953-54f7-4cf3-ad6e-d63b68de2a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:12.595863 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c20953-54f7-4cf3-ad6e-d63b68de2a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:12.595863 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c20953-54f7-4cf3-ad6e-d63b68de2a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:12.595863 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c20953-54f7-4cf3-ad6e-d63b68de2a0a admin admin] PATH_INFO: `/v3/users/83bb2ddbeea74b0194798def6afe16cd` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:12.596914 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c20953-54f7-4cf3-ad6e-d63b68de2a0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=83bb2ddbeea74b0194798def6afe16cd)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:12.598872 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c20953-54f7-4cf3-ad6e-d63b68de2a0a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:12.766622 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:53:12.772591 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-24c20953-54f7-4cf3-ad6e-d63b68de2a0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83bb2ddbeea74b0194798def6afe16cd'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:12.773297 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-24c20953-54f7-4cf3-ad6e-d63b68de2a0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83bb2ddbeea74b0194798def6afe16cd'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:12.773905 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-24c20953-54f7-4cf3-ad6e-d63b68de2a0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83bb2ddbeea74b0194798def6afe16cd'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:12.785971 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-24c20953-54f7-4cf3-ad6e-d63b68de2a0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83bb2ddbeea74b0194798def6afe16cd'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:12.867907 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-24c20953-54f7-4cf3-ad6e-d63b68de2a0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83bb2ddbeea74b0194798def6afe16cd'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:12.881260 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1376/2750] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:53:12 2022] DELETE /identity/v3/users/83bb2ddbeea74b0194798def6afe16cd => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:53:12.886080 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb735d1-ff0c-419b-a966-9d12dc3f3dba None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:12.886485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb735d1-ff0c-419b-a966-9d12dc3f3dba None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:12.886777 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb735d1-ff0c-419b-a966-9d12dc3f3dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:12.906055 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-9bb735d1-ff0c-419b-a966-9d12dc3f3dba None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:53:12.907333 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9bb735d1-ff0c-419b-a966-9d12dc3f3dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:53:12.958347 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:53:12.971551 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1375/2751] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:53:12.981634 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c20953-54f7-4cf3-ad6e-d63b68de2a0a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:12.983944 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-24c20953-54f7-4cf3-ad6e-d63b68de2a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:53:13.044025 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c20953-54f7-4cf3-ad6e-d63b68de2a0a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:13.047724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da4fe3-ddc2-4720-ae78-3050532a510c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:13.049033 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da4fe3-ddc2-4720-ae78-3050532a510c service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:13.049535 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da4fe3-ddc2-4720-ae78-3050532a510c service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:13.050067 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da4fe3-ddc2-4720-ae78-3050532a510c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:13.059849 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da4fe3-ddc2-4720-ae78-3050532a510c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:13.061282 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da4fe3-ddc2-4720-ae78-3050532a510c service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:13.071182 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1377/2752] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:53:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:53:13.504199 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb735d1-ff0c-419b-a966-9d12dc3f3dba None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:13.506564 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9bb735d1-ff0c-419b-a966-9d12dc3f3dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:53:13.519451 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb735d1-ff0c-419b-a966-9d12dc3f3dba None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:13.524309 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205b658-a5cd-4360-ad58-4221d1d9e366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:13.524946 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205b658-a5cd-4360-ad58-4221d1d9e366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:13.525228 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205b658-a5cd-4360-ad58-4221d1d9e366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:13.525501 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205b658-a5cd-4360-ad58-4221d1d9e366 admin admin] PATH_INFO: `/v3/projects/08bb70a5df9545f68dfaeb3daacbe091` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:13.526656 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205b658-a5cd-4360-ad58-4221d1d9e366 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08bb70a5df9545f68dfaeb3daacbe091)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:13.528593 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205b658-a5cd-4360-ad58-4221d1d9e366 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:13.759861 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-1205b658-a5cd-4360-ad58-4221d1d9e366 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08bb70a5df9545f68dfaeb3daacbe091', 'request_id': 'req-1205b658-a5cd-4360-ad58-4221d1d9e366'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:13.826746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-1205b658-a5cd-4360-ad58-4221d1d9e366 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08bb70a5df9545f68dfaeb3daacbe091', 'request_id': 'req-1205b658-a5cd-4360-ad58-4221d1d9e366'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:13.835074 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-1205b658-a5cd-4360-ad58-4221d1d9e366 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08bb70a5df9545f68dfaeb3daacbe091', 'request_id': 'req-1205b658-a5cd-4360-ad58-4221d1d9e366'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:13.846343 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-1205b658-a5cd-4360-ad58-4221d1d9e366 admin admin] The token cache is being invalidate because project 08bb70a5df9545f68dfaeb3daacbe091 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:53:13.846628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-1205b658-a5cd-4360-ad58-4221d1d9e366 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:13.847335 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-1205b658-a5cd-4360-ad58-4221d1d9e366 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:13.848828 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1376/2753] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:53:13 2022] DELETE /identity/v3/projects/08bb70a5df9545f68dfaeb3daacbe091 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:53:13.853655 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3f45d-0d63-4b25-9303-fafb51ce5605 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:13.854192 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3f45d-0d63-4b25-9303-fafb51ce5605 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:13.854297 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3f45d-0d63-4b25-9303-fafb51ce5605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:13.873527 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-47a3f45d-0d63-4b25-9303-fafb51ce5605 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:53:13.874770 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-47a3f45d-0d63-4b25-9303-fafb51ce5605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:53:13.933870 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1378/2754] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:53:13.943294 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab48d9-c285-4fae-9de6-86a8f946cda9 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:13.943824 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab48d9-c285-4fae-9de6-86a8f946cda9 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:13.943824 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab48d9-c285-4fae-9de6-86a8f946cda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:13.962745 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-14ab48d9-c285-4fae-9de6-86a8f946cda9 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:53:13.964005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-14ab48d9-c285-4fae-9de6-86a8f946cda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:53:13.971959 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1377/2755] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:53:13.976153 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3f45d-0d63-4b25-9303-fafb51ce5605 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:13.986736 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3f45d-0d63-4b25-9303-fafb51ce5605 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:13.991519 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ba146-ef3f-4025-b440-79302bc22b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:13.992155 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ba146-ef3f-4025-b440-79302bc22b02 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:13.992435 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ba146-ef3f-4025-b440-79302bc22b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:13.992708 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ba146-ef3f-4025-b440-79302bc22b02 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:13.993358 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ba146-ef3f-4025-b440-79302bc22b02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:53:13.993660 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ba146-ef3f-4025-b440-79302bc22b02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:13.995276 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ba146-ef3f-4025-b440-79302bc22b02 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:14.007554 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1379/2756] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:53:14.012033 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab48d9-c285-4fae-9de6-86a8f946cda9 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:14.021335 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab48d9-c285-4fae-9de6-86a8f946cda9 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:14.025861 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe171b-6ede-46b5-9f54-37d30d1a54b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:14.026444 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe171b-6ede-46b5-9f54-37d30d1a54b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:14.026714 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe171b-6ede-46b5-9f54-37d30d1a54b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:14.026975 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe171b-6ede-46b5-9f54-37d30d1a54b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:14.027592 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe171b-6ede-46b5-9f54-37d30d1a54b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:14.029454 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe171b-6ede-46b5-9f54-37d30d1a54b2 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:14.115930 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1378/2757] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:53:14 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:53:14.120203 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ba146-ef3f-4025-b440-79302bc22b02 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:14.131344 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ba146-ef3f-4025-b440-79302bc22b02 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:14.176289 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:53:14.189616 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fe945-0f18-437c-8bb7-af9f7728f7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:14.190294 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fe945-0f18-437c-8bb7-af9f7728f7d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:14.190576 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fe945-0f18-437c-8bb7-af9f7728f7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:14.190849 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fe945-0f18-437c-8bb7-af9f7728f7d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:14.191477 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fe945-0f18-437c-8bb7-af9f7728f7d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:14.193442 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fe945-0f18-437c-8bb7-af9f7728f7d4 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:14.319965 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1380/2758] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:53:14 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:53:14.324063 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe171b-6ede-46b5-9f54-37d30d1a54b2 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:14.334884 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe171b-6ede-46b5-9f54-37d30d1a54b2 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:14.339492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c1170-03c3-4f56-8cee-1d891595229b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:14.340112 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c1170-03c3-4f56-8cee-1d891595229b admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:14.340413 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c1170-03c3-4f56-8cee-1d891595229b admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:14.340752 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c1170-03c3-4f56-8cee-1d891595229b admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:14.341393 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c1170-03c3-4f56-8cee-1d891595229b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:14.342999 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c1170-03c3-4f56-8cee-1d891595229b admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:14.354705 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1379/2759] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:53:14.358790 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fe945-0f18-437c-8bb7-af9f7728f7d4 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:14.369885 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fe945-0f18-437c-8bb7-af9f7728f7d4 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:14.374528 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b2d4d-ea5c-44c5-860d-5287b4944a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:14.375119 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b2d4d-ea5c-44c5-860d-5287b4944a3e admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:14.375399 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b2d4d-ea5c-44c5-860d-5287b4944a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:14.375672 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b2d4d-ea5c-44c5-860d-5287b4944a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:14.376309 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b2d4d-ea5c-44c5-860d-5287b4944a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:14.378133 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b2d4d-ea5c-44c5-860d-5287b4944a3e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:14.388632 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1381/2760] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:53:14.392879 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c1170-03c3-4f56-8cee-1d891595229b admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:14.403167 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c1170-03c3-4f56-8cee-1d891595229b admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:14.408224 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab21f83-e799-4550-9e12-6283ed7f8d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:14.408958 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab21f83-e799-4550-9e12-6283ed7f8d59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:14.409258 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab21f83-e799-4550-9e12-6283ed7f8d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:14.409529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab21f83-e799-4550-9e12-6283ed7f8d59 admin admin] PATH_INFO: `/v3/projects/061bd67afb1d4db393aee9262649d87d/users/b2c8cdf9942241b49d43dd354c7a0cb0/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:14.424689 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab21f83-e799-4550-9e12-6283ed7f8d59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=061bd67afb1d4db393aee9262649d87d, user_id=b2c8cdf9942241b49d43dd354c7a0cb0, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:14.427395 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab21f83-e799-4550-9e12-6283ed7f8d59 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:14.501888 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1380/2761] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:53:14 2022] PUT /identity/v3/projects/061bd67afb1d4db393aee9262649d87d/users/b2c8cdf9942241b49d43dd354c7a0cb0/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:53:14.512267 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba1a4f-7001-47d9-b8d6-ae2d588b7d3f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:14.512535 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba1a4f-7001-47d9-b8d6-ae2d588b7d3f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:14.512810 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba1a4f-7001-47d9-b8d6-ae2d588b7d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:14.540936 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-3aba1a4f-7001-47d9-b8d6-ae2d588b7d3f None None] MFA Rules not processed for user `b2c8cdf9942241b49d43dd354c7a0cb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:53:14.542209 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3aba1a4f-7001-47d9-b8d6-ae2d588b7d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:53:14.607521 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1382/2762] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:53:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:53:14.620456 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab21f83-e799-4550-9e12-6283ed7f8d59 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:14.622173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4ab21f83-e799-4550-9e12-6283ed7f8d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:53:14.699697 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab21f83-e799-4550-9e12-6283ed7f8d59 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:14.703551 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba05f1-db06-4a32-aaf9-1c6e18e96b91 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78745f9dbf544ab291acfa7a063c1493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:14.704146 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba05f1-db06-4a32-aaf9-1c6e18e96b91 service glance] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:14.704420 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba05f1-db06-4a32-aaf9-1c6e18e96b91 service glance] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:14.705352 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba05f1-db06-4a32-aaf9-1c6e18e96b91 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:14.711878 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:53:14.714193 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba05f1-db06-4a32-aaf9-1c6e18e96b91 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:14.715609 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba05f1-db06-4a32-aaf9-1c6e18e96b91 service glance] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:14.725456 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1381/2763] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:53:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:53:24.604514 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=45,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:53:24.781880 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:53:35.605423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba1a4f-7001-47d9-b8d6-ae2d588b7d3f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:35.606898 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3aba1a4f-7001-47d9-b8d6-ae2d588b7d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:53:35.666854 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba1a4f-7001-47d9-b8d6-ae2d588b7d3f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:35.670545 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a36d6-f327-4908-9953-8a1a456b6232 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:35.671179 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a36d6-f327-4908-9953-8a1a456b6232 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:35.672068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a36d6-f327-4908-9953-8a1a456b6232 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:35.672527 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a36d6-f327-4908-9953-8a1a456b6232 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:35.674467 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-077a36d6-f327-4908-9953-8a1a456b6232 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:53:35.746165 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a36d6-f327-4908-9953-8a1a456b6232 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:35.747597 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a36d6-f327-4908-9953-8a1a456b6232 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:35.759073 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1383/2764] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:53:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:53:45.754006 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=54 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:53:53.328827 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba05f1-db06-4a32-aaf9-1c6e18e96b91 service glance] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:53.338874 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba05f1-db06-4a32-aaf9-1c6e18e96b91 service glance] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:53.343623 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909280f-01d3-4119-bb3f-726113e7a586 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:53.344221 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909280f-01d3-4119-bb3f-726113e7a586 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:53.345388 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909280f-01d3-4119-bb3f-726113e7a586 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:53.348157 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909280f-01d3-4119-bb3f-726113e7a586 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:53.348157 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d909280f-01d3-4119-bb3f-726113e7a586 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:53:53.365190 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909280f-01d3-4119-bb3f-726113e7a586 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:53.366746 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909280f-01d3-4119-bb3f-726113e7a586 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:53.381286 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1382/2765] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:53:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:53:58.211770 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a36d6-f327-4908-9953-8a1a456b6232 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:58.300297 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a36d6-f327-4908-9953-8a1a456b6232 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:58.306240 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385dcf77-06e5-4287-8cde-6bba8b76af0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:58.306902 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385dcf77-06e5-4287-8cde-6bba8b76af0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:58.307208 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385dcf77-06e5-4287-8cde-6bba8b76af0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:58.307544 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385dcf77-06e5-4287-8cde-6bba8b76af0b admin admin] PATH_INFO: `/v3/users/b2c8cdf9942241b49d43dd354c7a0cb0` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:58.309101 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385dcf77-06e5-4287-8cde-6bba8b76af0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2c8cdf9942241b49d43dd354c7a0cb0)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:58.311655 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385dcf77-06e5-4287-8cde-6bba8b76af0b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:58.484599 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-385dcf77-06e5-4287-8cde-6bba8b76af0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2c8cdf9942241b49d43dd354c7a0cb0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:58.485217 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-385dcf77-06e5-4287-8cde-6bba8b76af0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2c8cdf9942241b49d43dd354c7a0cb0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:58.486407 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-385dcf77-06e5-4287-8cde-6bba8b76af0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2c8cdf9942241b49d43dd354c7a0cb0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:58.499295 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-385dcf77-06e5-4287-8cde-6bba8b76af0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2c8cdf9942241b49d43dd354c7a0cb0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:58.568496 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-385dcf77-06e5-4287-8cde-6bba8b76af0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2c8cdf9942241b49d43dd354c7a0cb0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:58.582603 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1384/2766] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:53:58 2022] DELETE /identity/v3/users/b2c8cdf9942241b49d43dd354c7a0cb0 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:53:58.588470 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2833f-13a4-4cdb-b16b-1038e383ed4e None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:58.589197 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2833f-13a4-4cdb-b16b-1038e383ed4e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:58.589412 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2833f-13a4-4cdb-b16b-1038e383ed4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:58.620905 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-e0e2833f-13a4-4cdb-b16b-1038e383ed4e None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:53:58.622227 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e0e2833f-13a4-4cdb-b16b-1038e383ed4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:53:58.693466 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1383/2767] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:53:58.703368 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385dcf77-06e5-4287-8cde-6bba8b76af0b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:58.705508 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-385dcf77-06e5-4287-8cde-6bba8b76af0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:53:58.768591 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385dcf77-06e5-4287-8cde-6bba8b76af0b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:58.772181 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d4167-23f5-41eb-abad-f33c109b4cdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:58.772805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d4167-23f5-41eb-abad-f33c109b4cdf service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:58.773085 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d4167-23f5-41eb-abad-f33c109b4cdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:58.773358 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d4167-23f5-41eb-abad-f33c109b4cdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:58.783641 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d4167-23f5-41eb-abad-f33c109b4cdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:58.785092 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d4167-23f5-41eb-abad-f33c109b4cdf service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:58.795457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1385/2768] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:53:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:53:59.212997 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2833f-13a4-4cdb-b16b-1038e383ed4e None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:59.216856 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e0e2833f-13a4-4cdb-b16b-1038e383ed4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:53:59.226788 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2833f-13a4-4cdb-b16b-1038e383ed4e None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:59.232495 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35296591-c245-4f04-8f0a-5167cceac9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:59.233166 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35296591-c245-4f04-8f0a-5167cceac9ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:59.233537 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35296591-c245-4f04-8f0a-5167cceac9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:59.234777 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35296591-c245-4f04-8f0a-5167cceac9ec admin admin] PATH_INFO: `/v3/projects/061bd67afb1d4db393aee9262649d87d` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:59.237082 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35296591-c245-4f04-8f0a-5167cceac9ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=061bd67afb1d4db393aee9262649d87d)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:59.239237 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35296591-c245-4f04-8f0a-5167cceac9ec admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:59.436095 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-35296591-c245-4f04-8f0a-5167cceac9ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '061bd67afb1d4db393aee9262649d87d', 'request_id': 'req-35296591-c245-4f04-8f0a-5167cceac9ec'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:59.530331 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-35296591-c245-4f04-8f0a-5167cceac9ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '061bd67afb1d4db393aee9262649d87d', 'request_id': 'req-35296591-c245-4f04-8f0a-5167cceac9ec'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:59.539781 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-35296591-c245-4f04-8f0a-5167cceac9ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '061bd67afb1d4db393aee9262649d87d', 'request_id': 'req-35296591-c245-4f04-8f0a-5167cceac9ec'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:59.561536 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-35296591-c245-4f04-8f0a-5167cceac9ec admin admin] The token cache is being invalidate because project 061bd67afb1d4db393aee9262649d87d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:53:59.561856 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-35296591-c245-4f04-8f0a-5167cceac9ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:59.562525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-35296591-c245-4f04-8f0a-5167cceac9ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:53:59.564443 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1384/2769] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:53:59 2022] DELETE /identity/v3/projects/061bd67afb1d4db393aee9262649d87d => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:54:08.791201 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:54:09.553337 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:54:10.061622 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6fadf-7699-4317-87dd-7d8f3070bd67 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:54:10.062279 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6fadf-7699-4317-87dd-7d8f3070bd67 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:54:10.062434 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6fadf-7699-4317-87dd-7d8f3070bd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:54:10.084434 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-70d6fadf-7699-4317-87dd-7d8f3070bd67 None None] MFA Rules not processed for user `f88f7857e1d24bb0b038b7f6e98a6f34`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:54:10.085713 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-70d6fadf-7699-4317-87dd-7d8f3070bd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:54:10.159936 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1386/2770] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:54:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:54:10.486392 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35296591-c245-4f04-8f0a-5167cceac9ec admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:54:10.487885 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-35296591-c245-4f04-8f0a-5167cceac9ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:54:10.547671 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35296591-c245-4f04-8f0a-5167cceac9ec admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:54:10.551523 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1578c3-20bf-4762-8338-e850eca1c509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:54:10.552127 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1578c3-20bf-4762-8338-e850eca1c509 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:54:10.552407 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1578c3-20bf-4762-8338-e850eca1c509 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:54:10.552679 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1578c3-20bf-4762-8338-e850eca1c509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:54:10.554440 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0c1578c3-20bf-4762-8338-e850eca1c509 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:54:10.565395 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1578c3-20bf-4762-8338-e850eca1c509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:54:10.566942 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1578c3-20bf-4762-8338-e850eca1c509 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:54:10.575634 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1385/2771] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:54:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:54:10.972323 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6fadf-7699-4317-87dd-7d8f3070bd67 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:54:10.973840 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-70d6fadf-7699-4317-87dd-7d8f3070bd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:54:11.054654 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6fadf-7699-4317-87dd-7d8f3070bd67 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:54:11.059710 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f612de-aa37-402d-930c-a58b62dc9e4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63253cd786c04d6a9d099773198aee36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:54:11.060314 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f612de-aa37-402d-930c-a58b62dc9e4a service placement] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:54:11.060613 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f612de-aa37-402d-930c-a58b62dc9e4a service placement] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:54:11.060883 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f612de-aa37-402d-930c-a58b62dc9e4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:54:11.062624 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-91f612de-aa37-402d-930c-a58b62dc9e4a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:54:11.075827 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f612de-aa37-402d-930c-a58b62dc9e4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:54:11.077486 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f612de-aa37-402d-930c-a58b62dc9e4a service placement] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:54:11.088852 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1387/2772] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:54:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:54:14.627198 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1578c3-20bf-4762-8338-e850eca1c509 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:54:14.636489 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1578c3-20bf-4762-8338-e850eca1c509 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:54:14.640513 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701c2a4-9fe6-49b9-bd0f-39fec9cdb192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:54:14.641113 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701c2a4-9fe6-49b9-bd0f-39fec9cdb192 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:54:14.641390 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701c2a4-9fe6-49b9-bd0f-39fec9cdb192 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:54:14.641656 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701c2a4-9fe6-49b9-bd0f-39fec9cdb192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:54:14.644097 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-4701c2a4-9fe6-49b9-bd0f-39fec9cdb192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:54:14.655110 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701c2a4-9fe6-49b9-bd0f-39fec9cdb192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:54:14.656579 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701c2a4-9fe6-49b9-bd0f-39fec9cdb192 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:54:14.665217 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1386/2773] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:54:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:54:21.084443 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=57 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:54:24.661395 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=32 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:55:55.248935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f612de-aa37-402d-930c-a58b62dc9e4a service placement] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:55.250390 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-91f612de-aa37-402d-930c-a58b62dc9e4a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:55.346904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f612de-aa37-402d-930c-a58b62dc9e4a service placement] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:55.353546 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64e40e-222d-4c5d-b0d7-bb87c75f6192 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:55.354662 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64e40e-222d-4c5d-b0d7-bb87c75f6192 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:55.355188 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64e40e-222d-4c5d-b0d7-bb87c75f6192 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:55.355785 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64e40e-222d-4c5d-b0d7-bb87c75f6192 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:55.358236 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-de64e40e-222d-4c5d-b0d7-bb87c75f6192 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:55.371437 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64e40e-222d-4c5d-b0d7-bb87c75f6192 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:55.373767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64e40e-222d-4c5d-b0d7-bb87c75f6192 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:55.385149 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1388/2774] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:55:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:01.818960 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701c2a4-9fe6-49b9-bd0f-39fec9cdb192 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:01.828089 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701c2a4-9fe6-49b9-bd0f-39fec9cdb192 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:01.832177 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9ade7-b20c-4c8c-9288-65ba3b1bb2d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:01.832761 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9ade7-b20c-4c8c-9288-65ba3b1bb2d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:01.833036 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9ade7-b20c-4c8c-9288-65ba3b1bb2d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:01.833302 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9ade7-b20c-4c8c-9288-65ba3b1bb2d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:01.835665 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-fca9ade7-b20c-4c8c-9288-65ba3b1bb2d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:01.902550 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca9ade7-b20c-4c8c-9288-65ba3b1bb2d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:01.904011 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca9ade7-b20c-4c8c-9288-65ba3b1bb2d2 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:01.914771 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1387/2775] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:05.380909 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=34 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:05.431391 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64e40e-222d-4c5d-b0d7-bb87c75f6192 service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:05.432816 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-de64e40e-222d-4c5d-b0d7-bb87c75f6192 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:05.450547 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64e40e-222d-4c5d-b0d7-bb87c75f6192 service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:05.456530 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a3a94-294d-411e-bc2d-3b9e70156213 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63253cd786c04d6a9d099773198aee36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:05.457171 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a3a94-294d-411e-bc2d-3b9e70156213 service placement] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:05.457494 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a3a94-294d-411e-bc2d-3b9e70156213 service placement] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:05.457724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a3a94-294d-411e-bc2d-3b9e70156213 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:05.459622 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2b7a3a94-294d-411e-bc2d-3b9e70156213 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:05.474973 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a3a94-294d-411e-bc2d-3b9e70156213 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:05.477123 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a3a94-294d-411e-bc2d-3b9e70156213 service placement] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:05.491547 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1389/2776] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:05.581070 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9ade7-b20c-4c8c-9288-65ba3b1bb2d2 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:05.582706 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-fca9ade7-b20c-4c8c-9288-65ba3b1bb2d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:05.596740 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9ade7-b20c-4c8c-9288-65ba3b1bb2d2 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:05.602158 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b40ef-2c47-4108-84b3-d0ced02e606c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:05.606640 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b40ef-2c47-4108-84b3-d0ced02e606c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:05.607285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b40ef-2c47-4108-84b3-d0ced02e606c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:05.607734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b40ef-2c47-4108-84b3-d0ced02e606c admin admin] PATH_INFO: `/v3/users/f88f7857e1d24bb0b038b7f6e98a6f34` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:05.610499 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b40ef-2c47-4108-84b3-d0ced02e606c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f88f7857e1d24bb0b038b7f6e98a6f34)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:05.612476 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b40ef-2c47-4108-84b3-d0ced02e606c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:05.803468 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-eb8b40ef-2c47-4108-84b3-d0ced02e606c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f88f7857e1d24bb0b038b7f6e98a6f34'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:05.804309 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-eb8b40ef-2c47-4108-84b3-d0ced02e606c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f88f7857e1d24bb0b038b7f6e98a6f34'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:05.816797 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-eb8b40ef-2c47-4108-84b3-d0ced02e606c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f88f7857e1d24bb0b038b7f6e98a6f34'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:05.818866 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-eb8b40ef-2c47-4108-84b3-d0ced02e606c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f88f7857e1d24bb0b038b7f6e98a6f34'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:05.887988 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-eb8b40ef-2c47-4108-84b3-d0ced02e606c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f88f7857e1d24bb0b038b7f6e98a6f34'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:05.902015 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1388/2777] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:56:05 2022] DELETE /identity/v3/users/f88f7857e1d24bb0b038b7f6e98a6f34 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:06.152765 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a3a94-294d-411e-bc2d-3b9e70156213 service placement] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:06.169827 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a3a94-294d-411e-bc2d-3b9e70156213 service placement] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:06.231893 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5474a-d433-4e92-9f6f-db0a86be8799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:06.232523 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5474a-d433-4e92-9f6f-db0a86be8799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:06.232803 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5474a-d433-4e92-9f6f-db0a86be8799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:06.233074 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5474a-d433-4e92-9f6f-db0a86be8799 admin admin] PATH_INFO: `/v3/projects/13d426499b5b40818dca1573cb839b16` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:06.234230 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5474a-d433-4e92-9f6f-db0a86be8799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13d426499b5b40818dca1573cb839b16)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:06.236292 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5474a-d433-4e92-9f6f-db0a86be8799 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:06.351538 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b9f5474a-d433-4e92-9f6f-db0a86be8799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13d426499b5b40818dca1573cb839b16', 'request_id': 'req-b9f5474a-d433-4e92-9f6f-db0a86be8799'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:06.423009 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b9f5474a-d433-4e92-9f6f-db0a86be8799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13d426499b5b40818dca1573cb839b16', 'request_id': 'req-b9f5474a-d433-4e92-9f6f-db0a86be8799'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:06.429952 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b9f5474a-d433-4e92-9f6f-db0a86be8799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13d426499b5b40818dca1573cb839b16', 'request_id': 'req-b9f5474a-d433-4e92-9f6f-db0a86be8799'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:06.441410 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b9f5474a-d433-4e92-9f6f-db0a86be8799 admin admin] The token cache is being invalidate because project 13d426499b5b40818dca1573cb839b16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:06.441698 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b9f5474a-d433-4e92-9f6f-db0a86be8799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:06.442385 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b9f5474a-d433-4e92-9f6f-db0a86be8799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:06.443935 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1390/2778] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:06 2022] DELETE /identity/v3/projects/13d426499b5b40818dca1573cb839b16 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:06.448992 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312e4e0-e9e3-4f41-8bc8-d09960133b9a None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:06.449274 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312e4e0-e9e3-4f41-8bc8-d09960133b9a None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:06.449542 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312e4e0-e9e3-4f41-8bc8-d09960133b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:06.470467 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-f312e4e0-e9e3-4f41-8bc8-d09960133b9a None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:06.471692 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f312e4e0-e9e3-4f41-8bc8-d09960133b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:06.531162 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1389/2779] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:06.539264 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2ec23-3aca-447c-9141-f1f702df2083 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:06.539552 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2ec23-3aca-447c-9141-f1f702df2083 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:06.539826 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2ec23-3aca-447c-9141-f1f702df2083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:06.560624 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a8a2ec23-3aca-447c-9141-f1f702df2083 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:06.561971 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a8a2ec23-3aca-447c-9141-f1f702df2083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:06.570719 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1391/2780] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:56:06.575004 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312e4e0-e9e3-4f41-8bc8-d09960133b9a None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:06.585914 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312e4e0-e9e3-4f41-8bc8-d09960133b9a None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:06.590581 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b28b7-593b-43b4-ac32-277b5557d194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:06.591241 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b28b7-593b-43b4-ac32-277b5557d194 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:06.592333 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b28b7-593b-43b4-ac32-277b5557d194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:06.592630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b28b7-593b-43b4-ac32-277b5557d194 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:06.593278 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b28b7-593b-43b4-ac32-277b5557d194 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:56:06.593604 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b28b7-593b-43b4-ac32-277b5557d194 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:06.595312 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b28b7-593b-43b4-ac32-277b5557d194 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:06.596944 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:06.607587 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1390/2781] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:56:06.612576 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a2ec23-3aca-447c-9141-f1f702df2083 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:06.622010 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a2ec23-3aca-447c-9141-f1f702df2083 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:06.627330 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c005a32-5fa0-4ba6-b9c3-4bfe1f7232fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:06.627943 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c005a32-5fa0-4ba6-b9c3-4bfe1f7232fc admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:06.628222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c005a32-5fa0-4ba6-b9c3-4bfe1f7232fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:06.628623 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c005a32-5fa0-4ba6-b9c3-4bfe1f7232fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:06.629276 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c005a32-5fa0-4ba6-b9c3-4bfe1f7232fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:06.631315 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c005a32-5fa0-4ba6-b9c3-4bfe1f7232fc admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:06.723326 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1392/2782] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:06 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:06.727507 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b28b7-593b-43b4-ac32-277b5557d194 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:06.738496 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b28b7-593b-43b4-ac32-277b5557d194 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:06.799192 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b5e83-0bd4-4440-87b1-70654f47baf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:06.799826 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b5e83-0bd4-4440-87b1-70654f47baf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:06.800493 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b5e83-0bd4-4440-87b1-70654f47baf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:06.800493 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b5e83-0bd4-4440-87b1-70654f47baf5 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:06.801068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b5e83-0bd4-4440-87b1-70654f47baf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:06.803035 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b5e83-0bd4-4440-87b1-70654f47baf5 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:06.931946 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1391/2783] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:06 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:06.937329 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c005a32-5fa0-4ba6-b9c3-4bfe1f7232fc admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:06.948268 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c005a32-5fa0-4ba6-b9c3-4bfe1f7232fc admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:06.954096 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466026b2-374c-47d5-b528-eb040ebe21f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:06.960480 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466026b2-374c-47d5-b528-eb040ebe21f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:06.960480 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466026b2-374c-47d5-b528-eb040ebe21f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:06.960480 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466026b2-374c-47d5-b528-eb040ebe21f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:06.960480 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466026b2-374c-47d5-b528-eb040ebe21f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:06.960480 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466026b2-374c-47d5-b528-eb040ebe21f8 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:06.968503 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1393/2784] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:56:06.972667 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b5e83-0bd4-4440-87b1-70654f47baf5 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:06.994867 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b5e83-0bd4-4440-87b1-70654f47baf5 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:06.995591 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff0a7f-7f17-43a0-a86d-57a5cf42cb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:06.996210 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff0a7f-7f17-43a0-a86d-57a5cf42cb7f admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:06.996492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff0a7f-7f17-43a0-a86d-57a5cf42cb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:06.996792 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff0a7f-7f17-43a0-a86d-57a5cf42cb7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:06.997440 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff0a7f-7f17-43a0-a86d-57a5cf42cb7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:06.999657 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff0a7f-7f17-43a0-a86d-57a5cf42cb7f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:07.011319 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1392/2785] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:56:07.016656 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466026b2-374c-47d5-b528-eb040ebe21f8 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:07.034386 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466026b2-374c-47d5-b528-eb040ebe21f8 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:07.046495 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb803b-7ed8-4c32-ae77-096a0e01f792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:07.047180 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb803b-7ed8-4c32-ae77-096a0e01f792 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:07.047457 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb803b-7ed8-4c32-ae77-096a0e01f792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:07.047828 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb803b-7ed8-4c32-ae77-096a0e01f792 admin admin] PATH_INFO: `/v3/projects/e491b48d306340cc96e8324132829123/users/25346b3935d246219c67ce1dd698b89c/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:07.070804 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb803b-7ed8-4c32-ae77-096a0e01f792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e491b48d306340cc96e8324132829123, user_id=25346b3935d246219c67ce1dd698b89c, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:07.073499 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb803b-7ed8-4c32-ae77-096a0e01f792 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:07.077970 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:07.168985 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1394/2786] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:07 2022] PUT /identity/v3/projects/e491b48d306340cc96e8324132829123/users/25346b3935d246219c67ce1dd698b89c/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:07.182224 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45f485-331b-4a56-9a2b-251e935c3979 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:07.182504 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45f485-331b-4a56-9a2b-251e935c3979 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:07.182841 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45f485-331b-4a56-9a2b-251e935c3979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:07.224609 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-1b45f485-331b-4a56-9a2b-251e935c3979 None None] MFA Rules not processed for user `25346b3935d246219c67ce1dd698b89c`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:07.225913 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-1b45f485-331b-4a56-9a2b-251e935c3979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:07.293967 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1393/2787] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:56:07.299170 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb803b-7ed8-4c32-ae77-096a0e01f792 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:07.362998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb803b-7ed8-4c32-ae77-096a0e01f792 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:07.367814 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcebed6-e334-49b9-b963-17771df93656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:07.368418 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcebed6-e334-49b9-b963-17771df93656 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:07.368697 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcebed6-e334-49b9-b963-17771df93656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:07.368967 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcebed6-e334-49b9-b963-17771df93656 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:07.369603 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcebed6-e334-49b9-b963-17771df93656 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:07.371543 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcebed6-e334-49b9-b963-17771df93656 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:07.460947 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1395/2788] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:07 2022] POST /identity/v3/projects => generated 371 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:07.465289 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45f485-331b-4a56-9a2b-251e935c3979 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:07.477516 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45f485-331b-4a56-9a2b-251e935c3979 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:07.533467 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:07.542421 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed19b92-a80b-428d-9061-1e9313d0aa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:07.546051 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed19b92-a80b-428d-9061-1e9313d0aa4b admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:07.546051 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed19b92-a80b-428d-9061-1e9313d0aa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:07.546051 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed19b92-a80b-428d-9061-1e9313d0aa4b admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:07.546051 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed19b92-a80b-428d-9061-1e9313d0aa4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:07.547117 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed19b92-a80b-428d-9061-1e9313d0aa4b admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:07.657889 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1394/2789] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:07 2022] POST /identity/v3/users => generated 292 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:56:07.661963 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcebed6-e334-49b9-b963-17771df93656 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:07.673004 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcebed6-e334-49b9-b963-17771df93656 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:07.677669 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d4c1a-c7b7-41cf-b236-b002bc660525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:07.678296 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d4c1a-c7b7-41cf-b236-b002bc660525 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:07.678594 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d4c1a-c7b7-41cf-b236-b002bc660525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:07.678867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d4c1a-c7b7-41cf-b236-b002bc660525 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:07.679502 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d4c1a-c7b7-41cf-b236-b002bc660525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:07.681141 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d4c1a-c7b7-41cf-b236-b002bc660525 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:07.692633 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1396/2790] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:07.696989 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed19b92-a80b-428d-9061-1e9313d0aa4b admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:07.707702 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed19b92-a80b-428d-9061-1e9313d0aa4b admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:07.712520 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824e6eb-223b-4368-a518-e86df5634b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:07.713208 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824e6eb-223b-4368-a518-e86df5634b25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:07.713467 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824e6eb-223b-4368-a518-e86df5634b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:07.713847 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824e6eb-223b-4368-a518-e86df5634b25 admin admin] PATH_INFO: `/v3/projects/1810d54465c9467494891738a337cb3d/users/4d495120a1e244eb9a7800b433354142/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:07.731222 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824e6eb-223b-4368-a518-e86df5634b25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1810d54465c9467494891738a337cb3d, user_id=4d495120a1e244eb9a7800b433354142, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:07.734828 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824e6eb-223b-4368-a518-e86df5634b25 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:07.806120 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1395/2791] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:07 2022] PUT /identity/v3/projects/1810d54465c9467494891738a337cb3d/users/4d495120a1e244eb9a7800b433354142/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:07.810674 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d4c1a-c7b7-41cf-b236-b002bc660525 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:07.821222 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d4c1a-c7b7-41cf-b236-b002bc660525 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:07.891888 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb2215-8d3a-4c03-a887-98af0c9c8727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:07.892508 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb2215-8d3a-4c03-a887-98af0c9c8727 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:07.892782 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb2215-8d3a-4c03-a887-98af0c9c8727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:07.893051 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb2215-8d3a-4c03-a887-98af0c9c8727 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:07.893712 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb2215-8d3a-4c03-a887-98af0c9c8727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:07.895327 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb2215-8d3a-4c03-a887-98af0c9c8727 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:07.906477 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1397/2792] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:07.910748 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824e6eb-223b-4368-a518-e86df5634b25 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:07.922111 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824e6eb-223b-4368-a518-e86df5634b25 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:07.926888 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66436470-8388-440e-bb23-6eea5cbc4667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:07.927597 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66436470-8388-440e-bb23-6eea5cbc4667 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:07.927876 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66436470-8388-440e-bb23-6eea5cbc4667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:07.928147 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66436470-8388-440e-bb23-6eea5cbc4667 admin admin] PATH_INFO: `/v3/projects/1810d54465c9467494891738a337cb3d/users/4d495120a1e244eb9a7800b433354142/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:07.930173 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66436470-8388-440e-bb23-6eea5cbc4667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1810d54465c9467494891738a337cb3d, user_id=4d495120a1e244eb9a7800b433354142, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:07.932861 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66436470-8388-440e-bb23-6eea5cbc4667 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:07.943493 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1396/2793] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:07 2022] PUT /identity/v3/projects/1810d54465c9467494891738a337cb3d/users/4d495120a1e244eb9a7800b433354142/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:07.955628 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da05ec-7eb4-44b3-b3a4-a17e7374bfc9 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:07.955914 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da05ec-7eb4-44b3-b3a4-a17e7374bfc9 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:07.956212 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da05ec-7eb4-44b3-b3a4-a17e7374bfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:07.989516 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-05da05ec-7eb4-44b3-b3a4-a17e7374bfc9 None None] MFA Rules not processed for user `4d495120a1e244eb9a7800b433354142`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:07.990830 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-05da05ec-7eb4-44b3-b3a4-a17e7374bfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:08.050294 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:08.070252 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1398/2794] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:08.082757 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66436470-8388-440e-bb23-6eea5cbc4667 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:08.084552 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-66436470-8388-440e-bb23-6eea5cbc4667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:08.168014 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66436470-8388-440e-bb23-6eea5cbc4667 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:08.171933 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df589514-004a-4cf4-9ff3-92ba0e34048e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:08.173118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df589514-004a-4cf4-9ff3-92ba0e34048e service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:08.173118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df589514-004a-4cf4-9ff3-92ba0e34048e service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:08.173118 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df589514-004a-4cf4-9ff3-92ba0e34048e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:08.184422 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df589514-004a-4cf4-9ff3-92ba0e34048e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:08.185946 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df589514-004a-4cf4-9ff3-92ba0e34048e service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:08.196187 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1397/2795] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:09.243382 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da05ec-7eb4-44b3-b3a4-a17e7374bfc9 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:09.307344 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da05ec-7eb4-44b3-b3a4-a17e7374bfc9 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:09.312074 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1d2b9-fd17-492d-9dcc-24bd0d3d2118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:09.312707 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1d2b9-fd17-492d-9dcc-24bd0d3d2118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:09.312988 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1d2b9-fd17-492d-9dcc-24bd0d3d2118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:09.313266 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1d2b9-fd17-492d-9dcc-24bd0d3d2118 admin admin] PATH_INFO: `/v3/users/25346b3935d246219c67ce1dd698b89c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:09.314425 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1d2b9-fd17-492d-9dcc-24bd0d3d2118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25346b3935d246219c67ce1dd698b89c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:09.316407 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1d2b9-fd17-492d-9dcc-24bd0d3d2118 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:09.511199 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e3a1d2b9-fd17-492d-9dcc-24bd0d3d2118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25346b3935d246219c67ce1dd698b89c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:09.511795 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e3a1d2b9-fd17-492d-9dcc-24bd0d3d2118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25346b3935d246219c67ce1dd698b89c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:09.512429 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e3a1d2b9-fd17-492d-9dcc-24bd0d3d2118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25346b3935d246219c67ce1dd698b89c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:09.524708 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e3a1d2b9-fd17-492d-9dcc-24bd0d3d2118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25346b3935d246219c67ce1dd698b89c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:09.605566 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e3a1d2b9-fd17-492d-9dcc-24bd0d3d2118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25346b3935d246219c67ce1dd698b89c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:09.618802 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1399/2796] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:56:09 2022] DELETE /identity/v3/users/25346b3935d246219c67ce1dd698b89c => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:09.623556 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b7dd4-cf21-4421-83df-de78a8adb67e None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:09.624030 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b7dd4-cf21-4421-83df-de78a8adb67e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:09.624148 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b7dd4-cf21-4421-83df-de78a8adb67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:09.645033 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-504b7dd4-cf21-4421-83df-de78a8adb67e None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:09.646298 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-504b7dd4-cf21-4421-83df-de78a8adb67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:09.706780 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1398/2797] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:09.717672 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1d2b9-fd17-492d-9dcc-24bd0d3d2118 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:09.719168 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e3a1d2b9-fd17-492d-9dcc-24bd0d3d2118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:09.776803 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1d2b9-fd17-492d-9dcc-24bd0d3d2118 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:09.781342 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5aa8e-fb25-4c6c-90ad-bcddc57428dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:09.781967 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5aa8e-fb25-4c6c-90ad-bcddc57428dc service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:09.782243 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5aa8e-fb25-4c6c-90ad-bcddc57428dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:09.783125 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5aa8e-fb25-4c6c-90ad-bcddc57428dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:09.792355 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5aa8e-fb25-4c6c-90ad-bcddc57428dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:09.793823 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5aa8e-fb25-4c6c-90ad-bcddc57428dc service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:09.803561 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1400/2798] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:10.253708 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b7dd4-cf21-4421-83df-de78a8adb67e None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:10.253708 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-504b7dd4-cf21-4421-83df-de78a8adb67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:10.266128 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b7dd4-cf21-4421-83df-de78a8adb67e None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:10.270812 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4a965-9936-400d-a38d-b235a7c53b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:10.272933 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4a965-9936-400d-a38d-b235a7c53b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:10.272933 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4a965-9936-400d-a38d-b235a7c53b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:10.272933 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4a965-9936-400d-a38d-b235a7c53b46 admin admin] PATH_INFO: `/v3/projects/e491b48d306340cc96e8324132829123` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:10.273327 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4a965-9936-400d-a38d-b235a7c53b46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e491b48d306340cc96e8324132829123)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:10.275316 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4a965-9936-400d-a38d-b235a7c53b46 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:10.382622 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:10.397690 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c5d4a965-9936-400d-a38d-b235a7c53b46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e491b48d306340cc96e8324132829123', 'request_id': 'req-c5d4a965-9936-400d-a38d-b235a7c53b46'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:10.483133 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c5d4a965-9936-400d-a38d-b235a7c53b46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e491b48d306340cc96e8324132829123', 'request_id': 'req-c5d4a965-9936-400d-a38d-b235a7c53b46'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:10.491932 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c5d4a965-9936-400d-a38d-b235a7c53b46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e491b48d306340cc96e8324132829123', 'request_id': 'req-c5d4a965-9936-400d-a38d-b235a7c53b46'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:10.504307 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c5d4a965-9936-400d-a38d-b235a7c53b46 admin admin] The token cache is being invalidate because project e491b48d306340cc96e8324132829123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:10.504600 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c5d4a965-9936-400d-a38d-b235a7c53b46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:10.505260 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c5d4a965-9936-400d-a38d-b235a7c53b46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:10.506794 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1399/2799] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:10 2022] DELETE /identity/v3/projects/e491b48d306340cc96e8324132829123 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:10.511259 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5aa8e-fb25-4c6c-90ad-bcddc57428dc service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:10.522358 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5aa8e-fb25-4c6c-90ad-bcddc57428dc service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:10.532892 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:10.585561 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da47d3-ad6d-4c63-8ba8-90a074888ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:10.586231 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da47d3-ad6d-4c63-8ba8-90a074888ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:10.586674 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da47d3-ad6d-4c63-8ba8-90a074888ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:10.586969 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da47d3-ad6d-4c63-8ba8-90a074888ec2 admin admin] PATH_INFO: `/v3/users/4d495120a1e244eb9a7800b433354142` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:10.588100 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da47d3-ad6d-4c63-8ba8-90a074888ec2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d495120a1e244eb9a7800b433354142)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:10.590070 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da47d3-ad6d-4c63-8ba8-90a074888ec2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:10.812721 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a1da47d3-ad6d-4c63-8ba8-90a074888ec2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d495120a1e244eb9a7800b433354142'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:10.813391 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a1da47d3-ad6d-4c63-8ba8-90a074888ec2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d495120a1e244eb9a7800b433354142'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:10.814026 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a1da47d3-ad6d-4c63-8ba8-90a074888ec2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d495120a1e244eb9a7800b433354142'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:10.827599 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a1da47d3-ad6d-4c63-8ba8-90a074888ec2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d495120a1e244eb9a7800b433354142'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:10.899386 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a1da47d3-ad6d-4c63-8ba8-90a074888ec2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d495120a1e244eb9a7800b433354142'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:10.912364 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1401/2800] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:56:10 2022] DELETE /identity/v3/users/4d495120a1e244eb9a7800b433354142 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:11.330171 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4a965-9936-400d-a38d-b235a7c53b46 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:11.335575 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c5d4a965-9936-400d-a38d-b235a7c53b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:11.345851 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4a965-9936-400d-a38d-b235a7c53b46 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:11.407168 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8a42e-bc26-4673-9a14-2ebf41bfee98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:11.407848 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8a42e-bc26-4673-9a14-2ebf41bfee98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:11.408128 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8a42e-bc26-4673-9a14-2ebf41bfee98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:11.408399 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8a42e-bc26-4673-9a14-2ebf41bfee98 admin admin] PATH_INFO: `/v3/projects/1810d54465c9467494891738a337cb3d` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:11.409704 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8a42e-bc26-4673-9a14-2ebf41bfee98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1810d54465c9467494891738a337cb3d)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:11.411635 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8a42e-bc26-4673-9a14-2ebf41bfee98 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:11.522986 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a4e8a42e-bc26-4673-9a14-2ebf41bfee98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1810d54465c9467494891738a337cb3d', 'request_id': 'req-a4e8a42e-bc26-4673-9a14-2ebf41bfee98'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:11.608656 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a4e8a42e-bc26-4673-9a14-2ebf41bfee98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1810d54465c9467494891738a337cb3d', 'request_id': 'req-a4e8a42e-bc26-4673-9a14-2ebf41bfee98'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:11.615694 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a4e8a42e-bc26-4673-9a14-2ebf41bfee98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1810d54465c9467494891738a337cb3d', 'request_id': 'req-a4e8a42e-bc26-4673-9a14-2ebf41bfee98'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:11.627112 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a4e8a42e-bc26-4673-9a14-2ebf41bfee98 admin admin] The token cache is being invalidate because project 1810d54465c9467494891738a337cb3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:11.627400 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a4e8a42e-bc26-4673-9a14-2ebf41bfee98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:11.628063 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-a4e8a42e-bc26-4673-9a14-2ebf41bfee98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:11.629538 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1400/2801] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:11 2022] DELETE /identity/v3/projects/1810d54465c9467494891738a337cb3d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:11.634839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb0910-20a4-49ff-9f03-6b790e75b466 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:11.635362 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb0910-20a4-49ff-9f03-6b790e75b466 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:11.635362 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb0910-20a4-49ff-9f03-6b790e75b466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:11.656306 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-0efb0910-20a4-49ff-9f03-6b790e75b466 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:11.657524 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0efb0910-20a4-49ff-9f03-6b790e75b466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:11.719163 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1402/2802] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:11.727175 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038402eb-9e42-4d8a-9fed-55a9cfa38fc7 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:11.727457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038402eb-9e42-4d8a-9fed-55a9cfa38fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:11.727818 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038402eb-9e42-4d8a-9fed-55a9cfa38fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:11.747794 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-038402eb-9e42-4d8a-9fed-55a9cfa38fc7 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:11.749200 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-038402eb-9e42-4d8a-9fed-55a9cfa38fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:11.757069 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1401/2803] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:11.761494 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb0910-20a4-49ff-9f03-6b790e75b466 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:11.772148 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb0910-20a4-49ff-9f03-6b790e75b466 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:11.776802 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cea28-3b1c-405d-9213-30764851e00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:11.777455 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cea28-3b1c-405d-9213-30764851e00c admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:11.777731 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cea28-3b1c-405d-9213-30764851e00c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:11.778034 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cea28-3b1c-405d-9213-30764851e00c admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:11.778785 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318cea28-3b1c-405d-9213-30764851e00c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:56:11.779796 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318cea28-3b1c-405d-9213-30764851e00c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:11.781434 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318cea28-3b1c-405d-9213-30764851e00c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:11.793476 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1403/2804] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:56:11.798282 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038402eb-9e42-4d8a-9fed-55a9cfa38fc7 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:11.807777 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038402eb-9e42-4d8a-9fed-55a9cfa38fc7 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:11.812798 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aece251-ee8e-4dbf-a624-1899c4b65507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:11.813396 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aece251-ee8e-4dbf-a624-1899c4b65507 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:11.813676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aece251-ee8e-4dbf-a624-1899c4b65507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:11.813985 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aece251-ee8e-4dbf-a624-1899c4b65507 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:11.814606 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aece251-ee8e-4dbf-a624-1899c4b65507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:11.816530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aece251-ee8e-4dbf-a624-1899c4b65507 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:11.918078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1402/2805] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:11 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:11.922563 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cea28-3b1c-405d-9213-30764851e00c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:11.932570 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cea28-3b1c-405d-9213-30764851e00c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:11.945218 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:11.990245 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155aa7c6-9285-4ccd-9654-f65286341fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:11.990847 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155aa7c6-9285-4ccd-9654-f65286341fcb admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:11.991121 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155aa7c6-9285-4ccd-9654-f65286341fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:11.991388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155aa7c6-9285-4ccd-9654-f65286341fcb admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:11.992011 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155aa7c6-9285-4ccd-9654-f65286341fcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:11.994081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155aa7c6-9285-4ccd-9654-f65286341fcb admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:12.091685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1404/2806] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:11 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:12.095910 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aece251-ee8e-4dbf-a624-1899c4b65507 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:12.106596 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aece251-ee8e-4dbf-a624-1899c4b65507 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:12.111356 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ce72c-568d-4b59-a189-8b7f8c0bbe54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:12.111977 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ce72c-568d-4b59-a189-8b7f8c0bbe54 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:12.112254 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ce72c-568d-4b59-a189-8b7f8c0bbe54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:12.112525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ce72c-568d-4b59-a189-8b7f8c0bbe54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:12.113163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ce72c-568d-4b59-a189-8b7f8c0bbe54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:12.114846 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ce72c-568d-4b59-a189-8b7f8c0bbe54 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:12.125607 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1403/2807] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:12.129659 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155aa7c6-9285-4ccd-9654-f65286341fcb admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:12.141330 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155aa7c6-9285-4ccd-9654-f65286341fcb admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:12.146114 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af0fc2-cd09-455a-bc5d-039726fa8152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:12.146721 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af0fc2-cd09-455a-bc5d-039726fa8152 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:12.147005 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af0fc2-cd09-455a-bc5d-039726fa8152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:12.147282 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af0fc2-cd09-455a-bc5d-039726fa8152 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:12.147927 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af0fc2-cd09-455a-bc5d-039726fa8152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:12.149591 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af0fc2-cd09-455a-bc5d-039726fa8152 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:12.160628 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1405/2808] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:12.164802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ce72c-568d-4b59-a189-8b7f8c0bbe54 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:12.175019 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ce72c-568d-4b59-a189-8b7f8c0bbe54 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:12.179620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c458f37-2c5f-4f88-a51d-f0aadaed1ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:12.180265 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c458f37-2c5f-4f88-a51d-f0aadaed1ab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:12.180543 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c458f37-2c5f-4f88-a51d-f0aadaed1ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:12.180818 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c458f37-2c5f-4f88-a51d-f0aadaed1ab8 admin admin] PATH_INFO: `/v3/projects/bc30c62b49924dea88b3cf460b29cd50/users/71639d32783c4d179fceb8731d79dc8e/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:12.183039 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:12.196485 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c458f37-2c5f-4f88-a51d-f0aadaed1ab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc30c62b49924dea88b3cf460b29cd50, user_id=71639d32783c4d179fceb8731d79dc8e, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:12.199322 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c458f37-2c5f-4f88-a51d-f0aadaed1ab8 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:12.308517 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1404/2809] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:12 2022] PUT /identity/v3/projects/bc30c62b49924dea88b3cf460b29cd50/users/71639d32783c4d179fceb8731d79dc8e/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:12.319433 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be605d-f42a-4835-a211-3406b4e8b894 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:12.319715 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be605d-f42a-4835-a211-3406b4e8b894 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:12.319989 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be605d-f42a-4835-a211-3406b4e8b894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:12.348965 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-91be605d-f42a-4835-a211-3406b4e8b894 None None] MFA Rules not processed for user `71639d32783c4d179fceb8731d79dc8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:12.350364 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-91be605d-f42a-4835-a211-3406b4e8b894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:12.415284 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1406/2810] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:12.420383 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c458f37-2c5f-4f88-a51d-f0aadaed1ab8 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:12.481005 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c458f37-2c5f-4f88-a51d-f0aadaed1ab8 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:12.486189 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2da638-96aa-4013-a998-6802ae43bb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:12.486806 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2da638-96aa-4013-a998-6802ae43bb79 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:12.487085 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2da638-96aa-4013-a998-6802ae43bb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:12.487355 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2da638-96aa-4013-a998-6802ae43bb79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:12.487974 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2da638-96aa-4013-a998-6802ae43bb79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:12.489912 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2da638-96aa-4013-a998-6802ae43bb79 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:12.616041 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1405/2811] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:12 2022] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:12.620198 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be605d-f42a-4835-a211-3406b4e8b894 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:12.632093 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be605d-f42a-4835-a211-3406b4e8b894 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:12.690180 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21cbcf-8cee-44bd-81d0-ec4025b641aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:12.690904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21cbcf-8cee-44bd-81d0-ec4025b641aa admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:12.691014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21cbcf-8cee-44bd-81d0-ec4025b641aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:12.691221 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21cbcf-8cee-44bd-81d0-ec4025b641aa admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:12.691965 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21cbcf-8cee-44bd-81d0-ec4025b641aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:12.693776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21cbcf-8cee-44bd-81d0-ec4025b641aa admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:12.811735 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1407/2812] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:12 2022] POST /identity/v3/users => generated 299 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:12.815968 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2da638-96aa-4013-a998-6802ae43bb79 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:12.826841 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2da638-96aa-4013-a998-6802ae43bb79 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:12.831692 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e66af2-c06f-4694-acf7-30d1980b0802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:12.832286 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e66af2-c06f-4694-acf7-30d1980b0802 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:12.832561 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e66af2-c06f-4694-acf7-30d1980b0802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:12.832827 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e66af2-c06f-4694-acf7-30d1980b0802 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:12.833457 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e66af2-c06f-4694-acf7-30d1980b0802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:12.835334 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e66af2-c06f-4694-acf7-30d1980b0802 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:12.847013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1406/2813] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:12.854178 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21cbcf-8cee-44bd-81d0-ec4025b641aa admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:12.865427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21cbcf-8cee-44bd-81d0-ec4025b641aa admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:12.870085 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbed942-c18d-4060-9375-64528649dd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:12.870713 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbed942-c18d-4060-9375-64528649dd87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:12.870990 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbed942-c18d-4060-9375-64528649dd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:12.871263 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbed942-c18d-4060-9375-64528649dd87 admin admin] PATH_INFO: `/v3/projects/6d0d1c4e17f44ab1a13eb092df5f19c0/users/b6df8ff99ea046199b5ec71f1d60c5d7/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:12.883907 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:12.886655 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbed942-c18d-4060-9375-64528649dd87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d0d1c4e17f44ab1a13eb092df5f19c0, user_id=b6df8ff99ea046199b5ec71f1d60c5d7, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:12.889639 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbed942-c18d-4060-9375-64528649dd87 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:12.990833 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1408/2814] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:12 2022] PUT /identity/v3/projects/6d0d1c4e17f44ab1a13eb092df5f19c0/users/b6df8ff99ea046199b5ec71f1d60c5d7/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:12.994763 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e66af2-c06f-4694-acf7-30d1980b0802 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:13.005025 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e66af2-c06f-4694-acf7-30d1980b0802 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:13.062691 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d247cb-39f7-4b0b-a80a-e3a6ea71faa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:13.063302 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d247cb-39f7-4b0b-a80a-e3a6ea71faa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:13.063580 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d247cb-39f7-4b0b-a80a-e3a6ea71faa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:13.063850 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d247cb-39f7-4b0b-a80a-e3a6ea71faa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:13.064487 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d247cb-39f7-4b0b-a80a-e3a6ea71faa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:13.066101 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d247cb-39f7-4b0b-a80a-e3a6ea71faa3 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:13.075914 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1407/2815] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:13.080299 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbed942-c18d-4060-9375-64528649dd87 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:13.091719 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbed942-c18d-4060-9375-64528649dd87 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:13.096394 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdcdcfd-f630-4e0f-83e2-3ad78e458fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:13.097044 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcdcfd-f630-4e0f-83e2-3ad78e458fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:13.097323 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcdcfd-f630-4e0f-83e2-3ad78e458fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:13.097597 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcdcfd-f630-4e0f-83e2-3ad78e458fe4 admin admin] PATH_INFO: `/v3/projects/6d0d1c4e17f44ab1a13eb092df5f19c0/users/b6df8ff99ea046199b5ec71f1d60c5d7/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:13.099557 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdcdcfd-f630-4e0f-83e2-3ad78e458fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d0d1c4e17f44ab1a13eb092df5f19c0, user_id=b6df8ff99ea046199b5ec71f1d60c5d7, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:13.102241 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdcdcfd-f630-4e0f-83e2-3ad78e458fe4 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:13.112952 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1409/2816] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:13 2022] PUT /identity/v3/projects/6d0d1c4e17f44ab1a13eb092df5f19c0/users/b6df8ff99ea046199b5ec71f1d60c5d7/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:13.178448 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4b1a6-ab15-47f6-90a5-6e12b4416ae0 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:13.178728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4b1a6-ab15-47f6-90a5-6e12b4416ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:13.178996 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4b1a6-ab15-47f6-90a5-6e12b4416ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:13.207798 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-fbd4b1a6-ab15-47f6-90a5-6e12b4416ae0 None None] MFA Rules not processed for user `b6df8ff99ea046199b5ec71f1d60c5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:13.208996 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-fbd4b1a6-ab15-47f6-90a5-6e12b4416ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:13.252619 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:13.281712 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1408/2817] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:13 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:13.293948 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdcdcfd-f630-4e0f-83e2-3ad78e458fe4 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:13.295653 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1bdcdcfd-f630-4e0f-83e2-3ad78e458fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:13.354353 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdcdcfd-f630-4e0f-83e2-3ad78e458fe4 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:13.358160 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f6778-cf88-421f-9386-1fc888d6cf99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:13.358767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f6778-cf88-421f-9386-1fc888d6cf99 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:13.359044 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f6778-cf88-421f-9386-1fc888d6cf99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:13.359315 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f6778-cf88-421f-9386-1fc888d6cf99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:13.368426 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f6778-cf88-421f-9386-1fc888d6cf99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:13.369901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f6778-cf88-421f-9386-1fc888d6cf99 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:13.379588 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1410/2818] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:13 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:13.409534 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4b1a6-ab15-47f6-90a5-6e12b4416ae0 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:13.472322 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4b1a6-ab15-47f6-90a5-6e12b4416ae0 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:13.477190 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9ad16-04d2-40b6-8544-310046b9bb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:13.477877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9ad16-04d2-40b6-8544-310046b9bb82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:13.478155 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9ad16-04d2-40b6-8544-310046b9bb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:13.478423 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9ad16-04d2-40b6-8544-310046b9bb82 admin admin] PATH_INFO: `/v3/users/71639d32783c4d179fceb8731d79dc8e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:13.479555 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9ad16-04d2-40b6-8544-310046b9bb82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71639d32783c4d179fceb8731d79dc8e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:13.481583 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9ad16-04d2-40b6-8544-310046b9bb82 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:13.673387 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-ecd9ad16-04d2-40b6-8544-310046b9bb82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71639d32783c4d179fceb8731d79dc8e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:13.674078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-ecd9ad16-04d2-40b6-8544-310046b9bb82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71639d32783c4d179fceb8731d79dc8e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:13.686930 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-ecd9ad16-04d2-40b6-8544-310046b9bb82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71639d32783c4d179fceb8731d79dc8e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:13.687647 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-ecd9ad16-04d2-40b6-8544-310046b9bb82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71639d32783c4d179fceb8731d79dc8e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:13.756221 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-ecd9ad16-04d2-40b6-8544-310046b9bb82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71639d32783c4d179fceb8731d79dc8e'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:13.770042 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1409/2819] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:56:13 2022] DELETE /identity/v3/users/71639d32783c4d179fceb8731d79dc8e => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:13.774745 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600709e-078b-4284-a8fd-40edcab7f61a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:13.775229 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600709e-078b-4284-a8fd-40edcab7f61a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:13.775334 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600709e-078b-4284-a8fd-40edcab7f61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:13.794541 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-1600709e-078b-4284-a8fd-40edcab7f61a None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:13.795900 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1600709e-078b-4284-a8fd-40edcab7f61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:13.855525 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1411/2820] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:13.866753 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9ad16-04d2-40b6-8544-310046b9bb82 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:13.868163 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-ecd9ad16-04d2-40b6-8544-310046b9bb82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:13.927766 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9ad16-04d2-40b6-8544-310046b9bb82 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:13.932058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c75974-706a-4e6d-be0a-27045913346d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:13.932677 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c75974-706a-4e6d-be0a-27045913346d service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:13.932953 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c75974-706a-4e6d-be0a-27045913346d service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:13.933222 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c75974-706a-4e6d-be0a-27045913346d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:13.943607 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c75974-706a-4e6d-be0a-27045913346d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:13.945071 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c75974-706a-4e6d-be0a-27045913346d service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:13.950058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:13.955460 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1410/2821] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:14.409493 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600709e-078b-4284-a8fd-40edcab7f61a None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:14.410957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1600709e-078b-4284-a8fd-40edcab7f61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:14.423881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600709e-078b-4284-a8fd-40edcab7f61a None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:14.428711 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e852f-52ab-4d72-8958-6991d4dc59da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:14.429423 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e852f-52ab-4d72-8958-6991d4dc59da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:14.429707 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e852f-52ab-4d72-8958-6991d4dc59da admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:14.430052 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e852f-52ab-4d72-8958-6991d4dc59da admin admin] PATH_INFO: `/v3/projects/bc30c62b49924dea88b3cf460b29cd50` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:14.431191 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e852f-52ab-4d72-8958-6991d4dc59da admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc30c62b49924dea88b3cf460b29cd50)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:14.433128 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e852f-52ab-4d72-8958-6991d4dc59da admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:14.585132 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b99e852f-52ab-4d72-8958-6991d4dc59da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc30c62b49924dea88b3cf460b29cd50', 'request_id': 'req-b99e852f-52ab-4d72-8958-6991d4dc59da'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:14.671339 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b99e852f-52ab-4d72-8958-6991d4dc59da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc30c62b49924dea88b3cf460b29cd50', 'request_id': 'req-b99e852f-52ab-4d72-8958-6991d4dc59da'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:14.678820 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b99e852f-52ab-4d72-8958-6991d4dc59da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc30c62b49924dea88b3cf460b29cd50', 'request_id': 'req-b99e852f-52ab-4d72-8958-6991d4dc59da'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:14.689868 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b99e852f-52ab-4d72-8958-6991d4dc59da admin admin] The token cache is being invalidate because project bc30c62b49924dea88b3cf460b29cd50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:14.690188 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b99e852f-52ab-4d72-8958-6991d4dc59da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:14.690872 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b99e852f-52ab-4d72-8958-6991d4dc59da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:14.692426 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1412/2822] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:14 2022] DELETE /identity/v3/projects/bc30c62b49924dea88b3cf460b29cd50 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:14.696480 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c75974-706a-4e6d-be0a-27045913346d service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:14.707252 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c75974-706a-4e6d-be0a-27045913346d service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:14.770732 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88725e78-d704-4f8a-a12f-05f9997fd070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:14.771358 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88725e78-d704-4f8a-a12f-05f9997fd070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:14.771638 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88725e78-d704-4f8a-a12f-05f9997fd070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:14.772030 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88725e78-d704-4f8a-a12f-05f9997fd070 admin admin] PATH_INFO: `/v3/users/b6df8ff99ea046199b5ec71f1d60c5d7` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:14.773165 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88725e78-d704-4f8a-a12f-05f9997fd070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6df8ff99ea046199b5ec71f1d60c5d7)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:14.775109 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88725e78-d704-4f8a-a12f-05f9997fd070 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:14.986243 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-88725e78-d704-4f8a-a12f-05f9997fd070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6df8ff99ea046199b5ec71f1d60c5d7'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:14.986952 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-88725e78-d704-4f8a-a12f-05f9997fd070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6df8ff99ea046199b5ec71f1d60c5d7'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:15.000104 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-88725e78-d704-4f8a-a12f-05f9997fd070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6df8ff99ea046199b5ec71f1d60c5d7'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:15.000784 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-88725e78-d704-4f8a-a12f-05f9997fd070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6df8ff99ea046199b5ec71f1d60c5d7'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:15.102868 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-88725e78-d704-4f8a-a12f-05f9997fd070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6df8ff99ea046199b5ec71f1d60c5d7'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:15.117219 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1411/2823] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:56:14 2022] DELETE /identity/v3/users/b6df8ff99ea046199b5ec71f1d60c5d7 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:15.570212 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e852f-52ab-4d72-8958-6991d4dc59da admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:15.571672 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b99e852f-52ab-4d72-8958-6991d4dc59da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:15.575594 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:15.628215 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e852f-52ab-4d72-8958-6991d4dc59da admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:15.686558 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17935fab-53fc-42ee-a53b-bcb19dfc1b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:15.687209 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17935fab-53fc-42ee-a53b-bcb19dfc1b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:15.687494 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17935fab-53fc-42ee-a53b-bcb19dfc1b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:15.687770 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17935fab-53fc-42ee-a53b-bcb19dfc1b22 admin admin] PATH_INFO: `/v3/projects/6d0d1c4e17f44ab1a13eb092df5f19c0` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:15.688943 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17935fab-53fc-42ee-a53b-bcb19dfc1b22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d0d1c4e17f44ab1a13eb092df5f19c0)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:15.690923 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17935fab-53fc-42ee-a53b-bcb19dfc1b22 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:15.796097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-17935fab-53fc-42ee-a53b-bcb19dfc1b22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d0d1c4e17f44ab1a13eb092df5f19c0', 'request_id': 'req-17935fab-53fc-42ee-a53b-bcb19dfc1b22'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:15.864931 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-17935fab-53fc-42ee-a53b-bcb19dfc1b22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d0d1c4e17f44ab1a13eb092df5f19c0', 'request_id': 'req-17935fab-53fc-42ee-a53b-bcb19dfc1b22'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:15.872667 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-17935fab-53fc-42ee-a53b-bcb19dfc1b22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d0d1c4e17f44ab1a13eb092df5f19c0', 'request_id': 'req-17935fab-53fc-42ee-a53b-bcb19dfc1b22'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:15.883464 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-17935fab-53fc-42ee-a53b-bcb19dfc1b22 admin admin] The token cache is being invalidate because project 6d0d1c4e17f44ab1a13eb092df5f19c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:15.883686 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-17935fab-53fc-42ee-a53b-bcb19dfc1b22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:15.884388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-17935fab-53fc-42ee-a53b-bcb19dfc1b22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:15.885922 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1413/2824] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:15 2022] DELETE /identity/v3/projects/6d0d1c4e17f44ab1a13eb092df5f19c0 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:15.892134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a210b5-8e06-4fb6-bee2-00df80119ed2 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:15.892134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a210b5-8e06-4fb6-bee2-00df80119ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:15.892134 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a210b5-8e06-4fb6-bee2-00df80119ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:15.911067 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-70a210b5-8e06-4fb6-bee2-00df80119ed2 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:15.912275 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-70a210b5-8e06-4fb6-bee2-00df80119ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:15.971842 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1412/2825] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:56:15.979469 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96445fec-cbab-4dde-80f5-a628a89b227a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:15.979754 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96445fec-cbab-4dde-80f5-a628a89b227a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:15.980032 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96445fec-cbab-4dde-80f5-a628a89b227a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:16.000702 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-96445fec-cbab-4dde-80f5-a628a89b227a None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:16.001960 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-96445fec-cbab-4dde-80f5-a628a89b227a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:16.009912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1414/2826] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:16.014448 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a210b5-8e06-4fb6-bee2-00df80119ed2 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:16.024221 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a210b5-8e06-4fb6-bee2-00df80119ed2 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:16.028841 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19bafa-5ec8-45ff-a2bf-51e067cfca60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:16.029432 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19bafa-5ec8-45ff-a2bf-51e067cfca60 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:16.030313 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19bafa-5ec8-45ff-a2bf-51e067cfca60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:16.030580 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19bafa-5ec8-45ff-a2bf-51e067cfca60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:16.031339 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19bafa-5ec8-45ff-a2bf-51e067cfca60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:56:16.031638 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19bafa-5ec8-45ff-a2bf-51e067cfca60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:16.033228 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19bafa-5ec8-45ff-a2bf-51e067cfca60 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:16.048209 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1413/2827] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:56:16.052501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96445fec-cbab-4dde-80f5-a628a89b227a None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:16.062379 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96445fec-cbab-4dde-80f5-a628a89b227a None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:16.067126 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd683dd-2f1a-4d02-b715-d5d2083b3811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:16.067734 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd683dd-2f1a-4d02-b715-d5d2083b3811 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:16.068014 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd683dd-2f1a-4d02-b715-d5d2083b3811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:16.068290 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd683dd-2f1a-4d02-b715-d5d2083b3811 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:16.068925 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd683dd-2f1a-4d02-b715-d5d2083b3811 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:16.070887 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd683dd-2f1a-4d02-b715-d5d2083b3811 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:16.170648 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1415/2828] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:16 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:16.174878 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19bafa-5ec8-45ff-a2bf-51e067cfca60 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:16.185068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19bafa-5ec8-45ff-a2bf-51e067cfca60 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:16.188949 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:16.243120 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487baf3-b563-4afe-8924-1d8048f08102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:16.243725 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487baf3-b563-4afe-8924-1d8048f08102 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:16.244001 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487baf3-b563-4afe-8924-1d8048f08102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:16.244269 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487baf3-b563-4afe-8924-1d8048f08102 admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:16.244893 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487baf3-b563-4afe-8924-1d8048f08102 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:16.246865 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487baf3-b563-4afe-8924-1d8048f08102 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:16.347373 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1414/2829] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:16 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:16.351364 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd683dd-2f1a-4d02-b715-d5d2083b3811 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:16.362403 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd683dd-2f1a-4d02-b715-d5d2083b3811 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:16.367123 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9effb2-aa7a-4429-89a2-51f05a21afab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:16.367725 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9effb2-aa7a-4429-89a2-51f05a21afab admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:16.368005 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9effb2-aa7a-4429-89a2-51f05a21afab admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:16.368274 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9effb2-aa7a-4429-89a2-51f05a21afab admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:16.368915 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9effb2-aa7a-4429-89a2-51f05a21afab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:16.370570 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9effb2-aa7a-4429-89a2-51f05a21afab admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:16.380948 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1416/2830] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:16.385145 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487baf3-b563-4afe-8924-1d8048f08102 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:16.396282 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487baf3-b563-4afe-8924-1d8048f08102 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:16.400938 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5892e75-9257-4eb0-b39b-c14b200c5c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:16.401527 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5892e75-9257-4eb0-b39b-c14b200c5c47 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:16.401855 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5892e75-9257-4eb0-b39b-c14b200c5c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:16.402117 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5892e75-9257-4eb0-b39b-c14b200c5c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:16.402753 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5892e75-9257-4eb0-b39b-c14b200c5c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:16.404337 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5892e75-9257-4eb0-b39b-c14b200c5c47 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:16.416212 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1415/2831] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:16.420958 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9effb2-aa7a-4429-89a2-51f05a21afab admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:16.431158 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9effb2-aa7a-4429-89a2-51f05a21afab admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:16.435906 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac7eb1-e6d5-47b6-84ef-7b04b99fefc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:16.436600 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac7eb1-e6d5-47b6-84ef-7b04b99fefc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:16.436885 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac7eb1-e6d5-47b6-84ef-7b04b99fefc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:16.437163 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac7eb1-e6d5-47b6-84ef-7b04b99fefc7 admin admin] PATH_INFO: `/v3/projects/f48cb0586442446fa6258e4161494444/users/a3b5ef782bb440a69ecad003a7b39e25/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:16.452578 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac7eb1-e6d5-47b6-84ef-7b04b99fefc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f48cb0586442446fa6258e4161494444, user_id=a3b5ef782bb440a69ecad003a7b39e25, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:16.455278 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac7eb1-e6d5-47b6-84ef-7b04b99fefc7 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:16.526719 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:16.532805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1417/2832] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:16 2022] PUT /identity/v3/projects/f48cb0586442446fa6258e4161494444/users/a3b5ef782bb440a69ecad003a7b39e25/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:16.543246 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d9b26-c31d-49bc-8cb8-d7aa06aca3ff None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:16.543635 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d9b26-c31d-49bc-8cb8-d7aa06aca3ff None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:16.543978 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d9b26-c31d-49bc-8cb8-d7aa06aca3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:16.573023 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-890d9b26-c31d-49bc-8cb8-d7aa06aca3ff None None] MFA Rules not processed for user `a3b5ef782bb440a69ecad003a7b39e25`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:16.574293 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-890d9b26-c31d-49bc-8cb8-d7aa06aca3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:16.640782 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1416/2833] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:16.645377 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac7eb1-e6d5-47b6-84ef-7b04b99fefc7 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:16.707856 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac7eb1-e6d5-47b6-84ef-7b04b99fefc7 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:16.712426 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57d3fb-c2c8-4a00-9d15-d26a003c3718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:16.713021 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57d3fb-c2c8-4a00-9d15-d26a003c3718 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:16.713298 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57d3fb-c2c8-4a00-9d15-d26a003c3718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:16.713569 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57d3fb-c2c8-4a00-9d15-d26a003c3718 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:16.714229 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57d3fb-c2c8-4a00-9d15-d26a003c3718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:16.716400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57d3fb-c2c8-4a00-9d15-d26a003c3718 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:16.816331 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1418/2834] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:16 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:16.820372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d9b26-c31d-49bc-8cb8-d7aa06aca3ff None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:16.832146 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d9b26-c31d-49bc-8cb8-d7aa06aca3ff None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:16.890232 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3db085-f2ea-4fee-a582-4304ccede33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:16.890827 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3db085-f2ea-4fee-a582-4304ccede33f admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:16.891109 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3db085-f2ea-4fee-a582-4304ccede33f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:16.891381 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3db085-f2ea-4fee-a582-4304ccede33f admin admin] PATH_INFO: `/v3/users` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:16.892022 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3db085-f2ea-4fee-a582-4304ccede33f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:16.893987 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3db085-f2ea-4fee-a582-4304ccede33f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:16.974222 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1417/2835] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:16 2022] POST /identity/v3/users => generated 296 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:16.978221 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57d3fb-c2c8-4a00-9d15-d26a003c3718 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:16.990388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57d3fb-c2c8-4a00-9d15-d26a003c3718 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:16.994968 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8c012-cc70-4fd3-941d-5c2b2d3af639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:16.995568 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8c012-cc70-4fd3-941d-5c2b2d3af639 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:16.995849 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8c012-cc70-4fd3-941d-5c2b2d3af639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:16.996118 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8c012-cc70-4fd3-941d-5c2b2d3af639 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:16.996758 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e8c012-cc70-4fd3-941d-5c2b2d3af639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:16.999062 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e8c012-cc70-4fd3-941d-5c2b2d3af639 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:17.010864 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1419/2836] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:17.015250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3db085-f2ea-4fee-a582-4304ccede33f admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:17.021878 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:17.025877 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3db085-f2ea-4fee-a582-4304ccede33f admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:17.030801 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5ca96-907c-4bb9-b8ac-2327821450d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:17.031459 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5ca96-907c-4bb9-b8ac-2327821450d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:17.034887 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5ca96-907c-4bb9-b8ac-2327821450d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:17.034887 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5ca96-907c-4bb9-b8ac-2327821450d8 admin admin] PATH_INFO: `/v3/projects/42122b7ad1014ce0ac44a11d5e7f2f42/users/9052b54a037940b4b0ccb4ab6cf8851a/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:17.047860 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5ca96-907c-4bb9-b8ac-2327821450d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42122b7ad1014ce0ac44a11d5e7f2f42, user_id=9052b54a037940b4b0ccb4ab6cf8851a, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:17.050576 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5ca96-907c-4bb9-b8ac-2327821450d8 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:17.154211 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1418/2837] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:17 2022] PUT /identity/v3/projects/42122b7ad1014ce0ac44a11d5e7f2f42/users/9052b54a037940b4b0ccb4ab6cf8851a/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:17.159318 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8c012-cc70-4fd3-941d-5c2b2d3af639 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:17.169865 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8c012-cc70-4fd3-941d-5c2b2d3af639 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:17.229703 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15695c6-82c8-49db-a7b9-4f18fddfc4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:17.230263 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15695c6-82c8-49db-a7b9-4f18fddfc4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:17.230542 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15695c6-82c8-49db-a7b9-4f18fddfc4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:17.230814 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15695c6-82c8-49db-a7b9-4f18fddfc4f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:17.231459 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15695c6-82c8-49db-a7b9-4f18fddfc4f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:17.234385 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15695c6-82c8-49db-a7b9-4f18fddfc4f2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:17.244430 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1420/2838] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:17.249236 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5ca96-907c-4bb9-b8ac-2327821450d8 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:17.260816 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5ca96-907c-4bb9-b8ac-2327821450d8 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:17.265469 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcef76f-cb9b-433b-b1df-71d7d646554e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:17.266159 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcef76f-cb9b-433b-b1df-71d7d646554e admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:17.266441 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcef76f-cb9b-433b-b1df-71d7d646554e admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:17.266713 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcef76f-cb9b-433b-b1df-71d7d646554e admin admin] PATH_INFO: `/v3/projects/42122b7ad1014ce0ac44a11d5e7f2f42/users/9052b54a037940b4b0ccb4ab6cf8851a/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:17.268666 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcef76f-cb9b-433b-b1df-71d7d646554e admin admin] RBAC: Authorizing `identity:create_grant(project_id=42122b7ad1014ce0ac44a11d5e7f2f42, user_id=9052b54a037940b4b0ccb4ab6cf8851a, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:17.271350 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcef76f-cb9b-433b-b1df-71d7d646554e admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:17.282736 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1419/2839] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:17 2022] PUT /identity/v3/projects/42122b7ad1014ce0ac44a11d5e7f2f42/users/9052b54a037940b4b0ccb4ab6cf8851a/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:17.293724 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d04965-29f2-4fb0-95aa-43164f0fed09 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:17.294045 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d04965-29f2-4fb0-95aa-43164f0fed09 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:17.294320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d04965-29f2-4fb0-95aa-43164f0fed09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:17.322358 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f9d04965-29f2-4fb0-95aa-43164f0fed09 None None] MFA Rules not processed for user `9052b54a037940b4b0ccb4ab6cf8851a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:17.323567 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f9d04965-29f2-4fb0-95aa-43164f0fed09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:17.383305 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:17.394211 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1421/2840] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:17.405291 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcef76f-cb9b-433b-b1df-71d7d646554e admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:17.407284 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-8fcef76f-cb9b-433b-b1df-71d7d646554e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:17.465072 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcef76f-cb9b-433b-b1df-71d7d646554e admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:17.469305 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76815fd-1380-4715-b450-5eef4848fbab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:17.469925 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76815fd-1380-4715-b450-5eef4848fbab service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:17.470200 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76815fd-1380-4715-b450-5eef4848fbab service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:17.470463 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76815fd-1380-4715-b450-5eef4848fbab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:17.480097 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76815fd-1380-4715-b450-5eef4848fbab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:17.481668 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76815fd-1380-4715-b450-5eef4848fbab service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:17.492054 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1420/2841] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:17 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:18.005069 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d04965-29f2-4fb0-95aa-43164f0fed09 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:18.067776 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d04965-29f2-4fb0-95aa-43164f0fed09 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:18.072374 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81750399-fd9d-44d4-9e27-5503255f1ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:18.073297 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81750399-fd9d-44d4-9e27-5503255f1ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:18.073581 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81750399-fd9d-44d4-9e27-5503255f1ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:18.073881 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81750399-fd9d-44d4-9e27-5503255f1ca7 admin admin] PATH_INFO: `/v3/users/a3b5ef782bb440a69ecad003a7b39e25` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:18.075011 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81750399-fd9d-44d4-9e27-5503255f1ca7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3b5ef782bb440a69ecad003a7b39e25)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:18.076975 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81750399-fd9d-44d4-9e27-5503255f1ca7 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:18.273852 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-81750399-fd9d-44d4-9e27-5503255f1ca7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3b5ef782bb440a69ecad003a7b39e25'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:18.274509 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-81750399-fd9d-44d4-9e27-5503255f1ca7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3b5ef782bb440a69ecad003a7b39e25'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:18.275158 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-81750399-fd9d-44d4-9e27-5503255f1ca7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3b5ef782bb440a69ecad003a7b39e25'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:18.287836 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-81750399-fd9d-44d4-9e27-5503255f1ca7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3b5ef782bb440a69ecad003a7b39e25'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:18.391267 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-81750399-fd9d-44d4-9e27-5503255f1ca7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3b5ef782bb440a69ecad003a7b39e25'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:18.404132 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1422/2842] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:56:18 2022] DELETE /identity/v3/users/a3b5ef782bb440a69ecad003a7b39e25 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:18.409351 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016de36-9cbc-4d47-831f-cb6c8a41ec68 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:18.409896 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016de36-9cbc-4d47-831f-cb6c8a41ec68 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:18.410003 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016de36-9cbc-4d47-831f-cb6c8a41ec68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:18.428180 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-f016de36-9cbc-4d47-831f-cb6c8a41ec68 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:18.429381 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f016de36-9cbc-4d47-831f-cb6c8a41ec68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:18.491140 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1421/2843] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:18.501113 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81750399-fd9d-44d4-9e27-5503255f1ca7 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:18.502552 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-81750399-fd9d-44d4-9e27-5503255f1ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:18.569482 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81750399-fd9d-44d4-9e27-5503255f1ca7 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:18.573212 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ab5b1-dacd-4e74-896e-e44c16ea4fc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:18.573847 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ab5b1-dacd-4e74-896e-e44c16ea4fc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:18.574132 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ab5b1-dacd-4e74-896e-e44c16ea4fc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:18.574409 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ab5b1-dacd-4e74-896e-e44c16ea4fc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:18.584708 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ab5b1-dacd-4e74-896e-e44c16ea4fc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:18.586174 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ab5b1-dacd-4e74-896e-e44c16ea4fc0 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:18.597119 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1423/2844] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:19.061388 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016de36-9cbc-4d47-831f-cb6c8a41ec68 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:19.063184 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-f016de36-9cbc-4d47-831f-cb6c8a41ec68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:19.079150 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016de36-9cbc-4d47-831f-cb6c8a41ec68 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:19.083793 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a450d56-2a29-4ab5-859f-3cea912f4065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:19.084423 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a450d56-2a29-4ab5-859f-3cea912f4065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:19.084796 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a450d56-2a29-4ab5-859f-3cea912f4065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:19.084953 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a450d56-2a29-4ab5-859f-3cea912f4065 admin admin] PATH_INFO: `/v3/projects/f48cb0586442446fa6258e4161494444` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:19.086108 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a450d56-2a29-4ab5-859f-3cea912f4065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f48cb0586442446fa6258e4161494444)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:19.088145 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a450d56-2a29-4ab5-859f-3cea912f4065 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:19.197288 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-3a450d56-2a29-4ab5-859f-3cea912f4065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f48cb0586442446fa6258e4161494444', 'request_id': 'req-3a450d56-2a29-4ab5-859f-3cea912f4065'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:19.299424 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-3a450d56-2a29-4ab5-859f-3cea912f4065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f48cb0586442446fa6258e4161494444', 'request_id': 'req-3a450d56-2a29-4ab5-859f-3cea912f4065'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:19.306347 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-3a450d56-2a29-4ab5-859f-3cea912f4065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f48cb0586442446fa6258e4161494444', 'request_id': 'req-3a450d56-2a29-4ab5-859f-3cea912f4065'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:19.310282 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:19.317915 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-3a450d56-2a29-4ab5-859f-3cea912f4065 admin admin] The token cache is being invalidate because project f48cb0586442446fa6258e4161494444 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:19.318204 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-3a450d56-2a29-4ab5-859f-3cea912f4065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:19.318861 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-3a450d56-2a29-4ab5-859f-3cea912f4065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:19.320605 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1422/2845] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:19 2022] DELETE /identity/v3/projects/f48cb0586442446fa6258e4161494444 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:19.324366 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ab5b1-dacd-4e74-896e-e44c16ea4fc0 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:19.334527 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ab5b1-dacd-4e74-896e-e44c16ea4fc0 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:19.338109 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:19.393367 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c43330-0bbd-4a39-809d-786335731c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:19.394035 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c43330-0bbd-4a39-809d-786335731c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:19.394335 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c43330-0bbd-4a39-809d-786335731c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:19.394595 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c43330-0bbd-4a39-809d-786335731c46 admin admin] PATH_INFO: `/v3/users/9052b54a037940b4b0ccb4ab6cf8851a` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:19.395789 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c43330-0bbd-4a39-809d-786335731c46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9052b54a037940b4b0ccb4ab6cf8851a)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:19.397719 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c43330-0bbd-4a39-809d-786335731c46 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:19.659462 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e7c43330-0bbd-4a39-809d-786335731c46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9052b54a037940b4b0ccb4ab6cf8851a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:19.660118 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e7c43330-0bbd-4a39-809d-786335731c46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9052b54a037940b4b0ccb4ab6cf8851a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:19.660729 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e7c43330-0bbd-4a39-809d-786335731c46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9052b54a037940b4b0ccb4ab6cf8851a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:19.673084 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e7c43330-0bbd-4a39-809d-786335731c46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9052b54a037940b4b0ccb4ab6cf8851a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:19.739145 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e7c43330-0bbd-4a39-809d-786335731c46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9052b54a037940b4b0ccb4ab6cf8851a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:19.751947 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1424/2846] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:56:19 2022] DELETE /identity/v3/users/9052b54a037940b4b0ccb4ab6cf8851a => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:20.238092 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a450d56-2a29-4ab5-859f-3cea912f4065 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:20.239668 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-3a450d56-2a29-4ab5-859f-3cea912f4065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:20.254052 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a450d56-2a29-4ab5-859f-3cea912f4065 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:20.317166 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de8814-05b9-4a5e-a2ea-bb4ab9143ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:20.317820 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de8814-05b9-4a5e-a2ea-bb4ab9143ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:20.318100 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de8814-05b9-4a5e-a2ea-bb4ab9143ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:20.318374 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de8814-05b9-4a5e-a2ea-bb4ab9143ad6 admin admin] PATH_INFO: `/v3/projects/42122b7ad1014ce0ac44a11d5e7f2f42` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:20.319486 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de8814-05b9-4a5e-a2ea-bb4ab9143ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42122b7ad1014ce0ac44a11d5e7f2f42)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:20.321383 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de8814-05b9-4a5e-a2ea-bb4ab9143ad6 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:20.469914 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-98de8814-05b9-4a5e-a2ea-bb4ab9143ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42122b7ad1014ce0ac44a11d5e7f2f42', 'request_id': 'req-98de8814-05b9-4a5e-a2ea-bb4ab9143ad6'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:20.582544 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-98de8814-05b9-4a5e-a2ea-bb4ab9143ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42122b7ad1014ce0ac44a11d5e7f2f42', 'request_id': 'req-98de8814-05b9-4a5e-a2ea-bb4ab9143ad6'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:20.589480 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-98de8814-05b9-4a5e-a2ea-bb4ab9143ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42122b7ad1014ce0ac44a11d5e7f2f42', 'request_id': 'req-98de8814-05b9-4a5e-a2ea-bb4ab9143ad6'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:20.600415 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-98de8814-05b9-4a5e-a2ea-bb4ab9143ad6 admin admin] The token cache is being invalidate because project 42122b7ad1014ce0ac44a11d5e7f2f42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:20.600709 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-98de8814-05b9-4a5e-a2ea-bb4ab9143ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:20.601355 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-98de8814-05b9-4a5e-a2ea-bb4ab9143ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:20.602873 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1423/2847] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:20 2022] DELETE /identity/v3/projects/42122b7ad1014ce0ac44a11d5e7f2f42 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:20.607937 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc4ce4-3d2e-4664-8d6e-b2ff438fc5b0 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:20.608442 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc4ce4-3d2e-4664-8d6e-b2ff438fc5b0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:20.608547 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc4ce4-3d2e-4664-8d6e-b2ff438fc5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:20.666092 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d9dc4ce4-3d2e-4664-8d6e-b2ff438fc5b0 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:20.667299 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d9dc4ce4-3d2e-4664-8d6e-b2ff438fc5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:20.720139 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:20.731308 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1425/2848] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:56:20.739913 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b2c94-9708-4f1f-af21-d180efd32022 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:20.740106 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b2c94-9708-4f1f-af21-d180efd32022 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:20.740354 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b2c94-9708-4f1f-af21-d180efd32022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:20.760683 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-2d2b2c94-9708-4f1f-af21-d180efd32022 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:20.761928 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-2d2b2c94-9708-4f1f-af21-d180efd32022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:20.770158 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1424/2849] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:20.774328 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc4ce4-3d2e-4664-8d6e-b2ff438fc5b0 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:20.784992 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc4ce4-3d2e-4664-8d6e-b2ff438fc5b0 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:20.789555 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292bd7a-0bfc-4b84-8884-9a811085bd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:20.790201 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292bd7a-0bfc-4b84-8884-9a811085bd33 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:20.792460 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292bd7a-0bfc-4b84-8884-9a811085bd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:20.792460 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292bd7a-0bfc-4b84-8884-9a811085bd33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:20.792460 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292bd7a-0bfc-4b84-8884-9a811085bd33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:56:20.792460 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292bd7a-0bfc-4b84-8884-9a811085bd33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:20.793263 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292bd7a-0bfc-4b84-8884-9a811085bd33 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:20.805728 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1426/2850] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:56:20.810214 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b2c94-9708-4f1f-af21-d180efd32022 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:20.820439 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b2c94-9708-4f1f-af21-d180efd32022 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:20.825154 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7fb7d-9715-425c-a881-a95ea62c87d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:20.825759 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7fb7d-9715-425c-a881-a95ea62c87d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:20.826054 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7fb7d-9715-425c-a881-a95ea62c87d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:20.826500 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7fb7d-9715-425c-a881-a95ea62c87d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:20.827122 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7fb7d-9715-425c-a881-a95ea62c87d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:20.829109 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7fb7d-9715-425c-a881-a95ea62c87d6 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:20.935409 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1425/2851] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:20 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:20.937200 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292bd7a-0bfc-4b84-8884-9a811085bd33 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:20.947492 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292bd7a-0bfc-4b84-8884-9a811085bd33 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:21.005490 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1add093-0c3c-4d38-bd1f-770e025f8c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:21.006088 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1add093-0c3c-4d38-bd1f-770e025f8c43 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:21.006313 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1add093-0c3c-4d38-bd1f-770e025f8c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:21.006582 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1add093-0c3c-4d38-bd1f-770e025f8c43 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:21.007196 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1add093-0c3c-4d38-bd1f-770e025f8c43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:21.009097 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1add093-0c3c-4d38-bd1f-770e025f8c43 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:21.097823 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1427/2852] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:20 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:56:21.102010 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7fb7d-9715-425c-a881-a95ea62c87d6 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:21.113295 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7fb7d-9715-425c-a881-a95ea62c87d6 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:21.118129 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c89fe-9f96-423f-9d77-eccfbe94ac44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:21.118724 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c89fe-9f96-423f-9d77-eccfbe94ac44 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:21.119004 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c89fe-9f96-423f-9d77-eccfbe94ac44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:21.119289 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c89fe-9f96-423f-9d77-eccfbe94ac44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:21.119920 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c89fe-9f96-423f-9d77-eccfbe94ac44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:21.121529 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c89fe-9f96-423f-9d77-eccfbe94ac44 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:21.131635 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1426/2853] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:21.135685 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1add093-0c3c-4d38-bd1f-770e025f8c43 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:21.146224 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1add093-0c3c-4d38-bd1f-770e025f8c43 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:21.150944 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d55583-67d5-4b70-9f14-43f01a98d5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:21.151529 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d55583-67d5-4b70-9f14-43f01a98d5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:21.151805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d55583-67d5-4b70-9f14-43f01a98d5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:21.152071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d55583-67d5-4b70-9f14-43f01a98d5c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:21.152705 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d55583-67d5-4b70-9f14-43f01a98d5c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:21.154970 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d55583-67d5-4b70-9f14-43f01a98d5c7 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:21.165100 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1428/2854] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:21.169250 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c89fe-9f96-423f-9d77-eccfbe94ac44 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:21.180158 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c89fe-9f96-423f-9d77-eccfbe94ac44 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:21.184843 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9b14b-2f29-413d-b180-e51f2877ed5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:21.185482 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9b14b-2f29-413d-b180-e51f2877ed5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:21.185875 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9b14b-2f29-413d-b180-e51f2877ed5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:21.186374 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9b14b-2f29-413d-b180-e51f2877ed5f admin admin] PATH_INFO: `/v3/projects/467109ff93c041a9bdf0d623e67a8e8d/users/5bb925fda16b4411a47eb65e72d530eb/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:21.200641 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9b14b-2f29-413d-b180-e51f2877ed5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=467109ff93c041a9bdf0d623e67a8e8d, user_id=5bb925fda16b4411a47eb65e72d530eb, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:21.203698 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9b14b-2f29-413d-b180-e51f2877ed5f admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:21.280442 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1427/2855] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:21 2022] PUT /identity/v3/projects/467109ff93c041a9bdf0d623e67a8e8d/users/5bb925fda16b4411a47eb65e72d530eb/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:21.291855 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7209f-d9fa-4f5e-9c67-dcb2df97d5ac None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:21.292168 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7209f-d9fa-4f5e-9c67-dcb2df97d5ac None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:21.292440 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7209f-d9fa-4f5e-9c67-dcb2df97d5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:21.320534 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-1db7209f-d9fa-4f5e-9c67-dcb2df97d5ac None None] MFA Rules not processed for user `5bb925fda16b4411a47eb65e72d530eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:21.321800 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1db7209f-d9fa-4f5e-9c67-dcb2df97d5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:21.385552 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1429/2856] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:21.406753 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9b14b-2f29-413d-b180-e51f2877ed5f admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:21.406753 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-29a9b14b-2f29-413d-b180-e51f2877ed5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:21.422019 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:21.458026 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9b14b-2f29-413d-b180-e51f2877ed5f admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:21.461688 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28920d88-3282-411d-9638-7ea73837e4f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:21.462312 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28920d88-3282-411d-9638-7ea73837e4f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:21.462586 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28920d88-3282-411d-9638-7ea73837e4f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:21.462858 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28920d88-3282-411d-9638-7ea73837e4f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:21.472510 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28920d88-3282-411d-9638-7ea73837e4f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:21.474030 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28920d88-3282-411d-9638-7ea73837e4f5 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:21.483853 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1428/2857] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:21.502974 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7209f-d9fa-4f5e-9c67-dcb2df97d5ac None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:21.554486 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:21.566442 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7209f-d9fa-4f5e-9c67-dcb2df97d5ac None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:21.571068 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b6fdf-d701-4542-9a5f-e1d50e5ad051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:21.571698 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b6fdf-d701-4542-9a5f-e1d50e5ad051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:21.571976 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b6fdf-d701-4542-9a5f-e1d50e5ad051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:21.572249 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b6fdf-d701-4542-9a5f-e1d50e5ad051 admin admin] PATH_INFO: `/v3/users/5bb925fda16b4411a47eb65e72d530eb` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:21.573379 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b6fdf-d701-4542-9a5f-e1d50e5ad051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bb925fda16b4411a47eb65e72d530eb)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:21.575402 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b6fdf-d701-4542-9a5f-e1d50e5ad051 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:21.764407 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-378b6fdf-d701-4542-9a5f-e1d50e5ad051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bb925fda16b4411a47eb65e72d530eb'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:21.765359 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-378b6fdf-d701-4542-9a5f-e1d50e5ad051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bb925fda16b4411a47eb65e72d530eb'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:21.765927 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-378b6fdf-d701-4542-9a5f-e1d50e5ad051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bb925fda16b4411a47eb65e72d530eb'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:21.778765 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-378b6fdf-d701-4542-9a5f-e1d50e5ad051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bb925fda16b4411a47eb65e72d530eb'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:21.851289 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-378b6fdf-d701-4542-9a5f-e1d50e5ad051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bb925fda16b4411a47eb65e72d530eb'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:21.864844 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1430/2858] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:56:21 2022] DELETE /identity/v3/users/5bb925fda16b4411a47eb65e72d530eb => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:56:21.869377 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0570af5-aa57-4ef0-9388-4363b0ffae20 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:21.869664 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0570af5-aa57-4ef0-9388-4363b0ffae20 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:21.869964 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0570af5-aa57-4ef0-9388-4363b0ffae20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:21.888589 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-c0570af5-aa57-4ef0-9388-4363b0ffae20 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:21.889817 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c0570af5-aa57-4ef0-9388-4363b0ffae20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:21.948706 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1429/2859] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:21.958635 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b6fdf-d701-4542-9a5f-e1d50e5ad051 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:21.960033 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-378b6fdf-d701-4542-9a5f-e1d50e5ad051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:22.029214 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b6fdf-d701-4542-9a5f-e1d50e5ad051 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:22.033427 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb04f2-6af2-407c-b8ae-0998f280576e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:22.034071 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb04f2-6af2-407c-b8ae-0998f280576e service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:22.034351 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb04f2-6af2-407c-b8ae-0998f280576e service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:22.034621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb04f2-6af2-407c-b8ae-0998f280576e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:22.043555 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb04f2-6af2-407c-b8ae-0998f280576e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:22.044984 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb04f2-6af2-407c-b8ae-0998f280576e service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:22.055077 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1431/2860] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:22.499293 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0570af5-aa57-4ef0-9388-4363b0ffae20 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:22.500800 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c0570af5-aa57-4ef0-9388-4363b0ffae20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:22.514906 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0570af5-aa57-4ef0-9388-4363b0ffae20 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:22.518371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2d458-24ca-443d-86b0-f83942f42bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:22.518996 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2d458-24ca-443d-86b0-f83942f42bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:22.519270 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2d458-24ca-443d-86b0-f83942f42bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:22.519541 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2d458-24ca-443d-86b0-f83942f42bbb admin admin] PATH_INFO: `/v3/projects/467109ff93c041a9bdf0d623e67a8e8d` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:22.520659 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2d458-24ca-443d-86b0-f83942f42bbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=467109ff93c041a9bdf0d623e67a8e8d)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:22.522595 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2d458-24ca-443d-86b0-f83942f42bbb admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:22.629212 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-38e2d458-24ca-443d-86b0-f83942f42bbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '467109ff93c041a9bdf0d623e67a8e8d', 'request_id': 'req-38e2d458-24ca-443d-86b0-f83942f42bbb'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:22.707853 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-38e2d458-24ca-443d-86b0-f83942f42bbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '467109ff93c041a9bdf0d623e67a8e8d', 'request_id': 'req-38e2d458-24ca-443d-86b0-f83942f42bbb'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:22.714628 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-38e2d458-24ca-443d-86b0-f83942f42bbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '467109ff93c041a9bdf0d623e67a8e8d', 'request_id': 'req-38e2d458-24ca-443d-86b0-f83942f42bbb'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:22.725509 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-38e2d458-24ca-443d-86b0-f83942f42bbb admin admin] The token cache is being invalidate because project 467109ff93c041a9bdf0d623e67a8e8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:22.725839 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-38e2d458-24ca-443d-86b0-f83942f42bbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:22.726824 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-38e2d458-24ca-443d-86b0-f83942f42bbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:22.728365 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1430/2861] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:22 2022] DELETE /identity/v3/projects/467109ff93c041a9bdf0d623e67a8e8d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:22.733497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf149c-db81-4bc3-a124-132a42c0acd3 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:22.733806 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf149c-db81-4bc3-a124-132a42c0acd3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:22.734081 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf149c-db81-4bc3-a124-132a42c0acd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:22.758414 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-09cf149c-db81-4bc3-a124-132a42c0acd3 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:22.758414 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-09cf149c-db81-4bc3-a124-132a42c0acd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:22.815982 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1432/2862] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:22.823682 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bff4b-facb-4372-a932-38a191e53f5e None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:22.823968 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bff4b-facb-4372-a932-38a191e53f5e None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:22.824240 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bff4b-facb-4372-a932-38a191e53f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:22.845140 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-a94bff4b-facb-4372-a932-38a191e53f5e None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:22.846393 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a94bff4b-facb-4372-a932-38a191e53f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:22.854481 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1431/2863] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:22.861389 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf149c-db81-4bc3-a124-132a42c0acd3 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:22.866323 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:22.871587 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf149c-db81-4bc3-a124-132a42c0acd3 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:22.877002 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd9a8b-0c4d-4e54-a225-4bb50969f9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:22.877640 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd9a8b-0c4d-4e54-a225-4bb50969f9fd admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:22.877996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd9a8b-0c4d-4e54-a225-4bb50969f9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:22.878303 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd9a8b-0c4d-4e54-a225-4bb50969f9fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:22.878954 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd9a8b-0c4d-4e54-a225-4bb50969f9fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:56:22.879257 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd9a8b-0c4d-4e54-a225-4bb50969f9fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:22.880902 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd9a8b-0c4d-4e54-a225-4bb50969f9fd admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:22.893394 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1433/2864] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:56:22.898107 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bff4b-facb-4372-a932-38a191e53f5e None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:22.907770 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bff4b-facb-4372-a932-38a191e53f5e None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:22.912622 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da96f7-121e-4ac5-aff0-f0e9f4123371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:22.913215 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da96f7-121e-4ac5-aff0-f0e9f4123371 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:22.913495 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da96f7-121e-4ac5-aff0-f0e9f4123371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:22.913797 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da96f7-121e-4ac5-aff0-f0e9f4123371 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:22.914420 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da96f7-121e-4ac5-aff0-f0e9f4123371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:22.916341 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da96f7-121e-4ac5-aff0-f0e9f4123371 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:23.012710 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1432/2865] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:22 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:23.016828 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd9a8b-0c4d-4e54-a225-4bb50969f9fd admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:23.027195 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd9a8b-0c4d-4e54-a225-4bb50969f9fd admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:23.084271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e9369-1cf0-4a47-a34f-3815e45e7cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:23.084874 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e9369-1cf0-4a47-a34f-3815e45e7cda admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:23.085151 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e9369-1cf0-4a47-a34f-3815e45e7cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:23.085424 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e9369-1cf0-4a47-a34f-3815e45e7cda admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:23.086080 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e9369-1cf0-4a47-a34f-3815e45e7cda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:23.087996 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e9369-1cf0-4a47-a34f-3815e45e7cda admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:23.171343 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1434/2866] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:23 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:56:23.175460 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da96f7-121e-4ac5-aff0-f0e9f4123371 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:23.186350 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da96f7-121e-4ac5-aff0-f0e9f4123371 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:23.191038 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3ef40-a64d-40b8-bf64-f4f3447bb761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:23.191749 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3ef40-a64d-40b8-bf64-f4f3447bb761 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:23.191883 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3ef40-a64d-40b8-bf64-f4f3447bb761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:23.192148 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3ef40-a64d-40b8-bf64-f4f3447bb761 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:23.192806 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3ef40-a64d-40b8-bf64-f4f3447bb761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:23.194424 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3ef40-a64d-40b8-bf64-f4f3447bb761 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:23.204194 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1433/2867] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:23.208291 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e9369-1cf0-4a47-a34f-3815e45e7cda admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:23.218612 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e9369-1cf0-4a47-a34f-3815e45e7cda admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:23.223314 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce439992-145e-4f53-bcaa-e7cf2a01f079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:23.223997 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce439992-145e-4f53-bcaa-e7cf2a01f079 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:23.224269 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce439992-145e-4f53-bcaa-e7cf2a01f079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:23.224540 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce439992-145e-4f53-bcaa-e7cf2a01f079 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:23.225176 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce439992-145e-4f53-bcaa-e7cf2a01f079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:23.226808 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce439992-145e-4f53-bcaa-e7cf2a01f079 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:23.238584 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1435/2868] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:56:23.242809 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3ef40-a64d-40b8-bf64-f4f3447bb761 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:23.253726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3ef40-a64d-40b8-bf64-f4f3447bb761 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:23.258682 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41259ac4-281b-4b03-a990-4fbb35dc1989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:23.259372 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41259ac4-281b-4b03-a990-4fbb35dc1989 admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:23.259651 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41259ac4-281b-4b03-a990-4fbb35dc1989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:23.260029 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41259ac4-281b-4b03-a990-4fbb35dc1989 admin admin] PATH_INFO: `/v3/projects/c875680cbd5d4a03a0ff3200efee6d15/users/929c859c956e4debbab97810009c85b4/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:23.262468 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:23.275695 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41259ac4-281b-4b03-a990-4fbb35dc1989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c875680cbd5d4a03a0ff3200efee6d15, user_id=929c859c956e4debbab97810009c85b4, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:23.278370 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41259ac4-281b-4b03-a990-4fbb35dc1989 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:23.365886 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1434/2869] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:23 2022] PUT /identity/v3/projects/c875680cbd5d4a03a0ff3200efee6d15/users/929c859c956e4debbab97810009c85b4/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:23.376373 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e4f85-437c-4bba-8890-37d2bd980693 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:23.376661 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e4f85-437c-4bba-8890-37d2bd980693 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:23.376932 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e4f85-437c-4bba-8890-37d2bd980693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:23.405340 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-423e4f85-437c-4bba-8890-37d2bd980693 None None] MFA Rules not processed for user `929c859c956e4debbab97810009c85b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:23.406596 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-423e4f85-437c-4bba-8890-37d2bd980693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:23.471980 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1436/2870] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:23.483855 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41259ac4-281b-4b03-a990-4fbb35dc1989 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:23.485515 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-41259ac4-281b-4b03-a990-4fbb35dc1989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:23.542528 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41259ac4-281b-4b03-a990-4fbb35dc1989 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:23.546968 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2725563-2c46-48da-8d12-ae665d880124 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:23.547594 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2725563-2c46-48da-8d12-ae665d880124 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:23.547870 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2725563-2c46-48da-8d12-ae665d880124 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:23.548141 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2725563-2c46-48da-8d12-ae665d880124 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:23.556705 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2725563-2c46-48da-8d12-ae665d880124 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:23.558157 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2725563-2c46-48da-8d12-ae665d880124 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:23.567081 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1435/2871] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:23.588840 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e4f85-437c-4bba-8890-37d2bd980693 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:23.649240 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:23.658848 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e4f85-437c-4bba-8890-37d2bd980693 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:23.664187 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb01a9a-c044-4a65-9022-f2fbc40e3ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:23.664825 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb01a9a-c044-4a65-9022-f2fbc40e3ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:23.665099 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb01a9a-c044-4a65-9022-f2fbc40e3ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:23.665400 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb01a9a-c044-4a65-9022-f2fbc40e3ba1 admin admin] PATH_INFO: `/v3/users/929c859c956e4debbab97810009c85b4` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:23.666592 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb01a9a-c044-4a65-9022-f2fbc40e3ba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=929c859c956e4debbab97810009c85b4)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:23.668526 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb01a9a-c044-4a65-9022-f2fbc40e3ba1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:23.842702 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9eb01a9a-c044-4a65-9022-f2fbc40e3ba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '929c859c956e4debbab97810009c85b4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:23.843908 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9eb01a9a-c044-4a65-9022-f2fbc40e3ba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '929c859c956e4debbab97810009c85b4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:23.844318 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9eb01a9a-c044-4a65-9022-f2fbc40e3ba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '929c859c956e4debbab97810009c85b4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:23.856219 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9eb01a9a-c044-4a65-9022-f2fbc40e3ba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '929c859c956e4debbab97810009c85b4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:23.939191 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9eb01a9a-c044-4a65-9022-f2fbc40e3ba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '929c859c956e4debbab97810009c85b4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:23.952435 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1437/2872] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:56:23 2022] DELETE /identity/v3/users/929c859c956e4debbab97810009c85b4 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:23.956960 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf307ea-c954-4b61-abce-0d8a9d058fde None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:23.957247 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf307ea-c954-4b61-abce-0d8a9d058fde None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:23.957523 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf307ea-c954-4b61-abce-0d8a9d058fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:23.977736 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-aaf307ea-c954-4b61-abce-0d8a9d058fde None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:23.983625 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-aaf307ea-c954-4b61-abce-0d8a9d058fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:24.045418 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1436/2873] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:24.055157 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb01a9a-c044-4a65-9022-f2fbc40e3ba1 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:24.056558 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9eb01a9a-c044-4a65-9022-f2fbc40e3ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:24.113981 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb01a9a-c044-4a65-9022-f2fbc40e3ba1 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:24.117569 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4edacc6-197c-4633-9af2-14ef18ff27ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:24.118197 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edacc6-197c-4633-9af2-14ef18ff27ea service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:24.118557 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edacc6-197c-4633-9af2-14ef18ff27ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:24.118770 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edacc6-197c-4633-9af2-14ef18ff27ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:24.128356 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4edacc6-197c-4633-9af2-14ef18ff27ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:24.129805 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4edacc6-197c-4633-9af2-14ef18ff27ea service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:24.140454 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1438/2874] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:24.572489 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf307ea-c954-4b61-abce-0d8a9d058fde None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:24.574082 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-aaf307ea-c954-4b61-abce-0d8a9d058fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:24.587048 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf307ea-c954-4b61-abce-0d8a9d058fde None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:24.592911 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be1780-9895-4628-82eb-02155bcf02b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:24.594021 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be1780-9895-4628-82eb-02155bcf02b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:24.594021 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be1780-9895-4628-82eb-02155bcf02b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:24.594243 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be1780-9895-4628-82eb-02155bcf02b8 admin admin] PATH_INFO: `/v3/projects/c875680cbd5d4a03a0ff3200efee6d15` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:24.595657 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be1780-9895-4628-82eb-02155bcf02b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c875680cbd5d4a03a0ff3200efee6d15)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:24.597506 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be1780-9895-4628-82eb-02155bcf02b8 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:24.716369 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-08be1780-9895-4628-82eb-02155bcf02b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c875680cbd5d4a03a0ff3200efee6d15', 'request_id': 'req-08be1780-9895-4628-82eb-02155bcf02b8'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:24.824669 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-08be1780-9895-4628-82eb-02155bcf02b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c875680cbd5d4a03a0ff3200efee6d15', 'request_id': 'req-08be1780-9895-4628-82eb-02155bcf02b8'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:24.831726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-08be1780-9895-4628-82eb-02155bcf02b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c875680cbd5d4a03a0ff3200efee6d15', 'request_id': 'req-08be1780-9895-4628-82eb-02155bcf02b8'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:24.843813 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-08be1780-9895-4628-82eb-02155bcf02b8 admin admin] The token cache is being invalidate because project c875680cbd5d4a03a0ff3200efee6d15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:24.844102 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-08be1780-9895-4628-82eb-02155bcf02b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:24.844742 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-08be1780-9895-4628-82eb-02155bcf02b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:24.846280 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1437/2875] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:24 2022] DELETE /identity/v3/projects/c875680cbd5d4a03a0ff3200efee6d15 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:24.851193 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1af019-9f72-48ee-a95b-0c31d058a8a8 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:24.851690 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1af019-9f72-48ee-a95b-0c31d058a8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:24.851812 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1af019-9f72-48ee-a95b-0c31d058a8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:24.872098 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-aa1af019-9f72-48ee-a95b-0c31d058a8a8 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:24.873451 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-aa1af019-9f72-48ee-a95b-0c31d058a8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:24.933889 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1439/2876] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:24.943078 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dec59-ed19-4258-8668-ef8e49ad029c None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:24.943364 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dec59-ed19-4258-8668-ef8e49ad029c None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:24.943641 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dec59-ed19-4258-8668-ef8e49ad029c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:24.963383 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-df4dec59-ed19-4258-8668-ef8e49ad029c None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:24.964611 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-df4dec59-ed19-4258-8668-ef8e49ad029c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:24.973446 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1438/2877] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:24.978411 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1af019-9f72-48ee-a95b-0c31d058a8a8 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:24.989007 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1af019-9f72-48ee-a95b-0c31d058a8a8 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:24.993845 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e65125-b828-4d88-8630-f3bb463ca931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:24.994437 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e65125-b828-4d88-8630-f3bb463ca931 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:24.994722 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e65125-b828-4d88-8630-f3bb463ca931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:24.994998 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e65125-b828-4d88-8630-f3bb463ca931 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:24.995652 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e65125-b828-4d88-8630-f3bb463ca931 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:56:24.995957 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e65125-b828-4d88-8630-f3bb463ca931 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:24.997548 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e65125-b828-4d88-8630-f3bb463ca931 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:25.009549 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1440/2878] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:56:25.014061 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4dec59-ed19-4258-8668-ef8e49ad029c None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:25.018525 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:25.023901 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4dec59-ed19-4258-8668-ef8e49ad029c None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:25.028540 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce648a-ec9e-4643-9ec8-508aa76eb466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:25.030573 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce648a-ec9e-4643-9ec8-508aa76eb466 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:25.030573 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce648a-ec9e-4643-9ec8-508aa76eb466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:25.030573 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce648a-ec9e-4643-9ec8-508aa76eb466 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:25.030888 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce648a-ec9e-4643-9ec8-508aa76eb466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:25.032806 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce648a-ec9e-4643-9ec8-508aa76eb466 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:25.144366 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1439/2879] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:25 2022] POST /identity/v3/projects => generated 399 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:25.148761 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e65125-b828-4d88-8630-f3bb463ca931 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:25.159865 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e65125-b828-4d88-8630-f3bb463ca931 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:25.163465 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:25.215565 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447672b-77dc-4a35-ad88-6bc363d9d7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:25.216420 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447672b-77dc-4a35-ad88-6bc363d9d7f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:25.216701 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447672b-77dc-4a35-ad88-6bc363d9d7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:25.217601 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447672b-77dc-4a35-ad88-6bc363d9d7f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:25.218372 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447672b-77dc-4a35-ad88-6bc363d9d7f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:25.220300 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447672b-77dc-4a35-ad88-6bc363d9d7f9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:25.322726 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1441/2880] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:25 2022] POST /identity/v3/users => generated 300 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:25.327575 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce648a-ec9e-4643-9ec8-508aa76eb466 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:25.338769 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce648a-ec9e-4643-9ec8-508aa76eb466 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:25.344775 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ab4b4-9110-47c9-a807-188d6f968d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:25.345396 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ab4b4-9110-47c9-a807-188d6f968d43 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:25.345677 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ab4b4-9110-47c9-a807-188d6f968d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:25.345986 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ab4b4-9110-47c9-a807-188d6f968d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:25.346750 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ab4b4-9110-47c9-a807-188d6f968d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:25.348278 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ab4b4-9110-47c9-a807-188d6f968d43 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:25.359121 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1440/2881] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:25.363209 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447672b-77dc-4a35-ad88-6bc363d9d7f9 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:25.374133 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447672b-77dc-4a35-ad88-6bc363d9d7f9 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:25.378980 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c0889-55a0-4c20-a3a4-5fc871f057fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:25.379580 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c0889-55a0-4c20-a3a4-5fc871f057fd admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:25.379855 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c0889-55a0-4c20-a3a4-5fc871f057fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:25.380126 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c0889-55a0-4c20-a3a4-5fc871f057fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:25.380762 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c0889-55a0-4c20-a3a4-5fc871f057fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:25.382378 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c0889-55a0-4c20-a3a4-5fc871f057fd admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:25.393889 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1442/2882] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:25.398097 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ab4b4-9110-47c9-a807-188d6f968d43 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:25.409097 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ab4b4-9110-47c9-a807-188d6f968d43 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:25.413767 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489f7d0-0725-4ff6-a9c7-25c1478482bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:25.414439 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489f7d0-0725-4ff6-a9c7-25c1478482bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:25.414717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489f7d0-0725-4ff6-a9c7-25c1478482bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:25.414991 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489f7d0-0725-4ff6-a9c7-25c1478482bc admin admin] PATH_INFO: `/v3/projects/c076699de79d42f49fec64601fcc956d/users/161fde4c854f4cc8b542989f31408468/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:25.429773 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489f7d0-0725-4ff6-a9c7-25c1478482bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c076699de79d42f49fec64601fcc956d, user_id=161fde4c854f4cc8b542989f31408468, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:25.432429 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489f7d0-0725-4ff6-a9c7-25c1478482bc admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:25.546483 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1441/2883] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:25 2022] PUT /identity/v3/projects/c076699de79d42f49fec64601fcc956d/users/161fde4c854f4cc8b542989f31408468/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:25.557181 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4053bf-857c-4fa2-9cda-93e29c793bfb None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:25.557496 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4053bf-857c-4fa2-9cda-93e29c793bfb None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:25.557796 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4053bf-857c-4fa2-9cda-93e29c793bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:25.587051 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-1d4053bf-857c-4fa2-9cda-93e29c793bfb None None] MFA Rules not processed for user `161fde4c854f4cc8b542989f31408468`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:25.591251 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1d4053bf-857c-4fa2-9cda-93e29c793bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:25.653192 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1443/2884] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:25 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:25.664798 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489f7d0-0725-4ff6-a9c7-25c1478482bc admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:25.666649 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e489f7d0-0725-4ff6-a9c7-25c1478482bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:25.723831 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489f7d0-0725-4ff6-a9c7-25c1478482bc admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:25.727577 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b0bb4-0e8b-4252-8a77-fc33e797c097 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd03ddcf4bcc24f86be508345ad63ab5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:25.728179 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b0bb4-0e8b-4252-8a77-fc33e797c097 service cinder] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:25.728459 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b0bb4-0e8b-4252-8a77-fc33e797c097 service cinder] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:25.728733 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b0bb4-0e8b-4252-8a77-fc33e797c097 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:25.737245 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b0bb4-0e8b-4252-8a77-fc33e797c097 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:25.738693 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b0bb4-0e8b-4252-8a77-fc33e797c097 service cinder] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:25.747615 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1442/2885] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:25 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:35.650634 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=63,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:35.743568 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=49,keystone:INSERT=2 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:36.903338 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4053bf-857c-4fa2-9cda-93e29c793bfb None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:36.967811 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4053bf-857c-4fa2-9cda-93e29c793bfb None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:36.972955 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029b012-e69f-4732-8957-ee60a3137e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:36.973633 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029b012-e69f-4732-8957-ee60a3137e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:36.973936 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029b012-e69f-4732-8957-ee60a3137e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:36.974206 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029b012-e69f-4732-8957-ee60a3137e94 admin admin] PATH_INFO: `/v3/users/161fde4c854f4cc8b542989f31408468` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:36.975387 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029b012-e69f-4732-8957-ee60a3137e94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=161fde4c854f4cc8b542989f31408468)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:36.977327 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029b012-e69f-4732-8957-ee60a3137e94 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:37.147470 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6029b012-e69f-4732-8957-ee60a3137e94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '161fde4c854f4cc8b542989f31408468'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:37.148154 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6029b012-e69f-4732-8957-ee60a3137e94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '161fde4c854f4cc8b542989f31408468'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:37.148835 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6029b012-e69f-4732-8957-ee60a3137e94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '161fde4c854f4cc8b542989f31408468'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:37.161362 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6029b012-e69f-4732-8957-ee60a3137e94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '161fde4c854f4cc8b542989f31408468'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:37.242308 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6029b012-e69f-4732-8957-ee60a3137e94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '161fde4c854f4cc8b542989f31408468'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:37.255648 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1444/2886] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 14:56:36 2022] DELETE /identity/v3/users/161fde4c854f4cc8b542989f31408468 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:37.260363 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5372cb4-f4bc-4ac9-8466-5ffd0dd35717 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:37.260891 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5372cb4-f4bc-4ac9-8466-5ffd0dd35717 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:37.261058 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5372cb4-f4bc-4ac9-8466-5ffd0dd35717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:37.283854 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-d5372cb4-f4bc-4ac9-8466-5ffd0dd35717 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:37.285093 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d5372cb4-f4bc-4ac9-8466-5ffd0dd35717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:37.348539 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1443/2887] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:56:37.358478 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029b012-e69f-4732-8957-ee60a3137e94 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:37.359999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6029b012-e69f-4732-8957-ee60a3137e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:37.420693 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029b012-e69f-4732-8957-ee60a3137e94 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:37.424334 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375cbd3-079f-49a4-bd31-40cf25030e92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:37.424941 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375cbd3-079f-49a4-bd31-40cf25030e92 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:37.425221 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375cbd3-079f-49a4-bd31-40cf25030e92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:37.425496 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375cbd3-079f-49a4-bd31-40cf25030e92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:37.434841 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375cbd3-079f-49a4-bd31-40cf25030e92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:37.436275 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375cbd3-079f-49a4-bd31-40cf25030e92 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:37.446075 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1445/2888] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:37.946397 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5372cb4-f4bc-4ac9-8466-5ffd0dd35717 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:37.947863 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d5372cb4-f4bc-4ac9-8466-5ffd0dd35717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:37.970285 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5372cb4-f4bc-4ac9-8466-5ffd0dd35717 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:37.975759 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99cfa5-73f1-4144-9d3d-70e05c6e146c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:37.976427 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99cfa5-73f1-4144-9d3d-70e05c6e146c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:37.976702 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99cfa5-73f1-4144-9d3d-70e05c6e146c admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:37.976976 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99cfa5-73f1-4144-9d3d-70e05c6e146c admin admin] PATH_INFO: `/v3/projects/c076699de79d42f49fec64601fcc956d` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:37.978672 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99cfa5-73f1-4144-9d3d-70e05c6e146c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c076699de79d42f49fec64601fcc956d)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:37.980719 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99cfa5-73f1-4144-9d3d-70e05c6e146c admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:38.117435 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-aa99cfa5-73f1-4144-9d3d-70e05c6e146c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c076699de79d42f49fec64601fcc956d', 'request_id': 'req-aa99cfa5-73f1-4144-9d3d-70e05c6e146c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:38.205164 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-aa99cfa5-73f1-4144-9d3d-70e05c6e146c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c076699de79d42f49fec64601fcc956d', 'request_id': 'req-aa99cfa5-73f1-4144-9d3d-70e05c6e146c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:38.211859 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-aa99cfa5-73f1-4144-9d3d-70e05c6e146c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c076699de79d42f49fec64601fcc956d', 'request_id': 'req-aa99cfa5-73f1-4144-9d3d-70e05c6e146c'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:38.222738 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-aa99cfa5-73f1-4144-9d3d-70e05c6e146c admin admin] The token cache is being invalidate because project c076699de79d42f49fec64601fcc956d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:38.227665 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-aa99cfa5-73f1-4144-9d3d-70e05c6e146c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:38.227665 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-aa99cfa5-73f1-4144-9d3d-70e05c6e146c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:38.227665 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1444/2889] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:37 2022] DELETE /identity/v3/projects/c076699de79d42f49fec64601fcc956d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:38.230287 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccef41-ca92-42f4-87b8-4213f7937571 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:38.230769 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccef41-ca92-42f4-87b8-4213f7937571 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:38.230879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccef41-ca92-42f4-87b8-4213f7937571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:38.253511 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-97ccef41-ca92-42f4-87b8-4213f7937571 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:38.254886 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-97ccef41-ca92-42f4-87b8-4213f7937571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:38.272904 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:38.316311 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1446/2890] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:38.324667 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea44364-1a12-41ba-8c21-3af4aadbfc53 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:38.325369 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea44364-1a12-41ba-8c21-3af4aadbfc53 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:38.325369 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea44364-1a12-41ba-8c21-3af4aadbfc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:38.346616 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-5ea44364-1a12-41ba-8c21-3af4aadbfc53 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:38.347881 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-5ea44364-1a12-41ba-8c21-3af4aadbfc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:38.356068 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1445/2891] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:38.361117 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccef41-ca92-42f4-87b8-4213f7937571 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:38.371243 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccef41-ca92-42f4-87b8-4213f7937571 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:38.376767 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599f371-1603-42ee-b1db-5616022ef698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:38.381741 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599f371-1603-42ee-b1db-5616022ef698 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:38.381741 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599f371-1603-42ee-b1db-5616022ef698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:38.381741 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599f371-1603-42ee-b1db-5616022ef698 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:38.381741 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599f371-1603-42ee-b1db-5616022ef698 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:56:38.381741 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599f371-1603-42ee-b1db-5616022ef698 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:38.381741 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599f371-1603-42ee-b1db-5616022ef698 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:38.392620 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1447/2892] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 14:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:56:38.397096 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea44364-1a12-41ba-8c21-3af4aadbfc53 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:38.407508 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea44364-1a12-41ba-8c21-3af4aadbfc53 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:38.412147 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae6772-f7ab-462d-b960-a155cc76a980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:38.412737 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae6772-f7ab-462d-b960-a155cc76a980 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:38.413013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae6772-f7ab-462d-b960-a155cc76a980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:38.413281 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae6772-f7ab-462d-b960-a155cc76a980 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:38.413935 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae6772-f7ab-462d-b960-a155cc76a980 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:38.415853 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae6772-f7ab-462d-b960-a155cc76a980 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:38.515000 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1446/2893] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:38 2022] POST /identity/v3/projects => generated 369 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:38.519441 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599f371-1603-42ee-b1db-5616022ef698 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:38.530571 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599f371-1603-42ee-b1db-5616022ef698 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:38.586879 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f30b45-6246-49c8-918f-207267260be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:38.587481 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f30b45-6246-49c8-918f-207267260be6 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:38.587755 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f30b45-6246-49c8-918f-207267260be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:38.588024 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f30b45-6246-49c8-918f-207267260be6 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:38.588665 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f30b45-6246-49c8-918f-207267260be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:38.590985 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f30b45-6246-49c8-918f-207267260be6 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:38.673646 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1448/2894] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:38 2022] POST /identity/v3/users => generated 285 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:56:38.677769 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae6772-f7ab-462d-b960-a155cc76a980 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:38.688417 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae6772-f7ab-462d-b960-a155cc76a980 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:38.693111 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975d414-7d87-42d6-ab97-c05f871e6151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:38.693703 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975d414-7d87-42d6-ab97-c05f871e6151 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:38.694013 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975d414-7d87-42d6-ab97-c05f871e6151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:38.694282 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975d414-7d87-42d6-ab97-c05f871e6151 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:38.694989 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975d414-7d87-42d6-ab97-c05f871e6151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:38.696585 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975d414-7d87-42d6-ab97-c05f871e6151 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:38.707188 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1447/2895] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:38.711469 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f30b45-6246-49c8-918f-207267260be6 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:38.722389 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f30b45-6246-49c8-918f-207267260be6 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:38.727072 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb5b8d-6453-46e9-8812-c5bc854550c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:38.727624 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb5b8d-6453-46e9-8812-c5bc854550c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:38.727901 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb5b8d-6453-46e9-8812-c5bc854550c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:38.728169 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb5b8d-6453-46e9-8812-c5bc854550c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:38.728828 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb5b8d-6453-46e9-8812-c5bc854550c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:38.730441 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb5b8d-6453-46e9-8812-c5bc854550c4 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:38.741738 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1449/2896] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:38.746309 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975d414-7d87-42d6-ab97-c05f871e6151 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:38.756581 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975d414-7d87-42d6-ab97-c05f871e6151 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:38.761252 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbbc62-6f38-4109-9a0b-42cf628d9eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:38.761931 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbbc62-6f38-4109-9a0b-42cf628d9eac admin admin] REQUEST_METHOD: `PUT` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:38.762215 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbbc62-6f38-4109-9a0b-42cf628d9eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:38.762490 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbbc62-6f38-4109-9a0b-42cf628d9eac admin admin] PATH_INFO: `/v3/projects/c62ff2597c94498ca5f9873d87edba22/users/9b3b1bc724974112972af06eb577ffe1/roles/a5c4bcef93884b89bf10b2f011d880c8` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:38.777711 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafbbc62-6f38-4109-9a0b-42cf628d9eac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c62ff2597c94498ca5f9873d87edba22, user_id=9b3b1bc724974112972af06eb577ffe1, role_id=a5c4bcef93884b89bf10b2f011d880c8)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:38.781291 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafbbc62-6f38-4109-9a0b-42cf628d9eac admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:38.891891 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1448/2897] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:38 2022] PUT /identity/v3/projects/c62ff2597c94498ca5f9873d87edba22/users/9b3b1bc724974112972af06eb577ffe1/roles/a5c4bcef93884b89bf10b2f011d880c8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:56:38.897133 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842ac3c-06e9-482b-bb7b-664aa081f314 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:38.897422 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842ac3c-06e9-482b-bb7b-664aa081f314 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:38.897698 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842ac3c-06e9-482b-bb7b-664aa081f314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:38.918597 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e842ac3c-06e9-482b-bb7b-664aa081f314 None None] MFA Rules not processed for user `438e8adacb8940c696f3738e6ff13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:38.919987 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e842ac3c-06e9-482b-bb7b-664aa081f314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:38.979109 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1450/2898] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:38.988902 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbbc62-6f38-4109-9a0b-42cf628d9eac admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:38.990671 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-aafbbc62-6f38-4109-9a0b-42cf628d9eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:39.015260 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:39.050865 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbbc62-6f38-4109-9a0b-42cf628d9eac admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:39.054894 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8b565-3d0a-4b1f-8ce6-4a25917e9dcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:39.055492 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8b565-3d0a-4b1f-8ce6-4a25917e9dcf service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:39.055769 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8b565-3d0a-4b1f-8ce6-4a25917e9dcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:39.056038 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8b565-3d0a-4b1f-8ce6-4a25917e9dcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:39.065542 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8b565-3d0a-4b1f-8ce6-4a25917e9dcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:39.067029 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8b565-3d0a-4b1f-8ce6-4a25917e9dcf service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:39.077308 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1449/2899] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:44.790934 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad0a2e-01cd-4c5b-88bd-23d1f60c3152 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:44.791516 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad0a2e-01cd-4c5b-88bd-23d1f60c3152 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:44.791516 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad0a2e-01cd-4c5b-88bd-23d1f60c3152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:44.821982 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-3bad0a2e-01cd-4c5b-88bd-23d1f60c3152 None None] MFA Rules not processed for user `9b3b1bc724974112972af06eb577ffe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:44.823324 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3bad0a2e-01cd-4c5b-88bd-23d1f60c3152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:44.843245 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:44.900811 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1451/2900] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:44.905653 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8b565-3d0a-4b1f-8ce6-4a25917e9dcf service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:44.915687 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8b565-3d0a-4b1f-8ce6-4a25917e9dcf service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:44.920856 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb83f6d-2ff3-41a7-90a5-579e88e35c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:44.921449 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb83f6d-2ff3-41a7-90a5-579e88e35c06 admin admin] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:44.921728 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb83f6d-2ff3-41a7-90a5-579e88e35c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:44.922036 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb83f6d-2ff3-41a7-90a5-579e88e35c06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:44.922673 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb83f6d-2ff3-41a7-90a5-579e88e35c06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:44.924572 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb83f6d-2ff3-41a7-90a5-579e88e35c06 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:45.023620 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1450/2901] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:44 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:45.027420 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad0a2e-01cd-4c5b-88bd-23d1f60c3152 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:45.039395 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad0a2e-01cd-4c5b-88bd-23d1f60c3152 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:45.098448 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e83a30-abfb-42e3-96bc-70e025bd2686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:45.099051 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e83a30-abfb-42e3-96bc-70e025bd2686 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:45.099328 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e83a30-abfb-42e3-96bc-70e025bd2686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:45.099600 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e83a30-abfb-42e3-96bc-70e025bd2686 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:45.100247 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e83a30-abfb-42e3-96bc-70e025bd2686 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:45.102234 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e83a30-abfb-42e3-96bc-70e025bd2686 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:45.206156 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1452/2902] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:45 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:56:45.210144 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb83f6d-2ff3-41a7-90a5-579e88e35c06 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:45.221685 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb83f6d-2ff3-41a7-90a5-579e88e35c06 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:45.226350 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf123a0a-3035-48a0-a873-f632826156a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:45.226945 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf123a0a-3035-48a0-a873-f632826156a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:45.227225 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf123a0a-3035-48a0-a873-f632826156a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:45.227498 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf123a0a-3035-48a0-a873-f632826156a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:45.228136 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf123a0a-3035-48a0-a873-f632826156a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:45.229717 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf123a0a-3035-48a0-a873-f632826156a4 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:45.241116 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1451/2903] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:45.245394 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e83a30-abfb-42e3-96bc-70e025bd2686 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:45.255987 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e83a30-abfb-42e3-96bc-70e025bd2686 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:45.260708 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737afd67-6a64-490f-b40c-4f62a79fcbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:45.261501 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737afd67-6a64-490f-b40c-4f62a79fcbca admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:45.261920 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737afd67-6a64-490f-b40c-4f62a79fcbca admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:45.262282 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737afd67-6a64-490f-b40c-4f62a79fcbca admin admin] PATH_INFO: `/v3/projects/23e7d26ab0fa491c9d1e0eeff66bb453/users/337bd45f52024b9e90c176d6f74e5892/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:45.278171 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737afd67-6a64-490f-b40c-4f62a79fcbca admin admin] RBAC: Authorizing `identity:create_grant(project_id=23e7d26ab0fa491c9d1e0eeff66bb453, user_id=337bd45f52024b9e90c176d6f74e5892, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:45.281529 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737afd67-6a64-490f-b40c-4f62a79fcbca admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:45.380388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1453/2904] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:45 2022] PUT /identity/v3/projects/23e7d26ab0fa491c9d1e0eeff66bb453/users/337bd45f52024b9e90c176d6f74e5892/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:45.384629 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf123a0a-3035-48a0-a873-f632826156a4 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:45.397614 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf123a0a-3035-48a0-a873-f632826156a4 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:45.460486 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822444c3-0bcd-4486-aca5-9876bae4d7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:45.461084 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822444c3-0bcd-4486-aca5-9876bae4d7ac admin admin] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:45.461361 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822444c3-0bcd-4486-aca5-9876bae4d7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:45.461630 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822444c3-0bcd-4486-aca5-9876bae4d7ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:45.462302 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822444c3-0bcd-4486-aca5-9876bae4d7ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:45.463880 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822444c3-0bcd-4486-aca5-9876bae4d7ac admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:45.474837 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1452/2905] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:56:45.479069 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737afd67-6a64-490f-b40c-4f62a79fcbca admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:45.490648 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737afd67-6a64-490f-b40c-4f62a79fcbca admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:45.507211 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36be531-2ffd-4753-aaa8-6228efa7e02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:45.507211 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36be531-2ffd-4753-aaa8-6228efa7e02c admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:45.507211 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36be531-2ffd-4753-aaa8-6228efa7e02c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:45.507211 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36be531-2ffd-4753-aaa8-6228efa7e02c admin admin] PATH_INFO: `/v3/projects/23e7d26ab0fa491c9d1e0eeff66bb453/users/337bd45f52024b9e90c176d6f74e5892/roles/b779073cee3c470ca4ad7a7b27d72c5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:45.507839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36be531-2ffd-4753-aaa8-6228efa7e02c admin admin] RBAC: Authorizing `identity:create_grant(project_id=23e7d26ab0fa491c9d1e0eeff66bb453, user_id=337bd45f52024b9e90c176d6f74e5892, role_id=b779073cee3c470ca4ad7a7b27d72c5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:45.507839 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36be531-2ffd-4753-aaa8-6228efa7e02c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:45.521370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1454/2906] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:45 2022] PUT /identity/v3/projects/23e7d26ab0fa491c9d1e0eeff66bb453/users/337bd45f52024b9e90c176d6f74e5892/roles/b779073cee3c470ca4ad7a7b27d72c5e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:56:51.541802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedde89-c28d-43a7-852d-424833c14a46 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:51.542347 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedde89-c28d-43a7-852d-424833c14a46 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:51.542347 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedde89-c28d-43a7-852d-424833c14a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:51.587046 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-5fedde89-c28d-43a7-852d-424833c14a46 None None] MFA Rules not processed for user `337bd45f52024b9e90c176d6f74e5892`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:51.594760 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-5fedde89-c28d-43a7-852d-424833c14a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:51.681642 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1453/2907] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:51.699005 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36be531-2ffd-4753-aaa8-6228efa7e02c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:51.701684 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a36be531-2ffd-4753-aaa8-6228efa7e02c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:51.787947 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:51.823036 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36be531-2ffd-4753-aaa8-6228efa7e02c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:51.829669 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd386d-82af-46ac-8b7c-f8a0ec39935b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:51.830351 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd386d-82af-46ac-8b7c-f8a0ec39935b service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:51.830629 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd386d-82af-46ac-8b7c-f8a0ec39935b service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:51.830897 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd386d-82af-46ac-8b7c-f8a0ec39935b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:51.893506 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd386d-82af-46ac-8b7c-f8a0ec39935b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:51.895114 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd386d-82af-46ac-8b7c-f8a0ec39935b service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:51.904522 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1455/2908] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:55.044553 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a512c-1dd0-4eac-bd93-4c0160992d18 None None] REQUEST_METHOD: `POST` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:55.045119 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a512c-1dd0-4eac-bd93-4c0160992d18 None None] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:55.045119 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a512c-1dd0-4eac-bd93-4c0160992d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:55.065403 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.auth.core [None req-000a512c-1dd0-4eac-bd93-4c0160992d18 None None] MFA Rules not processed for user `9b3b1bc724974112972af06eb577ffe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:55.066666 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-000a512c-1dd0-4eac-bd93-4c0160992d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:55.073677 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1454/2909] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:02.250644 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=36 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:05.059152 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:15.838727 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd386d-82af-46ac-8b7c-f8a0ec39935b service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:15.840926 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-18bd386d-82af-46ac-8b7c-f8a0ec39935b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:15.933010 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd386d-82af-46ac-8b7c-f8a0ec39935b service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:15.938421 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f22e5-d38c-4ab1-a387-ddba39c086ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63253cd786c04d6a9d099773198aee36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:15.939033 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f22e5-d38c-4ab1-a387-ddba39c086ef service placement] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:15.939333 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f22e5-d38c-4ab1-a387-ddba39c086ef service placement] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:15.939721 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f22e5-d38c-4ab1-a387-ddba39c086ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:15.941462 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9a6f22e5-d38c-4ab1-a387-ddba39c086ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:15.953286 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f22e5-d38c-4ab1-a387-ddba39c086ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:15.954928 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f22e5-d38c-4ab1-a387-ddba39c086ef service placement] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:15.965817 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1456/2910] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:57:25.960692 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=41 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:35.716776 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a512c-1dd0-4eac-bd93-4c0160992d18 None None] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:35.731159 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a512c-1dd0-4eac-bd93-4c0160992d18 None None] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:35.737097 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4e1e1-4cd5-449a-8e45-d35db5f6df31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:35.737694 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4e1e1-4cd5-449a-8e45-d35db5f6df31 service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:35.738015 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4e1e1-4cd5-449a-8e45-d35db5f6df31 service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:35.738282 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4e1e1-4cd5-449a-8e45-d35db5f6df31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:35.740230 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d1c4e1e1-4cd5-449a-8e45-d35db5f6df31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:35.753353 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4e1e1-4cd5-449a-8e45-d35db5f6df31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:35.754956 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4e1e1-4cd5-449a-8e45-d35db5f6df31 service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:35.766676 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1455/2911] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:57:38.917911 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f22e5-d38c-4ab1-a387-ddba39c086ef service placement] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:38.972675 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f22e5-d38c-4ab1-a387-ddba39c086ef service placement] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:38.976354 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75086cb1-8cfe-499e-b221-ca357d8a026b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:38.976951 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75086cb1-8cfe-499e-b221-ca357d8a026b service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:38.977228 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75086cb1-8cfe-499e-b221-ca357d8a026b service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:38.977497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75086cb1-8cfe-499e-b221-ca357d8a026b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:38.987632 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75086cb1-8cfe-499e-b221-ca357d8a026b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:38.989085 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75086cb1-8cfe-499e-b221-ca357d8a026b service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:38.999279 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1457/2912] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:57:45.761261 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=6 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:48.994361 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=26 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:20.565450 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4e1e1-4cd5-449a-8e45-d35db5f6df31 service nova] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:20.575015 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4e1e1-4cd5-449a-8e45-d35db5f6df31 service nova] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:20.578778 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa13ba-b79d-43ce-b14e-f2383d32464b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:20.579418 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa13ba-b79d-43ce-b14e-f2383d32464b service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:20.579692 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa13ba-b79d-43ce-b14e-f2383d32464b service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:20.579960 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa13ba-b79d-43ce-b14e-f2383d32464b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:20.581663 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-03aa13ba-b79d-43ce-b14e-f2383d32464b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:20.592859 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa13ba-b79d-43ce-b14e-f2383d32464b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:20.594339 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa13ba-b79d-43ce-b14e-f2383d32464b service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:20.603315 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1456/2913] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:59:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:59:30.598758 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=6 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:55.850683 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75086cb1-8cfe-499e-b221-ca357d8a026b service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:55.864255 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75086cb1-8cfe-499e-b221-ca357d8a026b service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:55.868188 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6939a-f071-46b4-86ad-29cc26319139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:55.869337 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6939a-f071-46b4-86ad-29cc26319139 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:55.870835 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6939a-f071-46b4-86ad-29cc26319139 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:55.870835 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6939a-f071-46b4-86ad-29cc26319139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:55.872232 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-16a6939a-f071-46b4-86ad-29cc26319139 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:55.887641 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6939a-f071-46b4-86ad-29cc26319139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:55.891134 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6939a-f071-46b4-86ad-29cc26319139 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:55.901355 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1458/2914] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:59:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:59:57.088595 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa13ba-b79d-43ce-b14e-f2383d32464b service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:57.097553 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa13ba-b79d-43ce-b14e-f2383d32464b service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:57.101206 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3903b20-7b62-460c-a7f0-6bc3d367a483 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:57.101828 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3903b20-7b62-460c-a7f0-6bc3d367a483 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:57.102109 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3903b20-7b62-460c-a7f0-6bc3d367a483 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:57.102424 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3903b20-7b62-460c-a7f0-6bc3d367a483 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:57.104369 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a3903b20-7b62-460c-a7f0-6bc3d367a483 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:57.117983 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3903b20-7b62-460c-a7f0-6bc3d367a483 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:57.119599 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3903b20-7b62-460c-a7f0-6bc3d367a483 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:57.130726 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1457/2915] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 14:59:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:00:05.896146 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=6 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:07.125764 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=6 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:10.355621 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6939a-f071-46b4-86ad-29cc26319139 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:00:10.364292 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6939a-f071-46b4-86ad-29cc26319139 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:00:10.367922 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ad61b-3053-40e1-8d44-f6639b27d306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:00:10.369159 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ad61b-3053-40e1-8d44-f6639b27d306 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:00:10.369425 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ad61b-3053-40e1-8d44-f6639b27d306 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:00:10.369694 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ad61b-3053-40e1-8d44-f6639b27d306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:00:10.371447 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-879ad61b-3053-40e1-8d44-f6639b27d306 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:00:10.380857 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ad61b-3053-40e1-8d44-f6639b27d306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:00:10.382296 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ad61b-3053-40e1-8d44-f6639b27d306 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:00:10.390388 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1459/2916] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 15:00:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:00:10.764928 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3903b20-7b62-460c-a7f0-6bc3d367a483 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:00:10.766575 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-a3903b20-7b62-460c-a7f0-6bc3d367a483 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:00:10.777678 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3903b20-7b62-460c-a7f0-6bc3d367a483 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:00:10.781491 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabfe94-dc3d-4ae1-a194-eb1de8ac9fd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:00:10.782200 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabfe94-dc3d-4ae1-a194-eb1de8ac9fd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:00:10.782558 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabfe94-dc3d-4ae1-a194-eb1de8ac9fd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:00:10.782902 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabfe94-dc3d-4ae1-a194-eb1de8ac9fd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:00:10.784958 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-9fabfe94-dc3d-4ae1-a194-eb1de8ac9fd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:00:10.796172 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fabfe94-dc3d-4ae1-a194-eb1de8ac9fd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:00:10.798110 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fabfe94-dc3d-4ae1-a194-eb1de8ac9fd4 service neutron] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:00:10.807316 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1458/2917] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 15:00:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:00:10.897426 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ad61b-3053-40e1-8d44-f6639b27d306 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:00:10.906488 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ad61b-3053-40e1-8d44-f6639b27d306 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:00:10.910371 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7b8e3-0a15-482d-a693-bb004c94192f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:00:10.910999 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7b8e3-0a15-482d-a693-bb004c94192f service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:00:10.911271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7b8e3-0a15-482d-a693-bb004c94192f service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:00:10.911539 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7b8e3-0a15-482d-a693-bb004c94192f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:00:10.913361 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f4b7b8e3-0a15-482d-a693-bb004c94192f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:00:10.928442 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7b8e3-0a15-482d-a693-bb004c94192f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:00:10.929813 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7b8e3-0a15-482d-a693-bb004c94192f service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:00:10.942138 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1460/2918] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 15:00:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:00:11.007338 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabfe94-dc3d-4ae1-a194-eb1de8ac9fd4 service neutron] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:00:11.019530 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabfe94-dc3d-4ae1-a194-eb1de8ac9fd4 service neutron] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:00:11.024643 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf1987-03ee-44b3-9958-2b2d4e8b07f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63253cd786c04d6a9d099773198aee36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:00:11.025230 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf1987-03ee-44b3-9958-2b2d4e8b07f3 service placement] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:00:11.025505 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf1987-03ee-44b3-9958-2b2d4e8b07f3 service placement] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:00:11.025802 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf1987-03ee-44b3-9958-2b2d4e8b07f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:00:11.027484 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d1cf1987-03ee-44b3-9958-2b2d4e8b07f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:00:11.039129 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf1987-03ee-44b3-9958-2b2d4e8b07f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:00:11.041461 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf1987-03ee-44b3-9958-2b2d4e8b07f3 service placement] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:00:11.051453 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1459/2919] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 15:00:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:00:20.936764 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=12 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:21.047096 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=12 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:01:56.280652 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7b8e3-0a15-482d-a693-bb004c94192f service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:56.290591 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7b8e3-0a15-482d-a693-bb004c94192f service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:56.294239 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8c64d-0938-4b83-a041-71b4ae33e77a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:56.294827 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8c64d-0938-4b83-a041-71b4ae33e77a service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:56.295105 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8c64d-0938-4b83-a041-71b4ae33e77a service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:56.295399 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8c64d-0938-4b83-a041-71b4ae33e77a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:56.303590 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8c64d-0938-4b83-a041-71b4ae33e77a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:56.306599 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8c64d-0938-4b83-a041-71b4ae33e77a service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:56.314320 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1461/2920] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 15:01:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:01:57.251059 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf1987-03ee-44b3-9958-2b2d4e8b07f3 service placement] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:57.252537 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-d1cf1987-03ee-44b3-9958-2b2d4e8b07f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:57.270727 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf1987-03ee-44b3-9958-2b2d4e8b07f3 service placement] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:57.276246 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347aa60b-a636-44f7-baf8-c0ba0a286d4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d099678d6454f7eb494892a69feaf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:57.276882 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347aa60b-a636-44f7-baf8-c0ba0a286d4f service nova] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:57.277160 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347aa60b-a636-44f7-baf8-c0ba0a286d4f service nova] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:57.277429 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347aa60b-a636-44f7-baf8-c0ba0a286d4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:57.279374 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-347aa60b-a636-44f7-baf8-c0ba0a286d4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:57.300356 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347aa60b-a636-44f7-baf8-c0ba0a286d4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:57.300356 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347aa60b-a636-44f7-baf8-c0ba0a286d4f service nova] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:57.310592 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1460/2921] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 15:01:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:02:02.872967 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8c64d-0938-4b83-a041-71b4ae33e77a service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:02.881991 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8c64d-0938-4b83-a041-71b4ae33e77a service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:02.885857 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d2de6-f9f8-4cd6-91a2-087d69624f51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5021b569db41a08218cbec928442af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:02.886453 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d2de6-f9f8-4cd6-91a2-087d69624f51 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:02.886730 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d2de6-f9f8-4cd6-91a2-087d69624f51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:02.887003 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d2de6-f9f8-4cd6-91a2-087d69624f51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:02.952953 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d2de6-f9f8-4cd6-91a2-087d69624f51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:02.954490 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d2de6-f9f8-4cd6-91a2-087d69624f51 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:02.966795 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1462/2922] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 15:02:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:02:07.019805 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347aa60b-a636-44f7-baf8-c0ba0a286d4f service nova] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:07.021233 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-347aa60b-a636-44f7-baf8-c0ba0a286d4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:07.037011 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347aa60b-a636-44f7-baf8-c0ba0a286d4f service nova] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:07.043020 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eebafe-2437-4f9b-a64f-9fcdfd47f296 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63253cd786c04d6a9d099773198aee36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:07.043686 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eebafe-2437-4f9b-a64f-9fcdfd47f296 service placement] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:07.043968 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eebafe-2437-4f9b-a64f-9fcdfd47f296 service placement] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:07.044244 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eebafe-2437-4f9b-a64f-9fcdfd47f296 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:07.047084 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-e3eebafe-2437-4f9b-a64f-9fcdfd47f296 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:07.060648 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eebafe-2437-4f9b-a64f-9fcdfd47f296 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:07.062301 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eebafe-2437-4f9b-a64f-9fcdfd47f296 service placement] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:07.073610 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1461/2923] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 15:02:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:02:10.970592 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d2de6-f9f8-4cd6-91a2-087d69624f51 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:10.983206 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d2de6-f9f8-4cd6-91a2-087d69624f51 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:10.990417 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b087b60-3e06-4d49-a4a3-ff208def9ced service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63253cd786c04d6a9d099773198aee36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:10.991565 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b087b60-3e06-4d49-a4a3-ff208def9ced service placement] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:10.991867 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b087b60-3e06-4d49-a4a3-ff208def9ced service placement] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:10.992141 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b087b60-3e06-4d49-a4a3-ff208def9ced service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:10.993970 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2b087b60-3e06-4d49-a4a3-ff208def9ced service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:11.007585 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b087b60-3e06-4d49-a4a3-ff208def9ced service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:11.009269 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b087b60-3e06-4d49-a4a3-ff208def9ced service placement] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:11.021370 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1463/2924] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 15:02:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:02:11.132396 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eebafe-2437-4f9b-a64f-9fcdfd47f296 service placement] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:11.141933 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eebafe-2437-4f9b-a64f-9fcdfd47f296 service placement] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:11.146496 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dab067-3dd7-4a11-8a73-3f23052c1328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:11.147120 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dab067-3dd7-4a11-8a73-3f23052c1328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:11.147418 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dab067-3dd7-4a11-8a73-3f23052c1328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:11.147690 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dab067-3dd7-4a11-8a73-3f23052c1328 admin admin] PATH_INFO: `/v3/users/9b3b1bc724974112972af06eb577ffe1` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:11.148810 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dab067-3dd7-4a11-8a73-3f23052c1328 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b3b1bc724974112972af06eb577ffe1)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:11.150954 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dab067-3dd7-4a11-8a73-3f23052c1328 admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:11.416722 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c3dab067-3dd7-4a11-8a73-3f23052c1328 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b3b1bc724974112972af06eb577ffe1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:11.417389 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c3dab067-3dd7-4a11-8a73-3f23052c1328 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b3b1bc724974112972af06eb577ffe1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:11.432949 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c3dab067-3dd7-4a11-8a73-3f23052c1328 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b3b1bc724974112972af06eb577ffe1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:11.433716 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c3dab067-3dd7-4a11-8a73-3f23052c1328 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b3b1bc724974112972af06eb577ffe1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:11.534374 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-c3dab067-3dd7-4a11-8a73-3f23052c1328 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b3b1bc724974112972af06eb577ffe1'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:11.548462 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1462/2925] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 15:02:11 2022] DELETE /identity/v3/users/9b3b1bc724974112972af06eb577ffe1 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:02:11.917507 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b087b60-3e06-4d49-a4a3-ff208def9ced service placement] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:11.929196 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b087b60-3e06-4d49-a4a3-ff208def9ced service placement] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:12.003580 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd96e5-b69a-4fe1-96d9-ac78d362e31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:12.005010 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd96e5-b69a-4fe1-96d9-ac78d362e31b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:12.005282 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd96e5-b69a-4fe1-96d9-ac78d362e31b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:12.005550 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd96e5-b69a-4fe1-96d9-ac78d362e31b admin admin] PATH_INFO: `/v3/projects/c62ff2597c94498ca5f9873d87edba22` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:12.006781 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd96e5-b69a-4fe1-96d9-ac78d362e31b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c62ff2597c94498ca5f9873d87edba22)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:12.008699 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd96e5-b69a-4fe1-96d9-ac78d362e31b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:12.146959 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-95bd96e5-b69a-4fe1-96d9-ac78d362e31b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c62ff2597c94498ca5f9873d87edba22', 'request_id': 'req-95bd96e5-b69a-4fe1-96d9-ac78d362e31b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:12.236906 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-95bd96e5-b69a-4fe1-96d9-ac78d362e31b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c62ff2597c94498ca5f9873d87edba22', 'request_id': 'req-95bd96e5-b69a-4fe1-96d9-ac78d362e31b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:12.244117 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-95bd96e5-b69a-4fe1-96d9-ac78d362e31b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c62ff2597c94498ca5f9873d87edba22', 'request_id': 'req-95bd96e5-b69a-4fe1-96d9-ac78d362e31b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:12.252271 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:02:12.257428 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-95bd96e5-b69a-4fe1-96d9-ac78d362e31b admin admin] The token cache is being invalidate because project c62ff2597c94498ca5f9873d87edba22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:02:12.257723 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-95bd96e5-b69a-4fe1-96d9-ac78d362e31b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:12.261142 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-95bd96e5-b69a-4fe1-96d9-ac78d362e31b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:12.261875 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1464/2926] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 15:02:11 2022] DELETE /identity/v3/projects/c62ff2597c94498ca5f9873d87edba22 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:02:12.266730 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dab067-3dd7-4a11-8a73-3f23052c1328 admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:12.268139 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-c3dab067-3dd7-4a11-8a73-3f23052c1328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:12.281618 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dab067-3dd7-4a11-8a73-3f23052c1328 admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:12.338894 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b73e4-36ba-47f9-aff4-fc1f980b1baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:12.339545 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b73e4-36ba-47f9-aff4-fc1f980b1baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:12.339830 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b73e4-36ba-47f9-aff4-fc1f980b1baa admin admin] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:12.340107 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b73e4-36ba-47f9-aff4-fc1f980b1baa admin admin] PATH_INFO: `/v3/users/337bd45f52024b9e90c176d6f74e5892` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:12.341303 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b73e4-36ba-47f9-aff4-fc1f980b1baa admin admin] RBAC: Authorizing `identity:delete_user(user_id=337bd45f52024b9e90c176d6f74e5892)` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:12.343316 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b73e4-36ba-47f9-aff4-fc1f980b1baa admin admin] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:12.532371 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-684b73e4-36ba-47f9-aff4-fc1f980b1baa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '337bd45f52024b9e90c176d6f74e5892'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:12.532972 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-684b73e4-36ba-47f9-aff4-fc1f980b1baa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '337bd45f52024b9e90c176d6f74e5892'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:12.534221 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:02:12.546514 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-684b73e4-36ba-47f9-aff4-fc1f980b1baa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '337bd45f52024b9e90c176d6f74e5892'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:12.547257 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-684b73e4-36ba-47f9-aff4-fc1f980b1baa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '337bd45f52024b9e90c176d6f74e5892'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:12.677449 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.notifications [None req-684b73e4-36ba-47f9-aff4-fc1f980b1baa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '337bd45f52024b9e90c176d6f74e5892'} {{(pid=81742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:12.693786 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1463/2927] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 15:02:12 2022] DELETE /identity/v3/users/337bd45f52024b9e90c176d6f74e5892 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:02:12.976563 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd96e5-b69a-4fe1-96d9-ac78d362e31b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:12.978422 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-95bd96e5-b69a-4fe1-96d9-ac78d362e31b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:12.998333 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd96e5-b69a-4fe1-96d9-ac78d362e31b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:13.058464 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb87d1-0c38-42a9-885a-425ecefbe068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438e8adacb8940c696f3738e6ff13c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4410563d8b45fea6a29fd68277b77c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:13.059497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb87d1-0c38-42a9-885a-425ecefbe068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:13.059497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb87d1-0c38-42a9-885a-425ecefbe068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:13.059497 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb87d1-0c38-42a9-885a-425ecefbe068 admin admin] PATH_INFO: `/v3/projects/23e7d26ab0fa491c9d1e0eeff66bb453` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:13.060633 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb87d1-0c38-42a9-885a-425ecefbe068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23e7d26ab0fa491c9d1e0eeff66bb453)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:13.063237 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb87d1-0c38-42a9-885a-425ecefbe068 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:13.186089 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7dcb87d1-0c38-42a9-885a-425ecefbe068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23e7d26ab0fa491c9d1e0eeff66bb453', 'request_id': 'req-7dcb87d1-0c38-42a9-885a-425ecefbe068'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:13.298737 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7dcb87d1-0c38-42a9-885a-425ecefbe068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23e7d26ab0fa491c9d1e0eeff66bb453', 'request_id': 'req-7dcb87d1-0c38-42a9-885a-425ecefbe068'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:13.305671 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7dcb87d1-0c38-42a9-885a-425ecefbe068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23e7d26ab0fa491c9d1e0eeff66bb453', 'request_id': 'req-7dcb87d1-0c38-42a9-885a-425ecefbe068'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:13.316494 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7dcb87d1-0c38-42a9-885a-425ecefbe068 admin admin] The token cache is being invalidate because project 23e7d26ab0fa491c9d1e0eeff66bb453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:02:13.316715 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7dcb87d1-0c38-42a9-885a-425ecefbe068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:13.317395 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7dcb87d1-0c38-42a9-885a-425ecefbe068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:13.319012 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1465/2928] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 15:02:12 2022] DELETE /identity/v3/projects/23e7d26ab0fa491c9d1e0eeff66bb453 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:02:19.798211 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b73e4-36ba-47f9-aff4-fc1f980b1baa admin admin] Authenticating user token {{(pid=81742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:19.799734 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-684b73e4-36ba-47f9-aff4-fc1f980b1baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:19.870795 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b73e4-36ba-47f9-aff4-fc1f980b1baa admin admin] Validating token access rules against request {{(pid=81742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:19.930623 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea96917-e656-4692-91d2-ec7caacd8349 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63253cd786c04d6a9d099773198aee36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:19.931168 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea96917-e656-4692-91d2-ec7caacd8349 service placement] REQUEST_METHOD: `GET` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:19.931450 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea96917-e656-4692-91d2-ec7caacd8349 service placement] SCRIPT_NAME: `/identity` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:19.931723 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea96917-e656-4692-91d2-ec7caacd8349 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:19.933445 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.fernet_utils [None req-0ea96917-e656-4692-91d2-ec7caacd8349 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:19.945636 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea96917-e656-4692-91d2-ec7caacd8349 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:19.947241 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea96917-e656-4692-91d2-ec7caacd8349 service placement] RBAC: Authorization granted {{(pid=81742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:19.958177 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: [pid: 81742|app: 0|req: 1464/2929] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 15:02:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:02:23.313206 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:02:29.953711 dv-cinder-756710-6-iscsi devstack@keystone.service[81742]: DEBUG dbcounter [-] [81742] Writing DB stats keystone:SELECT=70,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:07:21.818912 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb87d1-0c38-42a9-885a-425ecefbe068 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:07:21.820331 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7dcb87d1-0c38-42a9-885a-425ecefbe068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:07:21.911693 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb87d1-0c38-42a9-885a-425ecefbe068 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:07:21.919995 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ae305-4649-4428-9b64-46b06b097107 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63253cd786c04d6a9d099773198aee36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34cce205e8ee4ae9b09bb89bc4bb081e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:07:21.919995 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ae305-4649-4428-9b64-46b06b097107 service placement] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:07:21.919995 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ae305-4649-4428-9b64-46b06b097107 service placement] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:07:21.919995 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ae305-4649-4428-9b64-46b06b097107 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:07:21.926955 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ae305-4649-4428-9b64-46b06b097107 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:07:21.928547 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ae305-4649-4428-9b64-46b06b097107 service placement] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:07:21.939009 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1466/2930] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 15:07:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:07:31.934107 dv-cinder-756710-6-iscsi devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=37 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}